Currently, `robots.txt` content is hardcoded in `client/server/constants.ts`. Adding or modifying rules requires a code change and creating a new release. We should expose this as a Helm value, so that Renku admins can easily modify it.
Currently,
robots.txtcontent is hardcoded inclient/server/constants.ts. Adding or modifying rules requires a code change and creating a new release.We should expose this as a Helm value, so that Renku admins can easily modify it.