I've installed a robots.txt file disallowing every bot access for all of git.osgeo.org. Can be tweaked in the future but for now it's the simplest thing to do as robots.txt format does not allow globbing and thus would require an update everytime a new repository is created.
I've installed a
robots.txt
file disallowing every bot access for all ofgit.osgeo.org
. Can be tweaked in the future but for now it's the simplest thing to do asrobots.txt
format does not allow globbing and thus would require an update everytime a new repository is created.An upstream ticket for autogenerating robots.txt is here: https://github.com/go-gitea/gitea/issues/705
But it would only work (if ever implemented) by serving the service from top-level directory (not curretnly the case).