Opened 8 years ago

Closed 8 years ago

#1858 closed task (fixed)

Add robots.txt for git.osgeo.org

Reported by: strk Owned by: sac@…
Priority: normal Milestone:
Component: SysAdmin Keywords: git
Cc:

Description

It's currently unavailable, creating issues like #1857

Change History (1)

comment:1 by strk, 8 years ago

Resolution: fixed
Status: newclosed

I've installed a robots.txt file disallowing every bot access for all of git.osgeo.org. Can be tweaked in the future but for now it's the simplest thing to do as robots.txt format does not allow globbing and thus would require an update everytime a new repository is created.

An upstream ticket for autogenerating robots.txt is here: https://github.com/go-gitea/gitea/issues/705

But it would only work (if ever implemented) by serving the service from top-level directory (not curretnly the case).

Note: See TracTickets for help on using tickets.