Magic-Mirror/gecko-dev
1
0
Fork 0
mirror of https://github.com/mozilla/gecko-dev.git synced 2024-11-05 08:35:26 +00:00
Code Issues Actions Packages Projects Releases Wiki Activity
b2cc0a38df
gecko-dev/webtools/bugzilla/robots.txt

4 lines
44 B
Plaintext
Raw Normal View History

If the application is set up at the server root (e.g. bugzilla.mozilla.org) then this robots.txt disallows robots from scanning the site except for the top level file.
2000-07-28 21:28:41 +00:00
User-agent: *
Bug 139800 - remove errant references to index.html. Patch by ddk, 2xr=gerv.
2002-04-24 18:11:00 +00:00
Allow: /index.cgi
If the application is set up at the server root (e.g. bugzilla.mozilla.org) then this robots.txt disallows robots from scanning the site except for the top level file.
2000-07-28 21:28:41 +00:00
Disallow: /
Reference in New Issue Copy Permalink