gecko-dev/webtools/tinderbox/robots.txt

mirror of https://github.com/mozilla/gecko-dev.git synced 2024-11-05 08:35:26 +00:00
User-agent: *
Allow: /index.html
Disallow: /
If the application is set up at the server root (e.g. bugzilla.mozilla.org) then this robots.txt disallows robots from scanning the site except for the top level file. 2000-07-28 21:28:41 +00:00			`User-agent: *`
			`Allow: /index.html`
			`Disallow: /`