gecko-dev/robots.txt at 8e0d9cbfa0bd5c19e203b5d40e4f696eb23ebcb9 - gecko-dev - Gitea: Git with a cup of tea

Magic-Mirror/gecko-dev

mirror of https://github.com/mozilla/gecko-dev.git synced 2024-10-31 22:25:30 +00:00

endico%mozilla.org 03ace48c70 If the application is set up at the server root (e.g. bugzilla.mozilla.org) then this robots.txt disallows robots from scanning the site except for the top level file.

2000-07-28 21:28:41 +00:00

4 lines

45 B

Plaintext

Raw Blame History

	`User-agent: *`
	`Allow: /index.html`
	`Disallow: /`