webwml/robots.txt

mirror of https://github.com/torproject/webwml.git synced 2025-01-21 17:54:27 +00:00
Sitemap: http://www.torproject.org/sitemap.xml
Sitemap: https://www.torproject.org/sitemap.xml
User-Agent: *
Allow: /
update robots.txt with sitemap, thanks to BarkerJr 2009-07-18 20:46:15 +00:00			`Sitemap: http://www.torproject.org/sitemap.xml`
			`Sitemap: https://www.torproject.org/sitemap.xml`
Update robots.txt. 2007-10-16 02:24:51 +00:00			`User-Agent: *`
update robots.txt to make it valid. 2010-07-12 18:35:11 +00:00			`Allow: /`