bintzwing/robots.txt

# Might as well keep robots away for performance and privacy reasons.
User-agent: *
Disallow: /
Allow: /index.php
For server-load and privacy reasons, disallow robots. 2012-08-02 15:23:04 +00:00			`# Might as well keep robots away for performance and privacy reasons.`
			`User-agent: *`
Incorrect structure The structure for robots.txt is incorrect for some/most search engines. 2013-11-01 00:22:16 +00:00			`Disallow: /`
Change order of allow rule in robots.txt I think this is the proper order. Don't know if it matters, but it is not bad to change it in any case. 2016-07-03 11:05:26 +00:00			`Allow: /index.php`