# robots.txt files can be validated at http://www.searchengineworld.com/cgi-bin/robotcheck.cgi # # No user-agents should index /mt/, /errors/ /cgi-bin/ User-agent: * Disallow: /mt/ Disallow: /errors/ Disallow: /cgi-bin/