# Robots.txt # For domain: http://www.htep.pl # All robots will spider the domain User-agent: * Disallow: /cgi-bin/ Disallow: /stats/ Disallow: /webalizer/ Disallow: /phpmailer/ Disallow: /admin/ Disallow: /includes/