User-agent: * Disallow: /401.shtml Disallow: /403.shtml Disallow: /404.shtml Disallow: /500.shtml Disallow: /thanks.shtml Disallow: /awstats/ Disallow: /cgi-bin/ Disallow: /counters/ Disallow: /images/ Disallow: /mail/ Disallow: /php/ User-agent: IconSurf Disallow: / User-agent: NextGenSearchBot Disallow: / User-agent: twiceler Disallow: /