# alphaSpider behaves bad, too fast request, and has no contact info in its user agent User-agent: alphaSpider Disallow: / # This is a spider trap, hope your spider doesn't end up in here User-agent: * Disallow: /private Disallow: /cgi-bin