# robots.txt User-agent: Googlebot Disallow:  User-agent: MSNBot Disallow:  User-agent: Slurp Disallow:  User-agent: Teoma Disallow:  User-agent: Gigabot Disallow:  User-agent: Scrubby Disallow:  User-agent: Robozilla Disallow:  User-agent: Nutch Disallow:  User-agent: ia_archiver Disallow:  User-agent: baiduspider Disallow:  User-agent: * Disallow:  Disallow: /cgi-bin/