robots

# This file contains User-Agent mappings for robots
#
# WWW Search Engines
Googlebot http://www.googlebot.com/bot.html IGNORE
FAST-WebCrawler http://fast.no/support/crawler.asp IGNORE
Slurp http://www.inktomi.com/slurp.html IGNORE
Teoma http://www.teoma.com/ IGNORE
#
# Syndication Crawler
Syndic8 http://www.syndic8.com IGNORE
organica http://organica.us  IGNORE
Popdexter http://www.popdex.com IGNORE
#
# Robots and crawler to be ignored
#
ZyBorg http://www.WISEnutbot.com IGNORE
larbon liston@cc.gatech.edu IGNORE
Baiduspider http://www.baidu.com/search/spider.htm IGNORE
Infoseek http://www.infoseek.com/ IGNORE
TurnitinBot http://www.turnitin.com/robot/crawlerinfo.html IGNORE
NIF http://www.newsisfree.com/robot.php IGNORE
NPBot http://www.nameprotect.com/botinfo.html IGNORE
Robot ??? IGNORE
Scooter ??? IGNORE
Mercator ??? IGNORE
EvilBot ??? IGNORE
BlogBot ??? IGNORE