User-agent: .NET Framework Test Client Disallow: / User-agent: Baiduspider+(+http://www.baidu.com/search/spider_jp.html) Disallow: / User-agent: Mediapartners-Google Disallow: / User-agent: Adsbot-Google Disallow: / User-agent: Jeeves Disallow: / User-agent: Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; FunWebProducts; yie5.5_SBCDSL; SV1; .NET CLR 1.1.4322) Disallow: / User-agent: Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; KKman2.0) Disallow: / User-agent: Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; FunWebProducts; YPC 3.2.0; .NET CLR 1.1.4322; .NET CLR 2.0.50727; Zango 10.0.370.0; yplus 5.1.04b) Disallow: / User-agent: Mozilla/4.0 (compatible; MSIE 7.0; AOL 9.0; Windows NT 5.1; acc=vonner; acc=none; (none); iebar; FunWebProducts; .NET CLR 1.1.4322) Disallow: / User-agent: Mozilla/4.0 (compatible; NaverBot/1.0; http://help.naver.com/delete_main.asp) Disallow: / User-agent: Mozilla/5.0 (Twiceler-0.9 http://www.cuil.com/twiceler/robot.html) Disallow: / User-agent: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1) Gecko/20061010 Firefox/2.0 Me.dium/1.0 (http://me.dium.com) Disallow: / User-agent: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9) Gecko/2008052906 Firefox/3.0/1.0 (bot; http://) Disallow: / User-agent: Mozilla/5.0 (Windows; U; Windows NT 5.1; fr; rv:1.8.1) VoilaBot BETA 1.2 (support.voilabot@orange-ftgroup.com) Disallow: / User-agent: Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.0.4) Gecko/2008102920 Firefox/3.0.4 Disallow: / User-agent: Mozilla/5.0 (X11; U; Linux 2.4.2-2 i586; en-US; m18) Gecko/20010131 Netscape6/6.01 Disallow: / User-agent: Mozilla/5.0 (compatible; Charlotte/1.1; http://www.searchme.com/support/) Disallow: / User-agent: Mozilla/5.0 (compatible; Exabot/3.0; +http://www.exabot.com/go/robot) Disallow: / User-agent: Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) Disallow: / User-agent: Mozilla/5.0 (compatible; NetcraftSurveyAgent/1.0; +info@netcraft.com) Disallow: / User-agent: Mozilla/5.0 (compatible; WebDataCentreBot/1.0; +http://WebDataCentre.com/) Disallow: / User-agent: Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) Disallow: / User-agent: Mozilla/5.0 (compatible; discobot/1.0; +http://discoveryengine.com/discobot.html) Disallow: / User-agent: Slurp Disallow: / User-agent: Sogou web spider/4.0(+http://www.sogou.com/docs/help/webmasters.htm#07) Disallow: / User-agent: Speedy Spider (http://www.entireweb.com/about/search_tech/speedy_spider/) Disallow: / User-agent: SurveyBot/2.3 (Whois Source) Disallow: / User-agent: msnbot Disallow: / User-agent: psbot Disallow: / User-agent: msnbot/1.1 (+http://search.msn.com/msnbot.htm) Disallow: / User-agent: * Crawl-delay: 999.00 Disallow: /pics Disallow: /*.gif$ Disallow: /*.Gif$ Disallow: /*.GIF$ Disallow: /*.jpg$ Disallow: /*.Jpg$ Disallow: /*.JPG$ Disallow: /*.jpeg$ Disallow: /*.Jpeg$ Disallow: /*.JPEG$ Disallow: /*.pdf$ Disallow: /*.Pdf$ Disallow: /*.PDF$ Disallow: /*.zip$ Disallow: /*.Zip$ Disallow: /*.ZIP$