User-agent: Exabot Allow: / Disallow: /media/ Disallow: /cgi-bin/ Disallow: /shopsite-data/ Disallow: /shopsite-images/ Disallow: /tmp/ Disallow: /ssl/ Disallow: /etc/ Disallow: /.trash/ Disallow: /.cpanel/ Disallow: /mail/ Disallow: /smarthtml/ User-Agent: 193.47.80.69 Allow: / Disallow: /media/ Disallow: /cgi-bin/ Disallow: /shopsite-data/ Disallow: /shopsite-images/ Disallow: /tmp/ Disallow: /ssl/ Disallow: /etc/ Disallow: /.trash/ Disallow: /.cpanel/ Disallow: /mail/ Disallow: /smarthtml/ User-Agent: entireweb.com Allow: / Disallow: /media/ Disallow: /cgi-bin/ Disallow: /shopsite-data/ Disallow: /shopsite-images/ Disallow: /tmp/ Disallow: /ssl/ Disallow: /etc/ Disallow: /.trash/ Disallow: /.cpanel/ Disallow: /mail/ Disallow: /smarthtml/ User-Agent: 89.150.197.4 Allow: / Disallow: /media/ Disallow: /cgi-bin/ Disallow: /shopsite-data/ Disallow: /shopsite-images/ Disallow: /tmp/ Disallow: /ssl/ Disallow: /etc/ Disallow: /.trash/ Disallow: /.cpanel/ Disallow: /mail/ Disallow: /smarthtml/ User-Agent: Googlebot Allow: / Disallow: /media/ Disallow: /cgi-bin/ Disallow: /shopsite-data/ Disallow: /shopsite-images/ Disallow: /tmp/ Disallow: /ssl/ Disallow: /etc/ Disallow: /.trash/ Disallow: /.cpanel/ Disallow: /mail/ Disallow: /smarthtml/ User-Agent: 66.249.64.0/19 Allow: / Disallow: /media/ Disallow: /cgi-bin/ Disallow: /shopsite-data/ Disallow: /shopsite-images/ Disallow: /tmp/ Disallow: /ssl/ Disallow: /etc/ Disallow: /.trash/ Disallow: /.cpanel/ Disallow: /mail/ Disallow: /smarthtml/ User-Agent: Ask Jeeves/Teoma +http://about.ask.com/en/docs/about/webmasters.shtml Allow: / Disallow: /media/ Disallow: /cgi-bin/ Disallow: /shopsite-data/ Disallow: /shopsite-images/ Disallow: /tmp/ Disallow: /ssl/ Disallow: /etc/ Disallow: /.trash/ Disallow: /.cpanel/ Disallow: /mail/ Disallow: /smarthtml/ Disallow: /.gif Disallow: /.icon User-Agent: 66.235.112.0/20 Allow: / Disallow: /media/ Disallow: /cgi-bin/ Disallow: /shopsite-data/ Disallow: /shopsite-images/ Disallow: /tmp/ Disallow: /ssl/ Disallow: /etc/ Disallow: /.trash/ Disallow: /.cpanel/ Disallow: /mail/ Disallow: /smarthtml/ User-Agent: bing.com Allow: / Disallow: /media/ Disallow: /cgi-bin/ Disallow: /shopsite-data/ Disallow: /shopsite-images/ Disallow: /tmp/ Disallow: /ssl/ Disallow: /etc/ Disallow: /.trash/ Disallow: /.cpanel/ Disallow: /mail/ Disallow: /smarthtml/ User-Agent: 65.55.175.254 Allow: / Disallow: /media/ Disallow: /cgi-bin/ Disallow: /shopsite-data/ Disallow: /shopsite-images/ Disallow: /tmp/ Disallow: /ssl/ Disallow: /etc/ Disallow: /.trash/ Disallow: /.cpanel/ Disallow: /mail/ Disallow: /smarthtml/ User-Agent: gigabot.com Allow: / Disallow: /media/ Disallow: /cgi-bin/ Disallow: /shopsite-data/ Disallow: /shopsite-images/ Disallow: /tmp/ Disallow: /ssl/ Disallow: /etc/ Disallow: /.trash/ Disallow: /.cpanel/ Disallow: /mail/ Disallow: /smarthtml/ User-Agent: 67.16.94.2 Allow: / Disallow: /media/ Disallow: /cgi-bin/ Disallow: /shopsite-data/ Disallow: /shopsite-images/ Disallow: /tmp/ Disallow: /ssl/ Disallow: /etc/ Disallow: /.trash/ Disallow: /.cpanel/ Disallow: /mail/ Disallow: /smarthtml/ User-Agent: AltaVista.com Allow: / Disallow: /media/ Disallow: /cgi-bin/ Disallow: /shopsite-data/ Disallow: /shopsite-images/ Disallow: /tmp/ Disallow: /ssl/ Disallow: /etc/ Disallow: /.trash/ Disallow: /.cpanel/ Disallow: /mail/ Disallow: /smarthtml/ User-Agent: 68.180.206.184 Allow: / Disallow: /media/ Disallow: /cgi-bin/ Disallow: /shopsite-data/ Disallow: /shopsite-images/ Disallow: /tmp/ Disallow: /ssl/ Disallow: /etc/ Disallow: /.trash/ Disallow: /.cpanel/ Disallow: /mail/ Disallow: /smarthtml/ User-Agent: aol.com Allow: / Disallow: /media/ Disallow: /cgi-bin/ Disallow: /shopsite-data/ Disallow: /shopsite-images/ Disallow: /tmp/ Disallow: /ssl/ Disallow: /etc/ Disallow: /.trash/ Disallow: /.cpanel/ Disallow: /mail/ Disallow: /smarthtml/ User-agent: 64.12.236.132 Allow: / Disallow: /media/ Disallow: /cgi-bin/ Disallow: /shopsite-data/ Disallow: /shopsite-images/ Disallow: /tmp/ Disallow: /ssl/ Disallow: /etc/ Disallow: /.trash/ Disallow: /.cpanel/ Disallow: /mail/ Disallow: /smarthtml/ User-Agent: Ask.com Allow: / Disallow: /media/ Disallow: /cgi-bin/ Disallow: /shopsite-data/ Disallow: /shopsite-images/ Disallow: /tmp/ Disallow: /ssl/ Disallow: /etc/ Disallow: /.trash/ Disallow: /.cpanel/ Disallow: /mail/ Disallow: /smarthtml/ User-agent: 66.235.120.101 Allow: / Disallow: /media/ Disallow: /cgi-bin/ Disallow: /shopsite-data/ Disallow: /shopsite-images/ Disallow: /tmp/ Disallow: /ssl/ Disallow: /etc/ Disallow: /.trash/ Disallow: /.cpanel/ Disallow: /mail/ Disallow: /smarthtml/ User-Agent: Ask Jeeves/Teoma Allow: / Disallow: /media/ Disallow: /cgi-bin/ Disallow: /shopsite-data/ Disallow: /shopsite-images/ Disallow: /tmp/ Disallow: /ssl/ Disallow: /etc/ Disallow: /.trash/ Disallow: /.cpanel/ Disallow: /mail/ Disallow: /smarthtml/ User-Agent: Dogpile.com Allow: / Disallow: /media/ Disallow: /cgi-bin/ Disallow: /shopsite-data/ Disallow: /shopsite-images/ Disallow: /tmp/ Disallow: /ssl/ Disallow: /etc/ Disallow: /.trash/ Disallow: /.cpanel/ Disallow: /mail/ Disallow: /smarthtml/ User-agent: 67.63.50.147 Allow: / Disallow: /media/ Disallow: /cgi-bin/ Disallow: /shopsite-data/ Disallow: /shopsite-images/ Disallow: /tmp/ Disallow: /ssl/ Disallow: /etc/ Disallow: /.trash/ Disallow: /.cpanel/ Disallow: /mail/ Disallow: /smarthtml/ User-Agent: Gigabot.com Allow: / Disallow: /media/ Disallow: /cgi-bin/ Disallow: /shopsite-data/ Disallow: /shopsite-images/ Disallow: /tmp/ Disallow: /ssl/ Disallow: /etc/ Disallow: /.trash/ Disallow: /.cpanel/ Disallow: /mail/ Disallow: /smarthtml/ User-agent: 174.137.125.51 Allow: / Disallow: /media/ Disallow: /cgi-bin/ Disallow: /shopsite-data/ Disallow: /shopsite-images/ Disallow: /tmp/ Disallow: /ssl/ Disallow: /etc/ Disallow: /.trash/ Disallow: /.cpanel/ Disallow: /mail/ Disallow: /smarthtml/ User-Agent: gigablast.com Allow: / Disallow: /media/ Disallow: /cgi-bin/ Disallow: /shopsite-data/ Disallow: /shopsite-images/ Disallow: /tmp/ Disallow: /ssl/ Disallow: /etc/ Disallow: /.trash/ Disallow: /.cpanel/ Disallow: /mail/ Disallow: /smarthtml/ User-agent: 207.251.60.162 Allow: / Disallow: /media/ Disallow: /cgi-bin/ Disallow: /shopsite-data/ Disallow: /shopsite-images/ Disallow: /tmp/ Disallow: /ssl/ Disallow: /etc/ Disallow: /.trash/ Disallow: /.cpanel/ Disallow: /mail/ Disallow: /smarthtml/ User-Agent: Live.com Allow: / Disallow: /media/ Disallow: /cgi-bin/ Disallow: /shopsite-data/ Disallow: /shopsite-images/ Disallow: /tmp/ Disallow: /ssl/ Disallow: /etc/ Disallow: /.trash/ Disallow: /.cpanel/ Disallow: /mail/ Disallow: /smarthtml/ User-agent: 65.55.206.154 Allow: / Disallow: /media/ Disallow: /cgi-bin/ Disallow: /shopsite-data/ Disallow: /shopsite-images/ Disallow: /tmp/ Disallow: /ssl/ Disallow: /etc/ Disallow: /.trash/ Disallow: /.cpanel/ Disallow: /mail/ Disallow: /smarthtml/ User-Agent: lycos.com Allow: / Disallow: /media/ Disallow: /cgi-bin/ Disallow: /shopsite-data/ Disallow: /shopsite-images/ Disallow: /tmp/ Disallow: /ssl/ Disallow: /etc/ Disallow: /.trash/ Disallow: /.cpanel/ Disallow: /mail/ Disallow: /smarthtml/ User-agent: 209.202.254.14 Allow: / Disallow: /media/ Disallow: /cgi-bin/ Disallow: /shopsite-data/ Disallow: /shopsite-images/ Disallow: /tmp/ Disallow: /ssl/ Disallow: /etc/ Disallow: /.trash/ Disallow: /.cpanel/ Disallow: /mail/ Disallow: /smarthtml/ User-Agent: MonsterCrawler.com Allow: / Disallow: /media/ Disallow: /cgi-bin/ Disallow: /shopsite-data/ Disallow: /shopsite-images/ Disallow: /tmp/ Disallow: /ssl/ Disallow: /etc/ Disallow: /.trash/ Disallow: /.cpanel/ Disallow: /mail/ Disallow: /smarthtml/ User-Agent: 209.92.71.208 Allow: / Disallow: /media/ Disallow: /cgi-bin/ Disallow: /shopsite-data/ Disallow: /shopsite-images/ Disallow: /tmp/ Disallow: /ssl/ Disallow: /etc/ Disallow: /.trash/ Disallow: /.cpanel/ Disallow: /mail/ Disallow: /smarthtml/ User-Agent: msnbot/2.0b (+http://search.msn.com/msnbot.htm) Allow: / Disallow: /media/ Disallow: /cgi-bin/ Disallow: /shopsite-data/ Disallow: /shopsite-images/ Disallow: /tmp/ Disallow: /ssl/ Disallow: /etc/ Disallow: /.trash/ Disallow: /.cpanel/ Disallow: /mail/ Disallow: /smarthtml/ User-Agent: 207.46.0.0/16 Allow: / Disallow: /media/ Disallow: /cgi-bin/ Disallow: /shopsite-data/ Disallow: /shopsite-images/ Disallow: /tmp/ Disallow: /ssl/ Disallow: /etc/ Disallow: /.trash/ Disallow: /.cpanel/ Disallow: /mail/ Disallow: /smarthtml/ User-Agent: 65.55.2.0/19 Allow: / Disallow: /media/ Disallow: /cgi-bin/ Disallow: /shopsite-data/ Disallow: /shopsite-images/ Disallow: /tmp/ Disallow: /ssl/ Disallow: /etc/ Disallow: /.trash/ Disallow: /.cpanel/ Disallow: /mail/ Disallow: /smarthtml/ User-Agent: paylessdivorce.com Allow: / Disallow: /media/ Disallow: /cgi-bin/ Disallow: /shopsite-data/ Disallow: /shopsite-images/ Disallow: /tmp/ Disallow: /ssl/ Disallow: /etc/ Disallow: /.trash/ Disallow: /.cpanel/ Disallow: /mail/ Disallow: /smarthtml/ User-Agent: 8.5.1.47 Allow: / Disallow: /media/ Disallow: /cgi-bin/ Disallow: /shopsite-data/ Disallow: /shopsite-images/ Disallow: /tmp/ Disallow: /ssl/ Disallow: /etc/ Disallow: /.trash/ Disallow: /.cpanel/ Disallow: /mail/ Disallow: /smarthtml/ User-Agent: search.msn.com Allow: / Disallow: /media/ Disallow: /cgi-bin/ Disallow: /shopsite-data/ Disallow: /shopsite-images/ Disallow: /tmp/ Disallow: /ssl/ Disallow: /etc/ Disallow: /.trash/ Disallow: /.cpanel/ Disallow: /mail/ Disallow: /smarthtml/ User-Agent: yahoo.com Allow: / Disallow: /media/ Disallow: /cgi-bin/ Disallow: /shopsite-data/ Disallow: /shopsite-images/ Disallow: /tmp/ Disallow: /ssl/ Disallow: /etc/ Disallow: /.trash/ Disallow: /.cpanel/ Disallow: /mail/ Disallow: /smarthtml/ User-Agent: 209.191.122.70 Allow: / Disallow: /media/ Disallow: /cgi-bin/ Disallow: /shopsite-data/ Disallow: /shopsite-images/ Disallow: /tmp/ Disallow: /ssl/ Disallow: /etc/ Disallow: /.trash/ Disallow: /.cpanel/ Disallow: /mail/ Disallow: /smarthtml/ User-Agent: Yahoo! Slurp/3.0; http://help.yahoo.com/help/us/ysearch/slurp Allow: / Disallow: /media/ Disallow: /cgi-bin/ Disallow: /shopsite-data/ Disallow: /shopsite-images/ Disallow: /tmp/ Disallow: /ssl/ Disallow: /etc/ Disallow: /.trash/ Disallow: /.cpanel/ Disallow: /mail/ Disallow: /smarthtml/ User-Agent: Webcrawler.com Allow: / Disallow: /media/ Disallow: /cgi-bin/ Disallow: /shopsite-data/ Disallow: /shopsite-images/ Disallow: /tmp/ Disallow: /ssl/ Disallow: /etc/ Disallow: /.trash/ Disallow: /.cpanel/ Disallow: /mail/ Disallow: /smarthtml/ User-Agent: 67.63.50.0/24 Allow: / Disallow: /media/ Disallow: /cgi-bin/ Disallow: /shopsite-data/ Disallow: /shopsite-images/ Disallow: /tmp/ Disallow: /ssl/ Disallow: /etc/ Disallow: /.trash/ Disallow: /.cpanel/ Disallow: /mail/ Disallow: /smarthtml/ User-Agent: 1.0.0.0/0 Disallow: / Disallow: /media/ Disallow: /cgi-bin/ Disallow: /shopsite-data/ Disallow: /shopsite-images/ Disallow: /tmp/ Disallow: /ssl/ Disallow: /etc/ Disallow: /.trash/ Disallow: /.cpanel/ Disallow: /mail/ Disallow: /smarthtml/ User-Agent: Yandex/1.01.001 (compatible; Win16; I) Disallow: / Disallow: /media/ Disallow: /cgi-bin/ Disallow: /shopsite-data/ Disallow: /shopsite-images/ Disallow: /tmp/ Disallow: /ssl/ Disallow: /etc/ Disallow: /.trash/ Disallow: /.cpanel/ Disallow: /mail/ Disallow: /smarthtml/ User-Agent: 93.158.144.28 Disallow: / User-Agent: 93.0.0.0/8 Disallow: / User-Agent: 119.62.128.115 Disallow: / User-Agent: 148.245.126.45 Disallow: / User-Agent: 150.0.0.0/8 Disallow: / User-Agent: 178.178.175.190 Disallow: / User-Agent: 187.132.186.227 Disallow: / User-Agent: 201.9.45.188 Disallow: / User-Agent: 206.225.11.20 Disallow: / User-Agent: 209.208.28.5 Disallow: / User-Agent: 218.28.29.236 Disallow: / User-Agent: 66.249.19.0/24 Disallow: / User-Agent: 69.198.7.252 Disallow: / User-Agent: 70.87.80.194 Disallow: / User-Agent: 77.66.214.80 Disallow: / User-Agent: 77.88.31.247 Disallow: / User-Agent: 87.249.0.0/16 Disallow: / User-Agent: 88.56.0.0/15 Disallow: / User-Agent: 88.191.98.110 Disallow: / User-Agent: 90.214.0.0/20 Disallow: / User-Agent: 88.0.0.0/8 Disallow: / User-Agent: 194.176.0.0/16 Disallow: / User-Agent: Twiceler-0.9 http://www.cuil.com/twiceler/robot.html Disallow: / Disallow: /media/ Disallow: /cgi-bin/ Disallow: /shopsite-data/ Disallow: /shopsite-images/ Disallow: /tmp/ Disallow: /ssl/ Disallow: /etc/ Disallow: /.trash/ Disallow: /.cpanel/ Disallow: /mail/ Disallow: /smarthtml/ User-Agent: http://www.cuil.com/twiceler/robot.html Disallow: / Disallow: /media/ Disallow: /cgi-bin/ Disallow: /shopsite-data/ Disallow: /shopsite-images/ Disallow: /tmp/ Disallow: /ssl/ Disallow: /etc/ Disallow: /.trash/ Disallow: /.cpanel/ Disallow: /mail/ Disallow: /smarthtml/ User-Agent: 67.218.116.0/24 Disallow: / Disallow: /media/ Disallow: /cgi-bin/ Disallow: /shopsite-data/ Disallow: /shopsite-images/ Disallow: /tmp/ Disallow: /ssl/ Disallow: /etc/ Disallow: /.trash/ Disallow: /.cpanel/ Disallow: /mail/ Disallow: /smarthtml User-Agent: 209.150.128.0/19 Disallow: / Disallow: /media/ Disallow: /cgi-bin/ Disallow: /shopsite-data/ Disallow: /shopsite-images/ Disallow: /tmp/ Disallow: /ssl/ Disallow: /etc/ Disallow: /.trash/ Disallow: /.cpanel/ Disallow: /mail/ Disallow: /smarthtml/ User-Agent: 216.129.119.0/24 Disallow: / Disallow: /media/ Disallow: /cgi-bin/ Disallow: /shopsite-data/ Disallow: /shopsite-images/ Disallow: /tmp/ Disallow: /ssl/ Disallow: /etc/ Disallow: /.trash/ Disallow: /.cpanel/ Disallow: /mail/ Disallow: /smarthtml/ User-Agent: 216.15.128.0/17 Disallow: / Disallow: /media/ Disallow: /cgi-bin/ Disallow: /shopsite-data/ Disallow: /shopsite-images/ Disallow: /tmp/ Disallow: /ssl/ Disallow: /etc/ Disallow: /.trash/ Disallow: /.cpanel/ Disallow: /mail/ Disallow: /smarthtml/ User-Agent: 216.222.192.0/20 Disallow: / Disallow: /media/ Disallow: /cgi-bin/ Disallow: /shopsite-data/ Disallow: /shopsite-images/ Disallow: /tmp/ Disallow: /ssl/ Disallow: /etc/ Disallow: /.trash/ Disallow: /.cpanel/ Disallow: /mail/ Disallow: /smarthtml/ User-Agent: 64.6.224.0/19 Disallow: / Disallow: /media/ Disallow: /cgi-bin/ Disallow: /shopsite-data/ Disallow: /shopsite-images/ Disallow: /tmp/ Disallow: /ssl/ Disallow: /etc/ Disallow: /.trash/ Disallow: /.cpanel/ Disallow: /mail/ Disallow: /smarthtml/ User-Agent: 64.6.241.16 Disallow: / Disallow: /media/ Disallow: /cgi-bin/ Disallow: /shopsite-data/ Disallow: /shopsite-images/ Disallow: /tmp/ Disallow: /ssl/ Disallow: /etc/ Disallow: /.trash/ Disallow: /.cpanel/ Disallow: /mail/ Disallow: /smarthtml/ User-Agent: 65.254.224.0/19 Disallow: / Disallow: /media/ Disallow: /cgi-bin/ Disallow: /shopsite-data/ Disallow: /shopsite-images/ Disallow: /tmp/ Disallow: /ssl/ Disallow: /etc/ Disallow: /.trash/ Disallow: /.cpanel/ Disallow: /mail/ Disallow: /smarthtml/ User-Agent: 66.165.125.116 Disallow: / Disallow: /media/ Disallow: /cgi-bin/ Disallow: /shopsite-data/ Disallow: /shopsite-images/ Disallow: /tmp/ Disallow: /ssl/ Disallow: /etc/ Disallow: /.trash/ Disallow: /.cpanel/ Disallow: /mail/ Disallow: /smarthtml/ User-Agent: 66.165.64.0/18 Disallow: / Disallow: /media/ Disallow: /cgi-bin/ Disallow: /shopsite-data/ Disallow: /shopsite-images/ Disallow: /tmp/ Disallow: /ssl/ Disallow: /etc/ Disallow: /.trash/ Disallow: /.cpanel/ Disallow: /mail/ Disallow: /smarthtml/ User-Agent: 67.192.0.0/16 Disallow: / Disallow: /media/ Disallow: /cgi-bin/ Disallow: /shopsite-data/ Disallow: /shopsite-images/ Disallow: /tmp/ Disallow: /ssl/ Disallow: /etc/ Disallow: /.trash/ Disallow: /.cpanel/ Disallow: /mail/ Disallow: /smarthtml/ User-Agent: 67.192.17.33 Disallow: / Disallow: /media/ Disallow: /cgi-bin/ Disallow: /shopsite-data/ Disallow: /shopsite-images/ Disallow: /tmp/ Disallow: /ssl/ Disallow: /etc/ Disallow: /.trash/ Disallow: /.cpanel/ Disallow: /mail/ Disallow: /smarthtml/ User-Agent: 69.89.16.0/20 Disallow: / Disallow: /media/ Disallow: /cgi-bin/ Disallow: /shopsite-data/ Disallow: /shopsite-images/ Disallow: /tmp/ Disallow: /ssl/ Disallow: /etc/ Disallow: /.trash/ Disallow: /.cpanel/ Disallow: /mail/ Disallow: /smarthtml/ User-Agent: 69.89.21.64 Disallow: / Disallow: /media/ Disallow: /cgi-bin/ Disallow: /shopsite-data/ Disallow: /shopsite-images/ Disallow: /tmp/ Disallow: /ssl/ Disallow: /etc/ Disallow: /.trash/ Disallow: /.cpanel/ Disallow: /mail/ Disallow: /smarthtml/ User-Agent: 74.220.192.0/19 Disallow: / Disallow: /media/ Disallow: /cgi-bin/ Disallow: /shopsite-data/ Disallow: /shopsite-images/ Disallow: /tmp/ Disallow: /ssl/ Disallow: /etc/ Disallow: /.trash/ Disallow: /.cpanel/ Disallow: /mail/ Disallow: /smarthtml/ User-Agent: 74.220.195.50 Disallow: / Disallow: /media/ Disallow: /cgi-bin/ Disallow: /shopsite-data/ Disallow: /shopsite-images/ Disallow: /tmp/ Disallow: /ssl/ Disallow: /etc/ Disallow: /.trash/ Disallow: /.cpanel/ Disallow: /mail/ Disallow: /smarthtml/ User-Agent: * Disallow: / Disallow: /media/ Disallow: /cgi-bin/ Disallow: /shopsite-data/ Disallow: /shopsite-images/ Disallow: /tmp/ Disallow: /ssl/ Disallow: /etc/ Disallow: /.trash/ Disallow: /.cpanel/ Disallow: /mail/ Disallow: /smarthtml/