### Thought Equity Robots.txt file
### enquiries to webmaster(at)thoughtequity.com 
##

User-agent: *
Disallow: /

##Disallow: /video/saveUserLanguage.do
##
### AllTheWeb
##User-agent: fast-webcrawler
##Crawl-Delay: 10
##
### AltaVista
##User-agent: scooter
##Crawl-Delay: 10
##
### Googlebot
##User-agent: googlebot
##Crawl-Delay: 30
##
### Looksmart
##User-agent: wisenutbot
##Crawl-Delay: 10
##
##User-agent: zyborg
##Crawl-Delay: 10
##
### MSN
##User-agent: msnbot
##Crawl-Delay: 10
##
### Yahoo Vertical Crawler
##User-agent: yahoo-verticalcrawler
##Crawl-Delay: 10
##
### Yahoo Slurp
##User-agent: Slurp
##Crawl-delay: 15
##Disallow: /video/bin
##Disallow: /video/shell/txp
##
##User-agent: twiceler
##Crawl-delay: 10
##
### Gigabot
##User-agent: gigabot
##Crawl-Delay: 10
##
### Any Others
##User-agent: * 
##Crawl-delay: 15
##Disallow: /video/bin
##Disallow: /video/shell/txp
##Disallow: /video/saveUserLanguage.do