# ---------------------------------------------------------------------------------------
# THIS FILE SPECIFIES SOME VALUES FOR WEBCRAWLERS LIKE GOOGLE AND YAHOO BOTS
# Last update 15-10-2006
# More info:   http://www.robotstxt.org/wc/faq.html#robotstxt
# ---------------------------------------------------------------------------------------

User-Agent: *
Allow: /
Disallow: /Data

User-agent: Slurp
Crawl-delay: 15

User-agent: MSNBot
Crawl-delay: 15