# Robots.txt file for http://www.mblucas.net # User-agent: * Disallow: / User-agent: Slurp Crawl-delay: 900 User-agent: WISENutbot Crawl-delay: 900