# Robots.txt file from http://www.josephpisani.com User-agent: * Disallow: cgi-bin Disallow: scripts Disallow: htm/Scripts Disallow: htm/images Disallow: htm/news/newsimage Disallow: htm/css Disallow: htm/mp3 Disallow: htm/swf_text Disallow: htm/inc Disallow: htm/pnew Disallow: htm/press Disallow: htm/paper Disallow: htm/photos2006 Disallow: htm/photos2007 Disallow: htm/pdf Disallow: htm/photos_abstract Disallow: htm/photos_portrait User-agent: Slurp Crawl-delay: 0.5