# Robots.txt # 2009-08-17 MRC: Yahoo Slurp makes many requests. Try to reduce them. User-agent: Slurp Crawl-delay: 1.0 User-agent: * # 2009-08-17 MRC: Disallow ALL robots from viewing site: # Temporary! This will allow people to use page, but exclude robots # No robot access --> no search engine results Disallow: / # 2009-08-17 MRC found the following rules; Put here by Fujiyama-san? Keep these! Disallow: /xoops/cgi-bin/ Disallow: /xoops/tmp/ Disallow: /xoops/cache/ Disallow: /xoops/class/ Disallow: /xoops/images/ Disallow: /xoops/include/ Disallow: /xoops/install/ Disallow: /xoops/kernel/ Disallow: /xoops/language/ Disallow: /xoops/templates_c/ Disallow: /xoops/themes/ Disallow: /xoops/uploads/