# /robots.txt for http://www.torsten-richardt.de/ # comments to http://www.torsten-richardt.de/kontakt-e.html # psbot (old MSN image bot), Slurp (Yahoo), twiceler (Cuil), MLBot (media idx) User-agent: Googlebot-Image User-agent: Yahoo-MMCrawler User-agent: Yahoo-MMAudVid User-Agent: msnbot-Media User-agent: psbot User-agent: MLBot User-agent: Mediapartners-Google User-agent: Adsbot-Google User-Agent: msnbot-Products User-agent: ICCrawler - iCjobs User-agent: TwengaBot-Discover Disallow: / # copyright User-agent: TurnitinBot Disallow: / # copyright infringement User-agent: obot Disallow: / User-agent: * Disallow: /cgi-bin/ Disallow: /bilder/