User-agent: * Crawl-delay: 60 #Disallow: /fileadmin/ #Disallow: /uploads/ #Disallow: /typo3conf/ Disallow: /typo3tmp/ Disallow: /shop/ Disallow: /_*/ User-agent: Googlebot Crawl-delay: 60 #Disallow: /fileadmin/ #Disallow: /uploads/ #Disallow: /typo3conf/ Disallow: /typo3tmp/ Disallow: /shop/ Disallow: /_*/ User-agent: Googlebot-Image Crawl-delay: 60 #Disallow: /fileadmin/ #Disallow: /uploads/ #Disallow: /typo3conf/ Disallow: /typo3tmp/ Disallow: /shop/ Disallow: /_*/ User-agent: Googlebot-Mobile Crawl-delay: 60 #Disallow: /fileadmin/ #Disallow: /uploads/ #Disallow: /typo3conf/ Disallow: /typo3tmp/ Disallow: /shop/ Disallow: /_*/ #MICROSOFT BOTS User-agent: msnbot Crawl-delay: 60 User-agent: bingbot Crawl-delay: 60 #YAHOO BOTS User-agent: Slurp Crawl-delay: 60 User-agent: Yahoo! Slurp Crawl-delay: 60 #SCONSIGLIATI User-agent: SMTBot Disallow: / User-agent: AhrefsBot Disallow: / User-agent: YisouSpider Disallow: / User-agent: DotBot Disallow: / User-agent: MegaIndex.ru/2.0 Disallow: / User-agent: MegaIndex.ru/ Disallow: / User-agent: SputnikBot Disallow: / User-agent: UbiCrawler Disallow: / User-agent: DOC Disallow: / User-agent: Zao Disallow: / User-agent: Zealbot Disallow: / User-agent: MSIECrawler Disallow: / User-agent: SiteSnagger Disallow: / User-agent: WebStripper Disallow: / User-agent: WebCopier Disallow: / User-agent: Fetch Disallow: / User-agent: Teleport Disallow: / User-agent: TeleportPro Disallow: / User-agent: WebZIP Disallow: / User-agent: linko Disallow: / User-agent: HTTrack Disallow: / User-agent: Xenu Disallow: / User-agent: larbin Disallow: / User-agent: libwww Disallow: / User-agent: ZyBORG Disallow: / User-agent: wget Disallow: / User-agent: grub-client Disallow: / User-agent: k2spider Disallow: / User-agent: NPBot Disallow: / User-agent: WebReaper Disallow: / User-agent: berlin-fu-cow Disallow: / User-agent: JikeSpider Disallow: / User-agent: semager Disallow: / User-agent: BLEXBot Disallow: / User-agent: MJ12bot Disallow: / User-agent: dotbot Disallow: / User-agent: Yandex Disallow: / User-agent: AhrefsBot Disallow: / User-agent: OrangeBot Disallow: / User-agent: Screaming Frog SEO Spider Disallow: / User-agent: MegaIndex.ru/2.0 Disallow: / User-agent: MegaIndex.ru Disallow: / User-agent: megaIndex.ru Disallow: / User-agent: SEOkicks-Robot Disallow: / User-agent: ltx71 Disallow: / User-agent: SputnikBot Disallow: / User-agent: spbot Disallow: / User-agent: seoscanners.net Disallow: / User-agent: DeuSu Disallow: / User-agent: meds-online24.com Disallow: / User-agent: seoscanners Disallow: / User-agent: PRTGCloudBot Disallow: / User-agent: Sogou Pic Spider/3.0( http://www.sogou.com/docs/help/webmasters.htm#07) Disallow: / User-agent: Sogou head spider/3.0( http://www.sogou.com/docs/help/webmasters.htm#07) Disallow: / User-agent: Sogou web spider/4.0(+http://www.sogou.com/docs/help/webmasters.htm#07) Disallow: / User-agent: Sogou Orion spider/3.0( http://www.sogou.com/docs/help/webmasters.htm#07) Disallow: / User-agent: Sogou-Test-Spider/4.0 (compatible; MSIE 5.5; Windows 98) Disallow: /