User-agent: AdsBot-Google Disallow: / User-agent: AdsBot-Google-Mobile Disallow: / User-agent: AhrefsBot Disallow: / User-agent: aipbot Disallow: / User-agent: Baiduspider Disallow: / User-agent: BLEXBot Disallow: / User-agent: boitho.com-dc Disallow: / User-agent: Cliqzbot Disallow: / User-agent: dloader(NaverRobot) Disallow: / User-agent: DOC Disallow: / User-agent: Download Ninja Disallow: / User-agent: Evaal Disallow: / User-agent: EvilSpider Disallow: / User-Agent: Exabot/ Disallow: / User-agent: FAST Disallow: / User-agent: fast Disallow: / User-agent: Fetch Disallow: / User-agent: findlinks Disallow: / User-agent: Gigamega.bot Disallow: / User-agent: girafa Disallow: / User-agent: Googlebot Disallow: / User-agent: Googlebot-Image Disallow: / User-agent: Googlebot-News Disallow: / User-agent: Googlebot-Video Disallow: / User-agent: grub-client Disallow: / User-agent: hl_ftien_spider_v1.1 Disallow: / User-agent: HTTrack Disallow: / User-agent: ichiro Disallow: / User-agent: icsbot-0.1 Disallow: / User-agent: IRLbot Disallow: / User-agent: Java/ Disallow: / User-agent: k2spider Disallow: / User-agent: larbin Disallow: / User-agent: LCC Disallow: / User-agent: libwww Disallow: / User-agent: linkdexbot Disallow: / User-agent: linko Disallow: / User-Agent: LinkWalker Disallow: / User-agent: Mediapartners-Google Disallow: / User-agent: MegaIndex.ru Disallow: / User-agent: Microsoft.URL.Control Disallow: / User-agent: MJ12bot Disallow: / User-agent: MSIECrawler Disallow: / User-agent: MSNBOT Disallow: / User-agent: NaverBot Disallow: / User-agent: noxtrumbot Disallow: / User-agent: NPBot Disallow: / User-agent: Offline Explorer Disallow: / User-Agent: OmniExplorer_Bot Disallow: / User-agent: OsO Disallow: / User-agent: psycheclone Disallow: / User-Agent: RufusBot Disallow: / User-Agent: SBIder Disallow: / User-agent: SemrushBot Disallow: / User-agent: SEOkicks-Robot Disallow: / User-agent: ShablastBot Disallow: / User-agent: sitecheck.internetseer.com Disallow: / User-agent: SiteSnagger Disallow: / User-agent: Slurp Disallow: / User-agent: Sogou Disallow: / User-agent: StackRambler Disallow: / User-agent: Streamline3Bot Disallow: / User-Agent: SurveyBot Disallow: / User-agent: Teleport Disallow: / User-agent: TeleportPro Disallow: / User-agent: TestBot Disallow: / User-agent: thesubot Disallow: / User-agent: TurnitinBot Disallow: / User-agent: Twiceler Disallow: / User-agent: UbiCrawler Disallow: / User-agent: VoilaBot Disallow: / User-agent: voyager/ Disallow: / User-agent: WebCopier Disallow: / User-agent: WebReaper Disallow: / User-agent: WebStripper Disallow: / User-agent: WebZIP Disallow: / User-agent: Xenu Disallow: / User-agent: YandexBot Disallow: / User-agent: Zao Disallow: / User-agent: Zealbot Disallow: / User-agent: ZyBORG Disallow: / User-agent: * Crawl-delay: 60 Disallow: /cgi Disallow: /contact* Disallow: /contact-form-notices.html Disallow: /contact-form-organise.html Disallow: /contact-form.html Disallow: /discuss Disallow: /meth* Disallow: /recei* Disallow: /registration Disallow: cgi