# go away User-agent: Alexa Disallow: / User-agent: IA Archiver Disallow: / User-agent: Alexa (IA Archiver) Disallow: / User-agent: Architext spider Disallow: / User-agent: arks Disallow: / User-agent: Ask Disallow: / User-agent: AskJeeves Disallow: / User-agent: Ask Jeeves Disallow: / User-agent: asterias Disallow: / User-agent: baiDuSpider Disallow: / User-agent: Bloodhound Disallow: / User-agent: bot Disallow: / User-agent: bot- Disallow: / User-agent: BSpider Disallow: / User-agent: CFNetwork Disallow: / User-agent: ConveraCrawler Disallow: / User-agent: crawler@fast Disallow: / User-agent: crawl Disallow: / User-agent: Crawler Disallow: / User-agent: Custo Disallow: / User-agent: DittoSpyder Disallow: / User-agent: FAST-WebCrawler Disallow: / User-agent: Fluffy the Spider Disallow: / User-agent: GigaBot Disallow: / User-agent: Google AdSense Disallow: / User-agent: Googlebot Disallow: / User-agent: Googlebot-Image Disallow: / User-agent: Grub.org Disallow: / User-agent: Gulliver Disallow: / User-agent: Heritrix Disallow: / User-agent: HTTrack Disallow: / User-agent: HTTrack off-line browser Disallow: / User-agent: ia_archiver Disallow: / User-agent: IA Archiver Disallow: / User-agent: Inktomi Slurp Disallow: / User-agent: InfoSeek sidewinder Disallow: / User-agent: Jakarta Disallow: / User-agent: Jakarta commons-httpclient disallow: / User-agent: Java Disallow: / User-agent: Jeeves Disallow: / User-agent: KIT_Fireball Disallow: / User-agent: Larbin Disallow: / User-agent: legs Disallow: / User-agent: Lycos_Spider_(T-Rex) Disallow: / User-agent: MantraAgent Disallow: / User-agent: Mercator Disallow: / User-agent: MJ12BOT Disallow: / User-agent: Moget Disallow: / User-agent: MSIECrawler Disallow: / User-agent: MSNBot Disallow: / User-agent: MSNBot-media Disallow: / User-agent: MuscatFerret Disallow: / User-agent: Netcraft Disallow: / User-agent: Nutch Disallow: / User-agent: powermarks Disallow: / User-agent: psbot Disallow: / User-agent: python Disallow: / User-agent: Python-urllib Disallow: / User-agent: robot Disallow: / User-agent: Robots.txt Disallow: / User-agent: Robozilla Disallow: / User-agent: Scooter Disallow: / User-agent: Scrubby Disallow: / User-agent: Sleek Spider Disallow: / User-agent: Slurp Disallow: / User-agent: Speedy Disallow: / User-agent: Spider Disallow: / User-agent: SpiderMan Disallow: / User-agent: Speedy Spider Disallow: / User-agent: spider Disallow: / User-agent: StackRambler Disallow: / User-agent: SurveyBot Disallow: / User-agent: TeomaAgent Disallow: / User-agent: The web archive (IA Archiver) Disallow: / User-agent: Turn It In Disallow: / User-agent: Twiceler Disallow: / User-agent: Ultraseek Disallow: / User-agent: VoilaBot Disallow: / User-agent: Voyager Disallow: / User-agent: vscooter Disallow: / User-agent: WebCrawler Disallow: / User-agent: WISENutbot Disallow: / User-agent: yahoo-blogs/v3.9 Disallow: / User-agent: yahoo Slurp Disallow: / User-agent: yahoo-mmcrawler Disallow: / User-agent: Yandex bot Disallow: / User-agent: Zyborg Disallow: / User-agent: Titan Disallow: / User-agent: EmailCollector Disallow: / User-agent: EmailSiphon Disallow: / User-agent: EmailWolf Disallow: / User-agent: ExtractorPro Disallow: / User-agent: * Disallow: /57/ Disallow: /58/ Disallow: /59/ Disallow: /61/ Disallow: /62/ Disallow: /64/ Disallow: /65/ Disallow: /66/ Disallow: /67/ Disallow: /as/ Disallow: /cretens/ Disallow: /css/ Disallow: /forms/ Disallow: /graphics/ Disallow: /guestbook/ Disallow: /links/ Disallow: /mid/ Disallow: /nagi/ Disallow: /newsletter/ Disallow: /password/ Disallow: /quilt/ Disallow: /terms/ Disallow: /usacycle/ Disallow: /*.gif$ Disallow: /*.jpg$ Disallow: /*.jpeg$ Disallow: /*.png$