# robots.txt for https://www.e-stampdutyreadyreckoner.com/ # Google Bot User-Agent: Googlebot Disallow: User-Agent: Adsbot-Google Disallow: User-Agent: Googlebot-Mobile Disallow: User-agent: Mediapartners-Google Disallow: # Bing Bot User-Agent: Bingbot Disallow: # Yahoo Bot User-Agent: Slurp Disallow: # Twitter Bot User-agent: Twitterbot Disallow: # Duck Duck Bot User-Agent: DuckDuckBot Disallow: # Bad Bots reported by botreports.com User-agent: Downloader Disallow: / User-agent: FAST-WebCrawler Disallow: / User-agent: Flashget Disallow: / User-agent: Gulliver Disallow: / User-agent: HTTrack Disallow: / User-agent: HTTrack Website Copier Disallow: / User-agent: MSIECrawler Disallow: / User-agent: NetAnts Disallow: / User-agent: Offline Disallow: / User-agent: reaper Disallow: / User-agent: serpstatbot Disallow: / User-agent: SuperBot Disallow: / User-agent: Teleport Disallow: / User-agent: WebC Disallow: / User-agent: WebCapture Disallow: / User-agent: Website Quester Disallow: / User-agent: WebZIP Disallow: / User-agent: WebStripper Disallow: / User-agent: Wget Disallow: / User-agent: EmailSiphon Disallow: / User-agent: EmailWolf Disallow: / User-agent: webbandit Disallow: / User-agent: AhrefsBot Disallow: / User-agent: dotbot Disallow: / User-agent: MJ12bot Disallow: / User-agent: Cyotek Disallow: / User-agent: CyotekWeb Disallow: / User-agent: CyotekWebCopy Disallow: / User-agent: CyotekHTTP Disallow: / User-agent: PetalBot Disallow: / Sitemap: https://www.e-stampdutyreadyreckoner.com/sitemap.xml