User-agent: SiteCheck-sitecrawl by Siteimprove.com Disallow: /cgi/img_query Disallow: /cgi-bin/img_query User-agent: SiteimproveBot Disallow: /cgi/img_query Disallow: /cgi-bin/img_query User-agent: SiteimproveBot-Crawler Disallow: /cgi/img_query Disallow: /cgi-bin/img_query User-agent: LinkCheck by Siteimprove.com Disallow: /cgi/img_query Disallow: /cgi-bin/img_query User-agent: Image size by Siteimprove.com Disallow: /cgi/img_query Disallow: /cgi-bin/img_query User-agent: Probe by Siteimprove.com Disallow: /cgi/img_query Disallow: /cgi-bin/img_query User-agent: bingbot Crawl-delay: 5 User-agent: Slurp Crawl-delay: 5 User-agent: Yahoo! Slurp Crawl-delay: 5 User-agent: Applebot Crawl-delay: 5 User-agent: YandexBot Crawl-delay: 10 User-agent: TurnitinBot Disallow: / User-agent: DotBot Crawl-delay: 10 User-agent: UT-Dorkbot Crawl-delay: 60 User-agent: Bytespider Disallow: / User-agent: GPTBot Disallow: / User-agent: Amazonbot Disallow: /