# See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file User-Agent: * Disallow: /*?cat= Disallow: /*?*&cat= Disallow: /*?section= Disallow: /*?*§ion= Disallow: /*?testimonial= Disallow: /*?*&testimonial= Disallow: /*?type= Disallow: /*?*&type= Disallow: /*?work[]= Disallow: /*?*&work[]= User-Agent: AhrefsBot Disallow: / User-Agent: Bingbot Allow: / Crawl-delay: 1 User-Agent: DotBot Disallow: / User-Agent: HubSpot Disallow: / User-Agent: ltx71 Disallow: / User-Agent: rogerbot Disallow: / User-Agent: SemrushBot Disallow: / User-Agent: Site24x7 Disallow: /