User-agent: * Allow: / Disallow: /search/ Disallow: /cdn-cgi/ Disallow: /internal/ Disallow: /accounts/ Disallow: /*?query= Disallow: /*?page= Disallow: /*?p= # Prevent duplicate content from pagination Disallow: /*?*page= Disallow: /*?*p= # Prevent indexing of search result pages Disallow: /*?*q= Disallow: /*?*search= Disallow: /*?*keyword= # Prevent indexing of filter pages Disallow: /*?*filter= Disallow: /*?*category=