# Don't allow web crawlers to index Craft CMS User-agent: * Disallow: /craft/ # Shop directives # Paths (clean URLs) Disallow: /index.php/ Disallow: /catalog/product_compare/ Disallow: /catalog/category/view/ Disallow: /catalog/product/view/ Disallow: /catalogsearch/ Disallow: /checkout/ Disallow: /control/ Disallow: /contacts/ Disallow: /customer/ Disallow: /customize/ Disallow: /newsletter/ Disallow: /review/ Disallow: /sendfriend/ Disallow: /wishlist/ # Do not index pages that are sorted or filtered. Disallow: /*?*categoryfilterby= Disallow: /*?*color= Disallow: /*?*colourfilterby= Disallow: /*?*size= Disallow: /*?*price= Disallow: /*?*manufacturer=