User-agent: * Disallow: /*? Disallow: /index.php/ Disallow: /catalog/product_compare/ Disallow: /catalog/category/view/ Disallow: /catalog/product/view/ Disallow: /wishlist/ Disallow: /admin/ Disallow: /beheer/ Disallow: /catalogsearch/ Disallow: /review/product/ Disallow: /sendfriend/ Disallow: /enable-cookies/ Disallow: /LICENSE.txt Disallow: /LICENSE.html Disallow: /skin/ Disallow: /js/ Disallow: /directory/ # Lets consider each groups of commands separately. # Stop crawling user account and checkout pages by search engine robot: Disallow: /checkout/ Disallow: /onestepcheckout/ Disallow: /customer/ Disallow: /customer/account/ Disallow: /customer/account/login/ # Blocking native catalog and search pages: Disallow: /catalogsearch/ Disallow: /catalog/product_compare/ Disallow: /catalog/category/view/ Disallow: /catalog/product/view/ # Sometimes Webmasters block pages with filters.. Disallow: /*?dir* Disallow: /*?dir=desc Disallow: /*?dir=asc Disallow: /*?limit=all Disallow: /*?mode* # More reasonable to use canonical tag on these pages. # Blocking CMS directories. Disallow: /app/ Disallow: /bin/ Disallow: /dev/ Disallow: /lib/ Disallow: /phpserver/ Disallow: /pub/ Sitemap: https://fullcartuning.com/media/sitemap/sitemap_en_US.xml Sitemap: https://fullcartuning.nl/media/sitemap/sitemap_nl_NL.xml Sitemap: https://fullcartuning.de/media/sitemap/sitemap_de_DE.xml Sitemap: https://fullcartuning.fr/media/sitemap/sitemap_fr_FR.xml Sitemap: https://fullcartuning.es/media/sitemap/sitemap_es_ES.xml Sitemap: https://fullcartuning.fi/media/sitemap/sitemap_fi_FI.xml