# This hostname serves noindex on every page and every file (GC_NOINDEX_HOSTS). # Crawling is still allowed deliberately: a crawler has to fetch a page to read its # noindex. Do not add Disallow here — see config/seo.php. User-agent: * # Product pages Allow: /product/ # Checkout & customer pages Disallow: /checkout Disallow: /payment Disallow: /my-account Disallow: /my-basket Disallow: /cart Disallow: /sign-in Disallow: /order- Disallow: /thank-you # Search and filtered listings — crawl waste, and every one of them is noindex anyway Disallow: /search Disallow: /*?*sort= Disallow: /*?*page= Disallow: /*?*filter= Disallow: /*?*utm_ Disallow: /*?*gclid= Disallow: /*?*fbclid= Disallow: /*?*msclkid= # Static assets Allow: /assets/ Allow: /css/ Allow: /js/ Allow: /img/ Allow: /fonts/ Sitemap: https://api.taraf-jo.com/sitemap.xml