User-agent: * Content-Signal: search=yes, ai-input=yes, ai-train=yes Allow: / # Optimize crawling Disallow: /admin/ Disallow: /api/ Disallow: /account/login/ Disallow: /account/logout/ Disallow: /static/ Disallow: /media/ Disallow: /*?* Disallow: /search/ Disallow: /cart/ Disallow: /checkout/ # Allow important pages Allow: / Allow: /storefront/ Allow: /brands/ # Sitemap location Sitemap: https://techtraders.co.za/sitemap.xml # Crawl-delay for performance Crawl-delay: 1