# KingCrop robots.txt โ€” physical file (canonical mirror: repo server-files/robots.txt) # 2026-08-08: crawl-budget + cart protection. Fixes: (a) faceted/sort params were index,follow # (crawl trap, audit 2026-08-04 issue #1); (b) new server had no physical robots.txt at all. # Cloudflare "Managed Content" AI-crawler block is injected at the edge ABOVE this file โ€” that # is a CF dashboard setting, not this file. User-agent: * Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php Disallow: /cart/ Disallow: /checkout/ Disallow: /my-account/ Disallow: /wishlist/ Disallow: /*add-to-cart= Disallow: /*?*orderby= Disallow: /*?*filter_ Disallow: /*?*min_price= Disallow: /*?*max_price= Disallow: /*?*rating_filter= Disallow: /*?*per_page= Disallow: /*?*shop_view= Disallow: /*?*attribute_ Disallow: /*?*wc-ajax= Disallow: /? # 2026-10-13 (SEO plan v2 ยง2.5-2): Google Business Profile website link lands on /?utm_source=gbp&utm_medium=organic โ€” # longest match wins, so this beats "/?" and "/*utm*=" for that URL only; every other parameter stays blocked. Allow: /?utm_source=gbp Disallow: /*?s= Disallow: /*&s= Disallow: /search/ Disallow: /author/ Disallow: /users/ Disallow: */trackback Disallow: */feed Disallow: */rss Disallow: */embed Disallow: */wlwmanifest.xml Disallow: /xmlrpc.php Disallow: /*utm*= Disallow: /*openstat= Disallow: /cgi-bin Disallow: /cdn-cgi/ Disallow: /wp-content/uploads/wc-logs/ Disallow: /wp-content/uploads/woocommerce_transient_files/ Disallow: /wp-content/uploads/woocommerce_uploads/ Allow: /*.css Allow: /*.js Allow: */uploads User-agent: MJ12bot Disallow: / Sitemap: https://kingcropdelivery.com/sitemap_index.xml