User-agent: * Allow: / # NOTE: do NOT disallow /_next/static/ or /_next/image here. # # /_next/static/ serves every JS and CSS bundle. Blocking it stops crawlers # rendering the site at all — Google's guidance is explicit that CSS/JS must # stay crawlable. /_next/image is the image optimiser every page image is # served through, so blocking it removes the whole image pipeline from search. # # Both were briefly disallowed on 13 Aug 2026 to stop a single # /_next/image?url=... asset URL appearing as a search result. That is a # cosmetic problem and nowhere near worth the cost. Reverted 16 Aug 2026. # Internal site search — search result pages were surfacing in Google # (e.g. "/search can i customize white label taxi apps...", 17 impressions). Disallow: /search Disallow: /*?q= Disallow: /*?s= # Post-conversion pages. Already noindex'd; blocked here so crawl budget # is not spent re-fetching them. Disallow: /thank-you Disallow: /book-demo/thank-you User-agent: GPTBot Allow: / User-agent: ClaudeBot Allow: / User-agent: anthropic-ai Allow: / User-agent: Google-Extended Allow: / User-agent: PerplexityBot Allow: / User-agent: Bingbot Allow: / User-agent: cohere-ai Allow: / sitemap: https://atozdispatch.com/sitemap.xml sitemap: https://atozdispatch.com/blog/sitemap.xml