User-agent: * Allow: / Disallow: /api/ Disallow: /_next/ Disallow: /login Disallow: /changelog # AI search crawlers (indexing + citation allowed) User-agent: GPTBot Allow: / User-agent: OAI-SearchBot Allow: / User-agent: ClaudeBot Allow: / User-agent: PerplexityBot Allow: / User-agent: Google-Extended Allow: / # Training-only crawlers (block to control training data) User-agent: CCBot Disallow: / Sitemap: https://www.kitchenstocker.com/sitemap.xml