# Public content may be indexed for search, user-requested retrieval, and # model-training collection. Page-level lifecycle and evidence labels remain # authoritative; crawler access does not remove those interpretation limits. # Policy: search=yes, user-triggered AI retrieval=yes, model training=yes # Standard search, AI search, and user-triggered retrieval User-agent: Googlebot User-agent: Bingbot User-agent: OAI-SearchBot User-agent: ChatGPT-User User-agent: Claude-SearchBot User-agent: Claude-User User-agent: PerplexityBot User-agent: Perplexity-User Allow: / # Client-side filter states serve the same HTML as their canonical page. Disallow: /*?tag= Disallow: /*?view= Disallow: /*?technique= Disallow: /*?tactic= Disallow: /*?facet= Disallow: /*?f. Disallow: /*?q= Disallow: /search.html? User-agent: GPTBot Allow: / User-agent: ClaudeBot Allow: / User-agent: anthropic-ai Allow: / User-agent: Google-Extended Allow: / User-agent: CCBot Allow: / User-agent: Applebot-Extended Allow: / User-agent: FacebookBot Allow: / User-agent: Bytespider Allow: / User-agent: cohere-ai Allow: / # All other compliant crawlers may index public pages. # Non-compliant scrapers and agentic browsers using ordinary browser signatures # cannot be controlled by robots.txt; enforcement for those belongs at the CDN/WAF. User-agent: * Allow: / # Client-side filter states serve the same HTML as their canonical page. Disallow: /*?tag= Disallow: /*?view= Disallow: /*?technique= Disallow: /*?tactic= Disallow: /*?facet= Disallow: /*?f. Disallow: /*?q= Disallow: /search.html? Sitemap: https://1200km.com/sitemap.xml # LLM guide: https://1200km.com/llms.txt