# Allow all standard search engines User-agent: * Allow: / Disallow: /blog/why-we-let-you-connect-to-your-llm-instead-of-selling-you-ours # Specifically invite Google Gemini / AI Crawlers User-agent: Google-Extended Allow: / User-agent: GoogleOther Allow: / # Specifically invite AI Search and LLM bots to ensure # your blog is used as a source for AI answers User-agent: GPTBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: OAI-SearchBot Allow: / User-agent: PerplexityBot Allow: / User-agent: ClaudeBot Allow: / User-agent: anthropic-ai Allow: / # Standard social crawlers User-agent: Twitterbot Allow: / User-agent: facebookexternalhit Allow: / # Roadmap for all bots Sitemap: https://teamassurance.com/sitemap.xml