# 1. OpenAI (ChatGPT) User-agent: GPTBot Allow: /id/blog/ # 2. Google Extended (Gemini & AI Training) User-agent: Google-Extended Allow: /id/blog/ # 3. Common Crawl (Digunakan oleh banyak model LLM lainnya) User-agent: CCBot Allow: /id/blog/ # 4. Anthropic (Claude AI) User-agent: anthropic-ai Allow: /id/blog/ # 5. Perplexity AI User-agent: PerplexityBot Allow: /id/blog/ # Memastikan Googlebot standar tetap bisa merayapi seluruh blog User-agent: Googlebot Allow: /id/blog/ # Default: izinkan semua bot merayapi seluruh website User-agent: * Allow: / Sitemap: https://www.klarsmile.com/sitemap.xml