# www.robotstxt.org/ # Allow all crawlers including LLM/AI crawlers User-agent: * Allow: / # Explicitly allow common LLM/AI crawlers User-agent: GPTBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: CCBot Allow: / User-agent: anthropic-ai Allow: / User-agent: Claude-Web Allow: / User-agent: Google-Extended Allow: / User-agent: PerplexityBot Allow: / User-agent: Applebot-Extended Allow: / User-agent: Omgilibot Allow: / User-agent: FacebookBot Allow: / User-agent: ia_archiver Allow: / # Sitemap location Sitemap: https://gpounj.com/sitemap.xml