User-agent: * Allow: / Disallow: /api/ # AI search, answer, and research crawlers — explicitly welcome public content. # # Keep the API exclusion here as well as in the wildcard group because a # crawler-specific group can take precedence over `User-agent: *`. User-agent: GPTBot User-agent: OAI-SearchBot User-agent: ChatGPT-User User-agent: ClaudeBot User-agent: Claude-SearchBot User-agent: PerplexityBot User-agent: Perplexity-User User-agent: Google-Extended User-agent: CCBot Allow: / Disallow: /api/ Sitemap: https://www.hanpass.com/sitemap.xml # LLM content index: https://www.hanpass.com/llms.txt