# Not Human Search — robots.txt # We index sites for AI agent discovery. We welcome all crawlers. User-agent: * Allow: / # AI agent crawlers — explicitly welcome User-agent: GPTBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: ClaudeBot Allow: / User-agent: PerplexityBot Allow: / User-agent: Applebot-Extended Allow: / User-agent: cohere-ai Allow: / Sitemap: https://nothumansearch.ai/sitemap.xml # RSS feed: https://nothumansearch.ai/feed.xml (new agent-ready additions)