llms.txt Content
# AI visibility checker
> Free tools that show whether ChatGPT, Perplexity and Google's AI answers can read and cite a website, and that generate or validate an llms.txt. Built by Reese Calder, backed by a 5,000-site crawler census.
## Tools
- [AI visibility checker](https://ai-visibility.lastminutedealshq.com/): checks a site's robots.txt for the AI search crawlers (OAI-SearchBot, PerplexityBot), whether the homepage ships readable text, and whether an llms.txt exists.
- [aicheck, the command-line version](https://ai-visibility.lastminutedealshq.com/tools/aicheck.py): a single-file MIT Python CLI running the same checks locally, with no dependencies, exiting non-zero so it can run in CI.
- [Which well-known sites block AI search crawlers](https://ai-visibility.lastminutedealshq.com/who-blocks-ai-search): a check of 32 recognizable sites showing which block ChatGPT's and Perplexity's search crawlers.
- [Common Crawl checked 584,107 llms.txt files. Most of them are not doing what site owners think.](https://ai-visibility.lastminutedealshq.com/guides/common-crawl-llms-txt-study): A new Common Crawl analysis of 584,107 llms.txt files found many are template-generated, link-free, or trying to write unenforceable robots.txt-style rules into a file that has no enforcement mechanism.
- [Which AI crawlers actually ignore robots.txt: Bytespider, DeepSeekBot and LAIONDownloader checked](https://ai-visibility.lastminutedealshq.com/guides/ai-crawlers-that-ignore-robots-txt): Bytespider, DeepSeekBot and LAIONDownloader checked: two are companies with no published crawler policy at all, and one may have no single operator to comply in the first place.
- [The BEGIN Cloudflare Managed Content block in your robots.txt, and what it does to rules you already had](https://ai-visibility.lastminutedealshq.com/guides/cloudflare-managed-content-robots-txt): Cloudflare's block always goes first in the file, not merged with your own rules. What that means if you already had a rule for the