← Back to search
75
Agent Ready
Agentic Readiness Score
+25 llms.txt +20 OpenAPI missing +20 ai-plugin
other openapiapimcpllms-txt

Agentic Signals

📄
Found
🤖
ai-plugin.json
Not found
📖
OpenAPI Spec
Found
🔗
Structured API
Found
🛡
Not specified
🏷
Schema.org Markup
Found
MCP Server
Found

Embed this badge

Show off your agentic readiness — the badge auto-updates when your score changes.

Agentic Ready 75/100

            

llms.txt Content

# CrawlGraph > Free backlink intelligence powered by Common Crawl's hyperlink graph (121.1M domains, 3.90B links). Paste any domain, see every site linking to it. No signup. $99 lifetime, unlimited queries. CrawlGraph is a backlink-checker SaaS for SEOs, indie founders, and researchers priced out of Ahrefs and Moz. The hyperlink graph from Common Crawl's quarterly web crawl is reindexed within days of each release; data spans 2017 through the latest 2026 release. ## Core pages - [Homepage](https://crawlgraph.com): product overview, free preview, pricing. - [Gap analysis](https://crawlgraph.com/gap-analysis): compare your backlinks against up to 4 competitors. - [API documentation](https://crawlgraph.com/docs/api): public REST API with a FREE tier (15 backlink calls/month, self-serve key by email, no card). The $99 lifetime license raises this to 1,000 backlink lookups + 50 gap analyses per month and unlocks the gap and outreach tools in the API and MCP server. - [Blog](https://crawlgraph.com/blog): articles on backlink methodology, Common Crawl, comparisons with Ahrefs and Semrush. - [MCP server](https://github.com/pucilpet/crawlgraph-mcp): "crawlgraph-mcp" on npm (npx -y crawlgraph-mcp). Four tools for backlinks, gap analysis, outreach targets, and releases, usable from Claude, Cursor, and Cline. ## Data studies and open datasets Original backlink-overlap studies on Common Crawl data (which domains link to every major tool in a category), free to cite and download: - [Who links to every SEO tool](https://crawlgraph.com/blog/who-links-to-every-seo-tool): 37 domains link to all 8 major SEO tools; mostly trade media and roundups. - [Who links to every CRM](https://crawlgraph.com/blog/who-links-to-every-crm): only 2 domains link to all 8 major CRMs; integration-driven niche. - [SEO-tool link leaderboard](https://crawlgraph.com/seo-tools-link-leaderboard): sortable table with CSV and JSON download. - [Open datasets repo](https://github.com/pucilpet/crawlgraph-dat

OpenAPI Spec (preview)

{"openapi":"3.1.0","info":{"title":"CrawlGraph","description":"Free backlink intelligence powered by Common Crawl's hyperlink graph.","version":"1.1.0"},"paths":{"/api/v1/backlinks":{"post":{"tags":["v1"],"summary":"Look up referring domains for a target domain","description":"Public-API backlink lookup.\n\nValidates ``domain`` and ``release_id`` (400 ``validation_error`` on\nfailure), charges one call against the caller's monthly\n``backlinks`` quota (429 ``quota_exceeded`` on overflow), then r