State of the Agentic Web

Live data on how well agent-first sites serve AI agents. Updated with every recrawl.

4313
Agent-First Sites
37.4
Average Score
353
Score 70+
481
Live MCP Servers

Signal Adoption

How many of the 4313 agent-first indexed sites expose each agentic signal. A site must expose a hard signal such as a structured API, OpenAPI spec, ai-plugin manifest, or MCP server to appear in this report.

llms.txt
2490 sites (57.7%)
Schema.org
2066 sites (47.9%)
robots.txt AI rules
959 sites (22.2%)
MCP Server
481 sites (11.2%)
OpenAPI Spec
605 sites (14.0%)
Structured API
4014 sites (93.1%)
ai-plugin.json
350 sites (8.1%)
Key finding: 58% of agent-first sites publish llms.txt, while 14% expose an OpenAPI spec. Sites that pair llms.txt with an MCP server (382 sites) score dramatically higher than passive content-only sites, which are excluded from this report.

Categories

CategorySitesAvg Score
developer 1319 38.0
ai-tools 924 42.6
other 814 28.4
data 388 33.4
finance 199 43.6
productivity 162 40.2
ecommerce 156 40.9
communication 123 38.7
security 113 39.9
health 60 43.3
jobs 26 42.3
education 20 50.0

Top Scoring Sites

DomainScoreCategory
chainray.online 100 ai-tools
chartlibrary.io 100 finance
amalgix.io 100 ai-tools
twexapi.io 100 security
asterpay.io 100 ai-tools
blooio.com 100 productivity
teenanxiety.ai 100 ai-tools
claudereviews.com 100 ai-tools
postalform.com 100 communication
savordish.com 100 ai-tools
tinify.ai 100 ai-tools
emadibrahim.com 100 ai-tools
rendoc.dev 100 developer
voidly.ai 100 ai-tools
aurelianflo.com 100 ai-tools
depscope.dev 100 ai-tools
flowzap.xyz 100 developer
api.headlessoracle.com 100 data
agentservices.to 100 ai-tools
clicksprotocol.xyz 100 ai-tools

Methodology

Every site is scored on 7 signals: llms.txt (25 pts), ai-plugin.json (20), OpenAPI spec (20), structured API (15), MCP server (10), robots.txt AI rules (5), Schema.org (5). All detections are content-verified — the crawler probes MCP endpoints with JSON-RPC, parses OpenAPI specs, and validates ai-plugin.json manifests.

The index grows via auto-discovery from the official MCP registry, PulseMCP, awesome-mcp-servers lists, and llms.txt directories. Sites are recrawled daily.

Full scoring methodology: Guide

Check your site's agentic readiness

Score any URL instantly and see which signals you're missing.

Score Your Site