State of the Agentic Web

Live data on how well agent-first sites serve AI agents. Updated with every recrawl.

4191
Agent-First Sites
35.5
Average Score
249
Score 70+
455
Live MCP Servers

Signal Adoption

How many of the 4191 agent-first indexed sites expose each agentic signal. A site must expose a hard signal such as a structured API, OpenAPI spec, ai-plugin manifest, or MCP server to appear in this report.

llms.txt
2275 sites (54.3%)
Schema.org
1843 sites (44.0%)
robots.txt AI rules
872 sites (20.8%)
MCP Server
455 sites (10.9%)
OpenAPI Spec
499 sites (11.9%)
Structured API
3897 sites (93.0%)
ai-plugin.json
271 sites (6.5%)
Key finding: 54% of agent-first sites publish llms.txt, while 12% expose an OpenAPI spec. Sites that pair llms.txt with an MCP server (348 sites) score dramatically higher than passive content-only sites, which are excluded from this report.

Categories

CategorySitesAvg Score
developer 1243 34.7
ai-tools 908 40.9
other 785 27.3
data 399 31.8
finance 189 40.5
productivity 170 38.6
ecommerce 148 41.3
communication 120 38.3
security 111 39.4
health 58 41.5
jobs 26 41.3
education 21 48.8

Top Scoring Sites

DomainScoreCategory
prereason.com 100 finance
gptr.dev 100 developer
skillboss.co 100 ecommerce
blooio.com 100 productivity
nothumansearch.com 100 ai-tools
mcp.depscope.dev 100 developer
zgts.in 100 health
flowzap.xyz 100 developer
memestack.ai 100 ai-tools
postalform.com 100 communication
headlessoracle.com 100 ai-tools
clicksprotocol.xyz 100 ai-tools
astranl.com 100 other
agentndx.ai 100 developer
chainray.online 100 ai-tools
api.contrastcyber.com 100 data
ansvar.eu 100 security
bringyour.ai 100 ai-tools
savordish.com 100 ai-tools
tabai.dev 100 productivity

Methodology

Every site is scored on 7 signals: llms.txt (25 pts), ai-plugin.json (20), OpenAPI spec (20), structured API (15), MCP server (10), robots.txt AI rules (5), Schema.org (5). All detections are content-verified — the crawler probes MCP endpoints with JSON-RPC, parses OpenAPI specs, and validates ai-plugin.json manifests.

The index grows via auto-discovery from the official MCP registry, PulseMCP, awesome-mcp-servers lists, and llms.txt directories. Sites are recrawled daily.

Full scoring methodology: Guide

Check your site's agentic readiness

Score any URL instantly and see which signals you're missing.

Score Your Site