State of the Agentic Web

Live data on how well agent-first sites serve AI agents. Updated with every recrawl.

5471
Agent-First Sites
38.7
Average Score
539
Score 70+
734
Live MCP Servers

Signal Adoption

How many of the 5471 agent-first indexed sites expose each agentic signal. A site must expose a hard signal such as a structured API, OpenAPI spec, ai-plugin manifest, or MCP server to appear in this report.

llms.txt
3248 sites (59.4%)
Schema.org
2711 sites (49.6%)
robots.txt AI rules
1362 sites (24.9%)
MCP Server
734 sites (13.4%)
OpenAPI Spec
903 sites (16.5%)
Structured API
5077 sites (92.8%)
ai-plugin.json
442 sites (8.1%)
Key finding: 59% of agent-first sites publish llms.txt, while 17% expose an OpenAPI spec. Sites that pair llms.txt with an MCP server (590 sites) score dramatically higher than passive content-only sites, which are excluded from this report.

Categories

CategorySitesAvg Score
developer 1661 38.5
ai-tools 1220 44.8
other 1086 31.8
data 499 33.0
finance 226 44.2
ecommerce 182 41.9
productivity 181 40.9
communication 163 41.3
security 129 39.6
health 63 41.7
jobs 31 41.5
education 20 50.0

Top Scoring Sites

DomainScoreCategory
bibigpt.co 100 ai-tools
asset-manager-jaymarrero2.replit.app 100 other
headlessoracle.com 100 ai-tools
tryspook.com 100 communication
api.headlessoracle.com 100 data
childanxiety.ai 100 ai-tools
bbwbelles.com 100 other
hlido.eu 100 ai-tools
workprotocol.ai 100 ai-tools
x711.io 100 ai-tools
mansetetkisi.com 100 news
lobehub.com 100 other
nothumansearch.com 100 ai-tools
astranl.com 100 other
budgetfitter.uk 100 ecommerce
childadhd.ai 100 ai-tools
gluon.stability.nexus 100 other
teenadhd.ai 100 ai-tools
zgts.in 100 health
eqbuilder.dev 100 ai-tools

Methodology

Every site is scored on 7 signals: llms.txt (25 pts), ai-plugin.json (20), OpenAPI spec (20), structured API (15), MCP server (10), robots.txt AI rules (5), Schema.org (5). All detections are content-verified — the crawler probes MCP endpoints with JSON-RPC, parses OpenAPI specs, and validates ai-plugin.json manifests.

The index grows via auto-discovery from the official MCP registry, PulseMCP, awesome-mcp-servers lists, and llms.txt directories. Sites are recrawled daily.

Full scoring methodology: Guide

Check your site's agentic readiness

Score any URL instantly and see which signals you're missing.

Score Your Site