← Back to search
45
Partial
Agentic Readiness Score
Raise this score to 95+
We ship the 6-file GEO uplift as a pull request against your repo. Flat fee, turnaround under 72 hours.
Fix this for $199 →
ai-tools apiaihostingllms-txt

Agentic Signals

📄
Found
🤖
ai-plugin.json
Not found
📖
OpenAPI Spec
Not found
🔗
Structured API
Found
🛡
Not specified
🏷
Schema.org Markup
Found
MCP Server
Not found

Embed this badge

Show off your agentic readiness — the badge auto-updates when your score changes.

Agentic Ready 45/100

            

llms.txt Content

# fastcrw.com > fastCRW is a high-performance web scraper built for AI agents. Single Rust binary, ~6 MB idle RAM, 85 ms cold start, Firecrawl-compatible REST API. Self-host for free or use the managed cloud at fastcrw.com. ## API Endpoints - [Scrape](https://docs.fastcrw.com/#scrape): POST /v1/scrape — extract markdown, HTML, links, or structured JSON from a single URL - [Crawl](https://docs.fastcrw.com/#crawl): POST /v1/crawl — async BFS crawl with job polling, up to 1000 pages - [Map](https://docs.fastcrw.com/#map): POST /v1/map — discover all URLs on a site via sitemap + link traversal - [Search](https://docs.fastcrw.com/#search): POST /v1/search — web search with optional full-page scrape (cloud-only) - [Extract](https://docs.fastcrw.com/#extract): POST /v1/extract — LLM-powered structured data extraction with JSON schema ## Documentation - [Getting Started](https://docs.fastcrw.com/#getting-started): API key setup, first scrape, first crawl - [Formats Reference](https://docs.fastcrw.com/#formats): Output formats — markdown, html, rawHtml, plainText, links, json - [JavaScript Rendering](https://docs.fastcrw.com/#js-rendering): Auto-detect SPA rendering with LightPanda/Chrome - [Error Codes](https://docs.fastcrw.com/#error-codes): HTTP status codes, error/warning response format - [Rate Limits](https://docs.fastcrw.com/#rate-limits): Cloud request-rate limits and retry headers - [Credit Costs](https://docs.fastcrw.com/#credit-costs): Per-endpoint credit consumption (cloud) - [Self-Hosting Guide](https://docs.fastcrw.com/#self-hosting): Single binary or Docker deployment - [Self-Hosting Hardening](https://docs.fastcrw.com/#self-hosting-hardening): Production security and ops guidance - [Compatibility Matrix](https://docs.fastcrw.com/#compatibility): Firecrawl API compatibility status - [Changelog](https://docs.fastcrw.com/#changelog): Release notes and recent changes - [SDK Examples](https://docs.fastcrw.com/#sdk-examples): Python, Node.js, curl ex