llms.txt Content
# fastcrw.com
> fastCRW is a high-performance web scraper built for AI agents. Single Rust binary, ~6 MB idle RAM, 85 ms cold start, Firecrawl-compatible REST API. Self-host for free or use the managed cloud at fastcrw.com.
## API Endpoints
- [Scrape](https://docs.fastcrw.com/#scrape): POST /v1/scrape — extract markdown, HTML, links, or structured JSON from a single URL
- [Crawl](https://docs.fastcrw.com/#crawl): POST /v1/crawl — async BFS crawl with job polling, up to 1000 pages
- [Map](https://docs.fastcrw.com/#map): POST /v1/map — discover all URLs on a site via sitemap + link traversal
- [Search](https://docs.fastcrw.com/#search): POST /v1/search — web search with optional full-page scrape (cloud-only)
- [Extract](https://docs.fastcrw.com/#extract): POST /v1/extract — LLM-powered structured data extraction with JSON schema
## Documentation
- [Getting Started](https://docs.fastcrw.com/#getting-started): API key setup, first scrape, first crawl
- [Formats Reference](https://docs.fastcrw.com/#formats): Output formats — markdown, html, rawHtml, plainText, links, json
- [JavaScript Rendering](https://docs.fastcrw.com/#js-rendering): Auto-detect SPA rendering with LightPanda/Chrome
- [Error Codes](https://docs.fastcrw.com/#error-codes): HTTP status codes, error/warning response format
- [Rate Limits](https://docs.fastcrw.com/#rate-limits): Cloud request-rate limits and retry headers
- [Credit Costs](https://docs.fastcrw.com/#credit-costs): Per-endpoint credit consumption (cloud)
- [Self-Hosting Guide](https://docs.fastcrw.com/#self-hosting): Single binary or Docker deployment
- [Self-Hosting Hardening](https://docs.fastcrw.com/#self-hosting-hardening): Production security and ops guidance
- [Compatibility Matrix](https://docs.fastcrw.com/#compatibility): Firecrawl API compatibility status
- [Changelog](https://docs.fastcrw.com/#changelog): Release notes and recent changes
- [SDK Examples](https://docs.fastcrw.com/#sdk-examples): Python, Node.js, curl ex