llms.txt Content
# ScrapingBee Documentation
> Official documentation index for ScrapingBee's web scraping, search, ecommerce, AI, developer tools, and automation integrations.
Use this index to select the specific API or integration reference for a task. Each linked file is directly maintained and contains the applicable contract, constraints, costs, and examples.
## Routing decision map
- Fetch, render, interact with, screenshot, download, or extract from an arbitrary URL → [HTML API](https://www.scrapingbee.com/llms/html-api.txt).
- Let ScrapingBee choose the proxy/rendering tier for a blocked URL → [HTML API](https://www.scrapingbee.com/llms/html-api.txt) with `mode=auto` and optional `max_cost`.
- Define CSS/XPath or AI extraction rules → [Data extraction](https://www.scrapingbee.com/llms/data-extraction.txt); automate clicks, fields, waits, or scrolling → [JavaScript scenarios](https://www.scrapingbee.com/llms/js-scenario.txt).
- Configure a third-party HTTP/SOCKS proxy client → [Proxy mode](https://www.scrapingbee.com/llms/proxy-mode.txt).
- Select country targeting → [Premium country codes](https://www.scrapingbee.com/llms/country-codes-premium.txt) or [Classic country codes](https://www.scrapingbee.com/llms/country-codes-classic.txt).
- Search Google → [Google Search API](https://www.scrapingbee.com/llms/google-search-api.txt); use [Fast Search API](https://www.scrapingbee.com/llms/fast-search-api.txt) for a lightweight result list.
- Retrieve Amazon, Walmart, or YouTube data → choose the exact endpoint below by query, ASIN, numeric product ID, video ID, or subtitles.
- Use an LLM response → [ChatGPT API](https://www.scrapingbee.com/llms/chatgpt-api.txt) or [Gemini API](https://www.scrapingbee.com/llms/gemini-api.txt).
- Integrate from a shell, MCP client, LangChain, or no-code product → use the matching tool/integration reference below.
## Core APIs
- [HTML API](https://www.scrapingbee.com/llms/html-api.txt) — Tags: web scraping, arbitrary URL,