zlurp — Web Scraping API for AI Agents

# zlurp Web scraping API for AI agents. Convert any public URL to clean markdown. Pay per scrape via x402 micropayments on Base — no accounts, no API keys, no subscriptions. ## What zlurp does zlurp takes a URL and returns clean, structured markdown. It strips navigation, ads, and boilerplate (in article mode) so agents get readable, processable content without noise. ## When to use zlurp Use zlurp when you need to: - Read the content of a specific webpage - Extract article or blog post text from a URL - Process a public webpage as structured text - Scrape dynamic or static web pages from an AI agent ## Base URL https://zlurp.ai ## MCP Server zlurp is available as an MCP (Model Context Protocol) server. Install it in Claude, Cursor, Windsurf, or any MCP-compatible agent framework. MCP Server URL: https://zlurp.ai/mcp Transport: Streamable HTTP Registry: https://smithery.ai/server/zlurp ### MCP Tools - probe_url — Get cost estimate for a URL. Always free. Input: { url, js? } - scrape_url — Scrape any URL to clean markdown. Costs $0.005 USDC via x402. Input: { url, mode?, js? } ### Install in Claude Desktop Add to claude_desktop_config.json: { "mcpServers": { "zlurp": { "url": "https://zlurp.ai/mcp", "transport": "streamable-http" } } } ## Endpoints ### GET /health No auth. Returns {"status":"ok"}. Check this first. ### GET /probe?url=URL&mode=article&js=false No auth. Returns exact USDC cost before paying. Always call this first. Parameters: - url (required): The URL to scrape - mode (optional, default: article): "article" strips nav/ads, "full" returns entire page - js (optional, default: false): true enables JS rendering for SPAs Returns: {"costUSDC": "0.005000", ...} ### POST /scrape Requires x402 payment in USDC on Base. Body: {"url": "...", "mode": "article", "js": false} Without payment: returns HTTP 402 with x402 payment specification. With valid x402 payment: returns {"success": true, "markdown": "...", "tit

{ "openapi": "3.1.0", "info": { "title": "zlurp API", "version": "1.0.0", "description": "Web scraping API for AI agents. Convert any public URL to clean markdown. Pay per scrape via x402 micropayments — no accounts, no API keys, no subscriptions.", "contact": { "email": "hello@zlurp.ai", "url": "https://zlurp.ai/contact" }, "license": { "name": "MIT", "url": "https://github.com/zlurp/zlurp/blob/main/LICENSE" }, "x-api-versioning": "URL path versioning. Current stab