Scorable - LLM Evaluation Platform, Calibrated LLM Judges

# Scorable > Scorable (formerly Root Signals) is an AI evaluation platform. It helps engineering teams measure, test, and improve LLM-powered applications using custom judges, automated experiments, and production monitoring. ## Product - [Home](https://scorable.ai): Overview of Scorable's AI evaluation capabilities. - [Pricing](https://scorable.ai/pricing): Free tier and paid plans for teams. - [Book a Demo](https://scorable.ai/book-a-demo): Schedule a walkthrough with the team. - [Use Cases](https://scorable.ai/use-cases): How teams evaluate chatbots, RAG pipelines, and AI agents with Scorable. - [Quick Start](https://scorable.ai/quick-start): Create an LLM-as-a-judge evaluator and score output in minutes. - [LLM-as-a-Judge](https://scorable.ai/c/llm-as-a-judge): Reliable AI with comprehensive LLM-as-a-judge evaluation. - [LLM Guardrails](https://scorable.ai/c/guardrails): Real-time prevention of AI failures in production agents. - [AI Agent Evaluation](https://scorable.ai/c/ai-agent-evaluation): Score every agent response for accuracy, safety, and compliance. - [Blog](https://scorable.ai/blog): 100+ articles on LLM evaluation, guardrails, RAG metrics, and AI reliability. - [Events and Webinars](https://scorable.ai/events-and-webinars): Talks and webinars on AI evaluation. ## Documentation - [Docs](https://docs.scorable.ai/llms.txt): Full documentation in LLM-friendly format. - [Full content](https://scorable.ai/llms-full.txt): Site content index - marketing, legal, and campaign pages plus all blog posts with summaries. ## API - [API Reference](https://docs.scorable.ai): REST API and SDK documentation. ## MCP server Scorable runs a hosted remote MCP server at `https://api.scorable.ai/mcp`. Connecting an MCP client to it gives an agent 14 tools to find, run, and author LLM evaluations: `list_judges`, `get_judge`, `run_judge`, `list_evaluators`, `get_evaluator`, `run_evaluator`, `generate_judge`, `create_judge`, `update_judge`, `create_evaluator`, `update_

{"openapi":"3.0.3","info":{"title":"Scorable API","version":"1.0.0 (latest)","description":"Scorable JSON API provides a way to access Scorable using provisioned API token"},"paths":{"/v1/annotations/":{"get":{"operationId":"annotations_list","parameters":[{"name":"cursor","required":false,"in":"query","description":"The pagination cursor value.","schema":{"type":"string"}},{"in":"query","name":"dataset","schema":{"type":"string","format":"uuid"},"description":"Filter by the dataset the items be