RealRun
Independent AI model test scores on 5 tasks: inbox, scheduling, receipts, finance, support replies.
Install
Add this to your client's MCP configuration (Claude Desktop: claude_desktop_config.json; Cursor: .cursor/mcp.json; VS Code and others use the same "mcpServers" shape).
claude mcp add --transport http realrun 'https://realrun.baseledgerip.com/mcp'{
"mcpServers": {
"realrun": {
"type": "http",
"url": "https://realrun.baseledgerip.com/mcp"
}
}
}Documentation
From the project's README on GitHub, refreshed weekly. Links open on GitHub.
Contents
RealRun MCP server
Read-only lookups over RealRun's published, independent tests of AI models on everyday tasks (inbox triage, meeting scheduling, receipts, small-business finance, customer support replies). It lets an agent ask "which model should I use for task X?" and get scores and safety warnings back.
Connect (remote, no install)
Streamable HTTP endpoint: https://realrun.baseledgerip.com/mcp
{ "mcpServers": { "realrun": { "url": "https://realrun.baseledgerip.com/mcp" } } }Claude Code: claude mcp add --transport http realrun https://realrun.baseledgerip.com/mcp
Cline: add this to cline_mcp_settings.json (keep "type": "streamableHttp"; without it Cline falls back to SSE and the connection fails). Full agent-readable steps: llms-install.md.
{ "mcpServers": { "realrun": { "type": "streamableHttp", "url": "https://realrun.baseledgerip.com/mcp", "disabled": false, "autoApprove": [] } } }Run locally (stdio)
npx -y realrun-mcp(once published to npm; from a checkout: npm install && node src/stdio.mjs)
Tools
| Tool | Input | Returns |
|---|---|---|
list_tasks | none | Tested tasks, item counts, dates, results pages, playbook prices |
get_scores | task | Every model's headline score (best first), cost tier, metric definition |
recommend_model | task, priority (accuracy/cost/balanced), include_subscription | One pick + 2 alternatives; never picks a model flagged not recommended |
get_warnings | task | Not-recommended and caution flags (scam failures, invented data, inconsistency) |
Task ids: inbox-triage, meeting-scheduling, receipts, finance, support-replies.
All tools are read-only. The server stores nothing and has no auth. It is stateless, with JSON responses.
Data
src/data.json holds only the published headline numbers. Full prompts and item-level results are in the paid playbooks ($29 each, links in list_tasks). Scores reflect our tests on the dates shown, not a guarantee.
Billing (not active)
Every call passes through src/metering.mjs. The plan is a free allowance of about 20 lookups a day, then per-call billing via Stripe or x402. It is off: nobody is charged, and no payment objects exist.
Test
npm test runs stdio end to end. node test/smoke.mjs https://realrun.baseledgerip.com/mcp tests the remote endpoint.
Layout
src/server.mjs: toolssrc/stdio.mjs: CLIsrc/http.mjs: exports for the HTTP function../netlify/functions/mcp.mjs: Netlify Function at/mcpserver.json: official MCP registry metadata
License: MIT. © Base Ledger IP LLC.
Frequently asked questions
What is RealRun?
Independent AI model test scores on 5 tasks: inbox, scheduling, receipts, finance, support replies.
How do I install RealRun?
It runs as a remote server. In Claude Code: claude mcp add --transport http realrun 'https://realrun.baseledgerip.com/mcp'. For other clients, paste the JSON configuration from this page into their MCP settings.
Does RealRun need an API key?
Its registry entry lists no required key or secret. Some features may still need an account with the service it connects to.
Is RealRun open source?
Yes. Its code is on GitHub under the MIT license.
Who maintains RealRun?
It is published by baseledgerip. AI.tn lists it but does not maintain or endorse it.
From the official MCP Registry. Listing is not an endorsement: review a server's code and permissions before giving it access to your data.