RealRun
Independent AI model test scores on 5 tasks: inbox, scheduling, receipts, finance, support replies.
Installation
Ajoutez ceci à la configuration MCP de votre client (Claude Desktop : claude_desktop_config.json ; Cursor : .cursor/mcp.json ; VS Code et les autres utilisent la même forme « mcpServers »).
claude mcp add --transport http realrun 'https://realrun.baseledgerip.com/mcp'{
"mcpServers": {
"realrun": {
"type": "http",
"url": "https://realrun.baseledgerip.com/mcp"
}
}
}Documentation
Tirée du README du projet sur GitHub, actualisée chaque semaine. Les liens ouvrent GitHub.
Sommaire
RealRun MCP server
Read-only lookups over RealRun's published, independent tests of AI models on everyday tasks (inbox triage, meeting scheduling, receipts, small-business finance, customer support replies). It lets an agent ask "which model should I use for task X?" and get scores and safety warnings back.
Connect (remote, no install)
Streamable HTTP endpoint: https://realrun.baseledgerip.com/mcp
{ "mcpServers": { "realrun": { "url": "https://realrun.baseledgerip.com/mcp" } } }Claude Code: claude mcp add --transport http realrun https://realrun.baseledgerip.com/mcp
Cline: add this to cline_mcp_settings.json (keep "type": "streamableHttp"; without it Cline falls back to SSE and the connection fails). Full agent-readable steps: llms-install.md.
{ "mcpServers": { "realrun": { "type": "streamableHttp", "url": "https://realrun.baseledgerip.com/mcp", "disabled": false, "autoApprove": [] } } }Run locally (stdio)
npx -y realrun-mcp(once published to npm; from a checkout: npm install && node src/stdio.mjs)
Tools
| Tool | Input | Returns |
|---|---|---|
list_tasks | none | Tested tasks, item counts, dates, results pages, playbook prices |
get_scores | task | Every model's headline score (best first), cost tier, metric definition |
recommend_model | task, priority (accuracy/cost/balanced), include_subscription | One pick + 2 alternatives; never picks a model flagged not recommended |
get_warnings | task | Not-recommended and caution flags (scam failures, invented data, inconsistency) |
Task ids: inbox-triage, meeting-scheduling, receipts, finance, support-replies.
All tools are read-only. The server stores nothing and has no auth. It is stateless, with JSON responses.
Data
src/data.json holds only the published headline numbers. Full prompts and item-level results are in the paid playbooks ($29 each, links in list_tasks). Scores reflect our tests on the dates shown, not a guarantee.
Billing (not active)
Every call passes through src/metering.mjs. The plan is a free allowance of about 20 lookups a day, then per-call billing via Stripe or x402. It is off: nobody is charged, and no payment objects exist.
Test
npm test runs stdio end to end. node test/smoke.mjs https://realrun.baseledgerip.com/mcp tests the remote endpoint.
Layout
src/server.mjs: toolssrc/stdio.mjs: CLIsrc/http.mjs: exports for the HTTP function../netlify/functions/mcp.mjs: Netlify Function at/mcpserver.json: official MCP registry metadata
License: MIT. © Base Ledger IP LLC.
Questions fréquentes
Qu'est-ce que RealRun ?
Independent AI model test scores on 5 tasks: inbox, scheduling, receipts, finance, support replies.
Comment installer RealRun ?
Il fonctionne comme serveur distant. Dans Claude Code : claude mcp add --transport http realrun 'https://realrun.baseledgerip.com/mcp'. Pour les autres clients, collez la configuration JSON de cette page dans leurs réglages MCP.
Faut-il une clé API pour RealRun ?
Son entrée au registre n'indique aucune clé ni secret obligatoire. Certaines fonctions peuvent tout de même demander un compte auprès du service auquel il se connecte.
RealRun est-il open source ?
Oui. Son code est sur GitHub sous licence MIT.
Qui maintient RealRun ?
Il est publié par baseledgerip. AI.tn le référence sans le maintenir ni le recommander.
Issu du registre MCP officiel. Être listé n'est pas une recommandation : vérifiez le code et les permissions d'un serveur avant de lui donner accès à vos données.