English Français العربية

io.github.AlligatorC0der/conkurrence

Official registry AI and agents

Multi-model rating for AI evaluation. Agreement is reliability, not validity. Maintenance mode.

Source code Documentation

What can you do with io.github.AlligatorC0der/conkurrence?

  • Multi-model evaluation — Run your schema against Bedrock, OpenAI, and Gemini models simultaneously
  • Agreement statistics — Fleiss' kappa with bootstrap confidence intervals; Kendall's W against expert-labelled anchor items
  • Self-consistency mode — No API keys needed; uses the host model via MCP Sampling
  • Schema suggestion — AI-powered schema design from your data
  • Trend tracking — Compare runs over time, detect agreement degradation
  • Cost estimation — Know the cost before running

Install

Add this to your client's MCP configuration (Claude Desktop: claude_desktop_config.json; Cursor: .cursor/mcp.json; VS Code and others use the same "mcpServers" shape).

NPM package conkurrence
Claude Code 
claude mcp add conkurrence -- npx -y conkurrence@1.0.5
JSON configuration (Claude Desktop, Cursor, VS Code) 
{
    "mcpServers": {
        "conkurrence": {
            "command": "npx",
            "args": [
                "-y",
                "conkurrence@1.0.5"
            ]
        }
    }
}

Documentation

From the project's README on GitHub, refreshed weekly. Links open on GitHub.

Contents
  1. ConKurrence
  2. Install
  3. MCP Server
  4. Features
  5. MCP Tools
  6. Links
  7. License

ConKurrence

Multi-model rating for AI evaluation: measures agreement among model raters (Fleiss' κ, Kendall's W) to find contested items for expert review.

What agreement tells you: where your raters and your criteria are consistent, and where they are not — which items are contested, and whether disagreement comes from the criteria or the raters.

What it does not tell you: that the raters are right. Agreement is reliability, not validity. Models can agree confidently on a wrong answer. Use ConKurrence to decide where an expert's judgment is needed and to diagnose your evaluation criteria — not to replace expert-labelled ground truth.

Status: maintenance mode. ConKurrence is developed by JE Vectors LLC as the evaluation instrument behind Inqura. It is not accepting purchases and carries no support commitment.

Install

npm install -g conkurrence

MCP Server

Use ConKurrence as an MCP server in Claude Desktop or any MCP-compatible client:

npx conkurrence mcp
Claude Desktop Configuration

Add to your claude_desktop_config.json:

{
  "mcpServers": {
    "conkurrence": {
      "command": "npx",
      "args": ["-y", "conkurrence", "mcp"]
    }
  }
}
Claude Code Plugin
/plugin marketplace add AlligatorC0der/conkurrence

Features

  • Multi-model evaluation — Run your schema against Bedrock, OpenAI, and Gemini models simultaneously
  • Agreement statistics — Fleiss' kappa with bootstrap confidence intervals; Kendall's W against expert-labelled anchor items
  • Self-consistency mode — No API keys needed; uses the host model via MCP Sampling
  • Schema suggestion — AI-powered schema design from your data
  • Trend tracking — Compare runs over time, detect agreement degradation
  • Cost estimation — Know the cost before running

MCP Tools

ToolDescription
conkurrence_runExecute an evaluation across multiple AI raters
conkurrence_reportGenerate a detailed markdown report
conkurrence_compareSide-by-side comparison of two runs
conkurrence_trendTrack agreement over multiple runs
conkurrence_suggestAI-powered schema suggestion from your data
conkurrence_validate_schemaValidate a schema before running
conkurrence_estimateEstimate cost and token usage

License

BUSL-1.1 — Business Source License 1.1

Frequently asked questions

What is io.github.AlligatorC0der/conkurrence?

Multi-model rating for AI evaluation. Agreement is reliability, not validity. Maintenance mode.

How do I install io.github.AlligatorC0der/conkurrence?

It runs on your machine. In Claude Code: claude mcp add conkurrence -- npx -y conkurrence@1.0.5. For other clients, paste the JSON configuration from this page into their MCP settings.

Does io.github.AlligatorC0der/conkurrence need an API key?

Its registry entry lists no required key or secret. Some features may still need an account with the service it connects to.

Is io.github.AlligatorC0der/conkurrence open source?

Its code is public on GitHub, but the repository does not declare a standard license.

Who maintains io.github.AlligatorC0der/conkurrence?

It is published by AlligatorC0der. AI.tn lists it but does not maintain or endorse it.

From the official MCP Registry. Listing is not an endorsement: review a server's code and permissions before giving it access to your data.