English Français العربية

io.github.harshitAgr/codabench-mcp

Official registry Productivity

MCP server for the Codabench REST API — drives a full ML-benchmark participant workflow.

Source code Documentation

What can you do with io.github.harshitAgr/codabench-mcp?

  • search_competitions, get_competition, list_competition_phases,
  • download_dataset (streaming + SHA-256)
  • list_my_submissions, get_submission, get_submission_logs
  • submit_to_phase (handles Codabench's 3-step upload flow)
  • poll_submission (backoff + timeout + non-error "still_running")
  • get_leaderboard, get_my_profile
  • codabench_request — generic REST escape hatch (GET-only by default)

Install

Add this to your client's MCP configuration (Claude Desktop: claude_desktop_config.json; Cursor: .cursor/mcp.json; VS Code and others use the same "mcpServers" shape).

PYPI package codabench-mcp
Claude Code 
claude mcp add codabench-mcp -e 'CODABENCH_API_TOKEN=<your codabench_api_token>' -- uvx codabench-mcp==0.1.1
JSON configuration (Claude Desktop, Cursor, VS Code) 
{
    "mcpServers": {
        "codabench-mcp": {
            "command": "uvx",
            "args": [
                "codabench-mcp==0.1.1"
            ],
            "env": {
                "CODABENCH_API_TOKEN": "<your codabench_api_token>"
            }
        }
    }
}

Environment variables

  • CODABENCH_API_TOKEN required secret DRF token for Codabench. Obtain via https://www.codabench.org/api/docs/ > api-token-auth > Try it out.

Documentation

From the project's README on GitHub, refreshed weekly. Links open on GitHub.

Contents
  1. codabench-mcp
  2. Features
  3. Authentication
  4. Install
  5. Configure an MCP client
  6. Environment variables
  7. Development
  8. License

codabench-mcp

MCP server for the Codabench REST API. Lets an AI agent drive a full participant ML-benchmark workflow: discover competitions, read rules, download data, submit, poll, read leaderboards.

Features

Curated tools for the participant path:

  • search_competitions, get_competition, list_competition_phases, get_phase, get_competition_rules, list_competition_tasks, get_task
  • download_dataset (streaming + SHA-256)
  • list_my_submissions, get_submission, get_submission_logs
  • submit_to_phase (handles Codabench's 3-step upload flow)
  • poll_submission (backoff + timeout + non-error "still_running")
  • get_leaderboard, get_my_profile
  • codabench_request — generic REST escape hatch (GET-only by default)

Authentication

You need a Codabench API token. Two ways to get one:

  1. Visit https://www.codabench.org/api/docs/
  2. Find the api-token-auth endpoint → Try it out
  3. POST your username/password
  4. Copy the token value from the response
2. curl
curl -X POST https://www.codabench.org/api/api-token-auth/ \
  -H "Content-Type: application/json" \
  -d '{"username":"YOUR_USERNAME","password":"YOUR_PASSWORD"}'

The response is {"token": "..."}.

Install

uvx codabench-mcp

To run the bleeding-edge main branch instead of the last release:

uvx --from git+https://github.com/harshitAgr/codabench-mcp codabench-mcp

Or for development:

git clone https://github.com/harshitAgr/codabench-mcp.git
cd codabench-mcp
uv sync
uv run codabench-mcp  # requires CODABENCH_API_TOKEN

Configure an MCP client

Claude Desktop (claude_desktop_config.json)
{
  "mcpServers": {
    "codabench": {
      "command": "uvx",
      "args": ["codabench-mcp"],
      "env": {
        "CODABENCH_API_TOKEN": "paste-your-token-here"
      }
    }
  }
}
Claude Code (plugin marketplace)
/plugin marketplace add harshitAgr/codabench-mcp
/plugin install codabench-mcp@codabench-mcp

Then export your token in the shell where you launch Claude Code:

export CODABENCH_API_TOKEN=paste-your-token-here
Claude Code (manual)

If you'd rather skip the plugin layer:

claude mcp add codabench \
  --env CODABENCH_API_TOKEN=paste-your-token-here \
  -- uvx codabench-mcp

Environment variables

VariableRequiredDefaultPurpose
CODABENCH_API_TOKENyes—DRF token, sent as Authorization: Token <token>
CODABENCH_BASE_URLnohttps://www.codabench.orgOverride for tests
CODABENCH_ALLOW_WRITE_RAWno0Set to 1 to allow non-GET methods through codabench_request
CODABENCH_MAX_DOWNLOAD_BYTESno5368709120 (5 GB)Cap for download_dataset

Development

uv sync
uv run pytest                              # unit tests, no network
uv run ruff check .                        # lint
uv run ruff format --check .               # format check

License

MIT — see LICENSE.

mcp-name: io.github.harshitAgr/codabench-mcp

Frequently asked questions

What is io.github.harshitAgr/codabench-mcp?

MCP server for the Codabench REST API — drives a full ML-benchmark participant workflow.

How do I install io.github.harshitAgr/codabench-mcp?

It runs on your machine. In Claude Code: claude mcp add codabench-mcp -e 'CODABENCH_API_TOKEN=<your codabench_api_token>' -- uvx codabench-mcp==0.1.1. For other clients, paste the JSON configuration from this page into their MCP settings.

Does io.github.harshitAgr/codabench-mcp need an API key?

Yes. It expects CODABENCH_API_TOKEN, which you set in its configuration.

Is io.github.harshitAgr/codabench-mcp open source?

Yes. Its code is on GitHub under the MIT license.

Who maintains io.github.harshitAgr/codabench-mcp?

It is published by harshitAgr. AI.tn lists it but does not maintain or endorse it.

From the official MCP Registry. Listing is not an endorsement: review a server's code and permissions before giving it access to your data.