English Français العربية

io.github.daedalus/mcp-llm-gateway

Official registry AI and agents

MCP-compatible LLM gateway that proxies completion requests.

Source code Documentation

What can you do with io.github.daedalus/mcp-llm-gateway?

  • list_models(): List all available models from the remote endpoint
  • complete(prompt, model, max_tokens, temperature): Send a completion request to the downstream LLM provider

Install

Add this to your client's MCP configuration (Claude Desktop: claude_desktop_config.json; Cursor: .cursor/mcp.json; VS Code and others use the same "mcpServers" shape).

PYPI package mcp-llm-gateway
Claude Code 
claude mcp add mcp-llm-gateway -- uvx mcp-llm-gateway==0.1.0
JSON configuration (Claude Desktop, Cursor, VS Code) 
{
    "mcpServers": {
        "mcp-llm-gateway": {
            "command": "uvx",
            "args": [
                "mcp-llm-gateway==0.1.0"
            ]
        }
    }
}

Documentation

From the project's README on GitHub, refreshed weekly. Links open on GitHub.

Contents
  1. MCP LLM Gateway
  2. Install
  3. Usage
  4. Development
  5. API

MCP LLM Gateway

MCP-compatible LLM gateway that proxies completion requests to downstream OpenAI-compatible providers.

mcp-name: io.github.daedalus/mcp-llm-gateway

Install

pip install mcp-llm-gateway

Usage

Configuration

Set the following environment variables:

  • DOWNSTREAM_URL: Base URL for the OpenAI-compatible downstream API (required)
  • DEFAULT_MODEL: Default model to use for completions (required)
  • MODEL_LIST_URL: URL to fetch available models from (optional, defaults to models.dev)
  • API_KEY: Optional API key for downstream (passthrough)
  • TIMEOUT: Request timeout in seconds (optional, default: 60)
MCP Server

Run the MCP server with stdio transport:

mcp-llm-gateway
MCP Tools

The server exposes the following tools:

  • list_models(): List all available models from the remote endpoint
  • complete(prompt, model, max_tokens, temperature): Send a completion request to the downstream LLM provider
MCP Resources
  • models://list: Returns the list of available models
  • config://info: Returns current gateway configuration

Development

git clone https://github.com/daedalus/mcp-llm-gateway.git
cd mcp-llm-gateway
pip install -e ".[test]"

# run tests
pytest

# format
ruff format src/ tests/

# lint
ruff check src/ tests/

# type check
mypy src/

API

core.models
  • Model: Dataclass representing an available LLM model
  • CompletionRequest: Dataclass for completion request payloads
  • GatewayConfig: Dataclass for gateway configuration
adapters.http
  • HTTPAdapter: HTTP client for downstream API communication
  • ModelListAdapter: Adapter for fetching model list from remote endpoints
services.gateway
  • ModelService: Service for managing model discovery and caching
  • CompletionService: Service for handling completion requests
  • ConfigService: Service for managing gateway configuration

Frequently asked questions

What is io.github.daedalus/mcp-llm-gateway?

MCP-compatible LLM gateway that proxies completion requests.

How do I install io.github.daedalus/mcp-llm-gateway?

It runs on your machine. In Claude Code: claude mcp add mcp-llm-gateway -- uvx mcp-llm-gateway==0.1.0. For other clients, paste the JSON configuration from this page into their MCP settings.

Does io.github.daedalus/mcp-llm-gateway need an API key?

Its registry entry lists no required key or secret. Some features may still need an account with the service it connects to.

Is io.github.daedalus/mcp-llm-gateway open source?

Yes. Its code is on GitHub under the MIT license.

Who maintains io.github.daedalus/mcp-llm-gateway?

It is published by daedalus. AI.tn lists it but does not maintain or endorse it.

From the official MCP Registry. Listing is not an endorsement: review a server's code and permissions before giving it access to your data.