English Français العربية

Octocrawl

Official registry Search and web

Web pages as clean Markdown and JSON for AI agents, in fewer tokens, with an Evidence Record.

Source code Website

Install

Add this to your client's MCP configuration (Claude Desktop: claude_desktop_config.json; Cursor: .cursor/mcp.json; VS Code and others use the same "mcpServers" shape).

Remote (streamable-http)
Claude Code 
claude mcp add --transport http octocrawl 'https://mcp.octocrawl.dev/mcp'
JSON configuration (Claude Desktop, Cursor, VS Code) 
{
    "mcpServers": {
        "octocrawl": {
            "type": "http",
            "url": "https://mcp.octocrawl.dev/mcp"
        }
    }
}
Remote (streamable-http)
Claude Code 
claude mcp add --transport http octocrawl 'https://mcp.octocrawl.dev/mcp-oauth'
JSON configuration (Claude Desktop, Cursor, VS Code) 
{
    "mcpServers": {
        "octocrawl": {
            "type": "http",
            "url": "https://mcp.octocrawl.dev/mcp-oauth"
        }
    }
}
NPM package @octocrawl/mcp
Claude Code 
claude mcp add octocrawl -e 'W2L_API_URL=<W2L_API_URL>' -e 'W2L_API_TOKEN=<your w2l_api_token>' -e 'W2L_MCP_TOOLSETS=<W2L_MCP_TOOLSETS>' -e 'W2L_MCP_READ_ONLY=<W2L_MCP_READ_ONLY>' -- npx -y @octocrawl/mcp@0.7.0
JSON configuration (Claude Desktop, Cursor, VS Code) 
{
    "mcpServers": {
        "octocrawl": {
            "command": "npx",
            "args": [
                "-y",
                "@octocrawl/mcp@0.7.0"
            ],
            "env": {
                "W2L_API_URL": "<W2L_API_URL>",
                "W2L_API_TOKEN": "<your w2l_api_token>",
                "W2L_MCP_TOOLSETS": "<W2L_MCP_TOOLSETS>",
                "W2L_MCP_READ_ONLY": "<W2L_MCP_READ_ONLY>"
            }
        }
    }
}

Environment variables

  • W2L_API_URL The Octocrawl API the server calls: npx octocrawl serve on this computer (default http://127.0.0.1:8787), or https://api.octocrawl.dev
  • W2L_API_TOKEN secret A bearer token for a hosted or self-hosted API; none for a local one
  • W2L_MCP_TOOLSETS The tool groups to list, comma-separated: core, crawl, batch, products, logins, monitor, delivery, or all (default all); the same as --toolsets
  • W2L_MCP_READ_ONLY 1 lists read-only tools alone, with a scrape that does not act as the person; the same as --read-only

Frequently asked questions

What is Octocrawl?

Web pages as clean Markdown and JSON for AI agents, in fewer tokens, with an Evidence Record.

How do I install Octocrawl?

It runs as a remote server. In Claude Code: claude mcp add --transport http octocrawl 'https://mcp.octocrawl.dev/mcp'. For other clients, paste the JSON configuration from this page into their MCP settings.

Does Octocrawl need an API key?

Yes. It expects W2L_API_TOKEN, which you set in its configuration.

Is Octocrawl open source?

Its code is public on GitHub, but the repository does not declare a standard license.

Who maintains Octocrawl?

It is published by 77777R7. AI.tn lists it but does not maintain or endorse it.

From the official MCP Registry. Listing is not an endorsement: review a server's code and permissions before giving it access to your data.