Online Web Directory

Official registry AI and agents

How websites treat AI agents: bot walls, JS needs, robots rules, llms.txt. Look up before you fetch.

Install

Add this to your client's MCP configuration (Claude Desktop: claude_desktop_config.json; Cursor: .cursor/mcp.json; VS Code and others use the same "mcpServers" shape).

Remote (streamable-http)
Claude Code
claude mcp add --transport http online-web-directory 'https://onlinewebdirectory.net/mcp'
JSON configuration (Claude Desktop, Cursor, VS Code)
{
    "mcpServers": {
        "online-web-directory": {
            "type": "http",
            "url": "https://onlinewebdirectory.net/mcp"
        }
    }
}

Frequently asked questions

What is Online Web Directory?

How websites treat AI agents: bot walls, JS needs, robots rules, llms.txt. Look up before you fetch.

How do I install Online Web Directory?

It runs as a remote server. In Claude Code: claude mcp add --transport http online-web-directory 'https://onlinewebdirectory.net/mcp'. For other clients, paste the JSON configuration from this page into their MCP settings.

Does Online Web Directory need an API key?

Its registry entry lists no required key or secret. Some features may still need an account with the service it connects to.

Who maintains Online Web Directory?

It is published by net.onlinewebdirectory. AI.tn lists it but does not maintain or endorse it.

From the official MCP Registry. Listing is not an endorsement: review a server's code and permissions before giving it access to your data.