English Français العربية

AI Crawler Access Checker

Official registry Search and web

Shows if GPTBot, ClaudeBot, PerplexityBot and other AI crawlers can read each site in a list.

Website

Install

Add this to your client's MCP configuration (Claude Desktop: claude_desktop_config.json; Cursor: .cursor/mcp.json; VS Code and others use the same "mcpServers" shape).

Remote (streamable-http)
Claude Code 
claude mcp add --transport http ai-crawler-access-checker 'https://mcp.apify.com/?tools=nerolabs/ai-crawler-access-checker' --header 'Authorization: <Your Apify API token, sent as '\''Bearer <token>'\''. Runs are billed per event to your Apify account.>'
JSON configuration (Claude Desktop, Cursor, VS Code) 
{
    "mcpServers": {
        "ai-crawler-access-checker": {
            "type": "http",
            "url": "https://mcp.apify.com/?tools=nerolabs/ai-crawler-access-checker",
            "headers": {
                "Authorization": "<Your Apify API token, sent as 'Bearer <token>'. Runs are billed per event to your Apify account.>"
            }
        }
    }
}

Frequently asked questions

What is AI Crawler Access Checker?

Shows if GPTBot, ClaudeBot, PerplexityBot and other AI crawlers can read each site in a list.

How do I install AI Crawler Access Checker?

It runs as a remote server. In Claude Code: claude mcp add --transport http ai-crawler-access-checker 'https://mcp.apify.com/?tools=nerolabs/ai-crawler-access-checker' --header 'Authorization: <Your Apify API token, sent as '\''Bearer <token>'\''. Runs are billed per event to your Apify account.>'. For other clients, paste the JSON configuration from this page into their MCP settings.

Does AI Crawler Access Checker need an API key?

Yes. It expects Authorization, which you set in its configuration.

Who maintains AI Crawler Access Checker?

It is published by Nero-Engine. AI.tn lists it but does not maintain or endorse it.

From the official MCP Registry. Listing is not an endorsement: review a server's code and permissions before giving it access to your data.