Crawl4Agent
crawl4ai-compatible web crawler API: POST a URL, get clean LLM-ready Markdown with fit_markdown...
Install
Add this to your client's MCP configuration (Claude Desktop: claude_desktop_config.json; Cursor: .cursor/mcp.json; VS Code and others use the same "mcpServers" shape).
claude mcp add --transport http crawl4agent 'https://crawl4agent.saastemly.com/mcp' --header 'Authorization: <Bearer <API key>: prepaid credits from https://crawl4agent.saastemly.com (tools with a free tier work without one)>'
{
"mcpServers": {
"crawl4agent": {
"type": "http",
"url": "https://crawl4agent.saastemly.com/mcp",
"headers": {
"Authorization": "<Bearer <API key>: prepaid credits from https://crawl4agent.saastemly.com (tools with a free tier work without one)>"
}
}
}
}
Frequently asked questions
What is Crawl4Agent?
crawl4ai-compatible web crawler API: POST a URL, get clean LLM-ready Markdown with fit_markdown...
How do I install Crawl4Agent?
It runs as a remote server. In Claude Code: claude mcp add --transport http crawl4agent 'https://crawl4agent.saastemly.com/mcp' --header 'Authorization: <Bearer <API key>: prepaid credits from https://crawl4agent.saastemly.com (tools with a free tier work without one)>'. For other clients, paste the JSON configuration from this page into their MCP settings.
Does Crawl4Agent need an API key?
Yes. It expects Authorization, which you set in its configuration.
Who maintains Crawl4Agent?
It is published by com.saastemly. AI.tn lists it but does not maintain or endorse it.
From the official MCP Registry. Listing is not an endorsement: review a server's code and permissions before giving it access to your data.