Clearcrawl
Any URL to clean markdown/JSON; PDF, XLSX, CSV, DOCX to text and tables. Free tier for agents.
Install
Add this to your client's MCP configuration (Claude Desktop: claude_desktop_config.json; Cursor: .cursor/mcp.json; VS Code and others use the same "mcpServers" shape).
claude mcp add --transport http clearcrawl 'https://agentreader.onrender.com/clearcrawl/mcp' --header 'Authorization: <Optional: '\''Bearer <Clearcrawl API key>'\'' for paid credits. Omit for the free tier (100 calls/day).>'
{
"mcpServers": {
"clearcrawl": {
"type": "http",
"url": "https://agentreader.onrender.com/clearcrawl/mcp",
"headers": {
"Authorization": "<Optional: 'Bearer <Clearcrawl API key>' for paid credits. Omit for the free tier (100 calls/day).>"
}
}
}
}
Documentation
From the project's README on GitHub, refreshed weekly. Links open on GitHub.
Clearcrawl MCP
An MCP server for Clearcrawl, a pay-per-call API built for AI agents:
read_url: turns any public URL into clean markdown or structured JSON (title, author, date, text, links, tables). Ads, menus and footers are stripped. PDF URLs are converted automatically.convert_file: turns a PDF, XLSX/XLS/CSV or DOCX (by URL or local path) into text and tables (per-page text, sheet rows and records, markdown tables).
Free tier: 100 calls a day with no signup. Paid: 1 credit = $0.001; read_url costs 2 credits and convert_file costs 3 per page. Credit packs start at $5 for 5,000 credits.
Option 1: remote (no install)
Streamable HTTP endpoint: https://agentreader.onrender.com/clearcrawl/mcp
{ "mcpServers": { "clearcrawl": { "url": "https://agentreader.onrender.com/clearcrawl/mcp" } } }
Claude Code: claude mcp add --transport http clearcrawl https://agentreader.onrender.com/clearcrawl/mcp
For paid credits, add the header Authorization: Bearer <your key>.
Option 2: local stdio
{ "mcpServers": { "clearcrawl": { "command": "npx", "args": ["-y", "github:clearcrawl/clearcrawl-mcp"], "env": { "CLEARCRAWL_API_KEY": "" } } } }
The local mode can also convert files from your disk (convert_file with path).
Getting an API key
POST https://agentreader.onrender.com/v1/credits/checkout {"pack":"ar_pack_5"} returns a Stripe Checkout URL. Once you pay, the success page shows your key. Full docs: https://agentreader.onrender.com/llms.txt
Notes
- Clearcrawl runs on a free host, so the first call after it has been idle can take about a minute.
- Limits: public http(s) URLs only, 15 MB max, no JavaScript rendering or OCR yet.
MIT licensed (this client). The Clearcrawl API itself is a hosted service.
More from our studio: VibePicks · LinkPreflight
Pairs well with LinkPreflight, our sister brand: preflight a URL with LinkPreflight, then extract it with Clearcrawl.
Frequently asked questions
What is Clearcrawl?
Any URL to clean markdown/JSON; PDF, XLSX, CSV, DOCX to text and tables. Free tier for agents.
How do I install Clearcrawl?
It runs as a remote server. In Claude Code: claude mcp add --transport http clearcrawl 'https://agentreader.onrender.com/clearcrawl/mcp' --header 'Authorization: <Optional: '\''Bearer <Clearcrawl API key>'\'' for paid credits. Omit for the free tier (100 calls/day).>'. For other clients, paste the JSON configuration from this page into their MCP settings.
Does Clearcrawl need an API key?
Yes. It expects Authorization, which you set in its configuration.
Is Clearcrawl open source?
Yes. Its code is on GitHub under the MIT license.
Who maintains Clearcrawl?
It is published by clearcrawl. AI.tn lists it but does not maintain or endorse it.
From the official MCP Registry. Listing is not an endorsement: review a server's code and permissions before giving it access to your data.