English Français العربية

Web2MD

السجل الرسمي البحث والويب

Turn any web page into clean Markdown, text or token-bounded RAG chunks (via RapidAPI).

الشيفرة المصدرية الموقع التوثيق

ماذا يمكنك أن تفعل مع Web2MD؟

  • read_url: fetch a web page and return its main content as Markdown or plain text, without nav, ads or boilerplate.
  • chunk_url: fetch a web page and split it into heading-aware chunks sized in tokens, for RAG and embeddings.
  • convert_html: convert raw HTML you already have into Markdown or plain text.
  • page_metadata: get a page's title, author, published date, description and similar fields without the full content.

التثبيت

أضف هذا إلى إعدادات MCP في عميلك (Claude Desktop: claude_desktop_config.json، وCursor: ‏.cursor/mcp.json، ويستخدم VS Code وغيره الصيغة نفسها «mcpServers»).

NPM package web2md-rag-mcp
Claude Code 
claude mcp add web2md -e 'RAPIDAPI_KEY=<your rapidapi_key>' -- npx -y web2md-rag-mcp@0.1.0
إعداد JSON (Claude Desktop وCursor وVS Code) 
{
    "mcpServers": {
        "web2md": {
            "command": "npx",
            "args": [
                "-y",
                "web2md-rag-mcp@0.1.0"
            ],
            "env": {
                "RAPIDAPI_KEY": "<your rapidapi_key>"
            }
        }
    }
}

متغيرات البيئة

  • RAPIDAPI_KEY إلزامي سري Your RapidAPI key, subscribed to Web2MD (free BASIC plan available).

التوثيق

مأخوذ من ملف README للمشروع على GitHub ويُحدَّث أسبوعيًا. تفتح الروابط على GitHub.

المحتويات
  1. Web2MD MCP server
  2. What it does
  3. Setup in 3 steps
  4. Tools
  5. Limits and plans
  6. Errors
  7. Privacy
  8. Development
  9. Licence

Web2MD MCP server

An MCP server that turns any web page into clean Markdown, plain text or token-bounded RAG chunks, using the Web2MD API on RapidAPI.

What it does

  • read_url: fetch a web page and return its main content as Markdown or plain text, without nav, ads or boilerplate.
  • chunk_url: fetch a web page and split it into heading-aware chunks sized in tokens, for RAG and embeddings.
  • convert_html: convert raw HTML you already have into Markdown or plain text.
  • page_metadata: get a page's title, author, published date, description and similar fields without the full content.

Setup in 3 steps

  1. Subscribe to Web2MD on RapidAPI. The BASIC plan is free and includes 500 requests per month.
  2. Copy your X-RapidAPI-Key from the Endpoints tab of the listing.
  3. Add the server to your client.

Requires Node.js 22 or newer.

Claude Code:

claude mcp add web2md -e RAPIDAPI_KEY=your-key -- npx -y web2md-rag-mcp

Claude Desktop (claude_desktop_config.json) and Cursor (~/.cursor/mcp.json) use the same JSON:

{
  "mcpServers": {
    "web2md": {
      "command": "npx",
      "args": ["-y", "web2md-rag-mcp"],
      "env": { "RAPIDAPI_KEY": "your-key" }
    }
  }
}

Windsurf: put the same block in ~/.codeium/windsurf/mcp_config.json.

Tools

ToolWhat it doesArgumentsReturns
read_urlFetch a page as clean Markdown or texturl (up to 2048 chars); format: markdown, text or json; include_links, include_images, include_tablesTitle, token count and the content; format: "json" returns the full JSON document
chunk_urlSplit a page into RAG chunksurl; max_tokens 64-8192 (default 512); overlap_tokens 0-1024 (default 50); include_links, include_images, include_tablesJSON with total_tokens and chunks, each with its heading path and token count
convert_htmlConvert raw HTMLhtml (up to 5,000,000 chars); optional url to resolve relative links; format; include_links, include_images, include_tablesSame as read_url
page_metadataGet page metadataurlJSON with title, author, date, description, site name, language, canonical URL, image, word count, reading time

Limits and plans

PlanPriceRequests per month
BASIC$0500
PRO$910,000
ULTRA$2960,000
MEGA$79250,000
  • RapidAPI rate limit: 1,000 requests per hour.
  • Pages up to 5 MB.
  • robots.txt is respected.
  • JavaScript-heavy pages may return no_content. Rendering support is planned.

Errors

Tool errors look like Web2MD error [code]: message. Input-validation failures (a bad URL, out-of-range numbers) come from the MCP SDK as MCP error -32602: Input validation error ... instead.

CodeMeaning
missing_keyRAPIDAPI_KEY is not set
invalid_keyRAPIDAPI_KEY contains characters not allowed in an HTTP header, often a pasted newline
rapidapi_authRapidAPI rejected the key, or you are not subscribed
rapidapi_quotaYour plan's quota or rate limit is used up
invalid_requestThe request failed validation (HTTP 422)
invalid_url400: not http/https, has credentials, no host, bad port, or longer than 2048 chars
blocked_destination400: host resolves to a private, loopback, link-local or metadata address; port not 80/443; localhost/.local/.internal. Applies to every redirect
dns_error400: the host does not resolve
robots_disallowed403: the site's robots.txt disallows the web2md user agent for that path
page_too_large413: page larger than 5 MB
unsupported_content_type415: not HTML
no_content422: fewer than 10 words of main content, often a JavaScript-only page
host_rate_limited429: per-target-site limit that protects the sites fetched. It is not your quota
target_blocked502: the site answered 401/403/429/503, often a bot wall
target_error502: the site answered another 4xx/5xx
fetch_failed502: could not connect, or TLS failed
too_many_redirects502: more than 5 redirects
fetch_timeout504: the fetch took more than 15 s
timeoutThe Web2MD request timed out
network_errorThe request could not reach the API
bad_responseThe API returned a non-JSON success response
http_<status>Any other HTTP failure, with a short snippet of the response
internal_errorAn unexpected error inside the MCP server

Privacy

Your key is sent only to the RapidAPI gateway (web2md-webpage-to-markdown-rag-chunks.p.rapidapi.com) and is never logged.

Development

npm ci
npm test
npm run lint
npm run build
RAPIDAPI_KEY=your-key npm run smoke

Licence

MIT

الأسئلة الشائعة

ما هو Web2MD؟

Turn any web page into clean Markdown, text or token-bounded RAG chunks (via RapidAPI).

كيف أثبّت Web2MD؟

يعمل على جهازك. في Claude Code: claude mcp add web2md -e 'RAPIDAPI_KEY=<your rapidapi_key>' -- npx -y web2md-rag-mcp@0.1.0. وفي العملاء الآخرين، الصق إعداد JSON من هذه الصفحة في إعدادات MCP الخاصة بهم.

هل يحتاج Web2MD إلى مفتاح API؟

نعم. يتطلب RAPIDAPI_KEY، وتضبطها في إعداداته.

هل Web2MD مفتوح المصدر؟

نعم. شيفرته متاحة على GitHub بترخيص MIT.

من يصون Web2MD؟

ينشره kanavsingla28. يدرجه AI.tn لكنه لا يصونه ولا يوصي به.

من سجل MCP الرسمي. الإدراج ليس توصية: راجع شيفرة الخادم وصلاحياته قبل منحه الوصول إلى بياناتك.