English Français العربية

Scrapingbee

السجل الرسمي البحث والويب

ScrapingBee MCP — wraps the ScrapingBee headless-scraping API (scrapingbee.com)

الشيفرة المصدرية الموقع التوثيق

التثبيت

أضف هذا إلى إعدادات MCP في عميلك (Claude Desktop: claude_desktop_config.json، وCursor: ‏.cursor/mcp.json، ويستخدم VS Code وغيره الصيغة نفسها «mcpServers»).

Remote (streamable-http)
Claude Code 
claude mcp add --transport http scrapingbee 'https://gateway.pipeworx.io/scrapingbee/mcp'
إعداد JSON (Claude Desktop وCursor وVS Code) 
{
    "mcpServers": {
        "scrapingbee": {
            "type": "http",
            "url": "https://gateway.pipeworx.io/scrapingbee/mcp"
        }
    }
}

التوثيق

مأخوذ من ملف README للمشروع على GitHub ويُحدَّث أسبوعيًا. تفتح الروابط على GitHub.

المحتويات
  1. mcp-scrapingbee
  2. Tools
  3. Quick Start
  4. No MCP client? Call it over HTTP
  5. Standalone (no gateway account)
  6. Using with ask_pipeworx
  7. More
  8. License

mcp-scrapingbee

ScrapingBee MCP — wraps the ScrapingBee headless-scraping API (scrapingbee.com)

Part of Pipeworx — an MCP gateway connecting AI agents to 1683+ live data sources.

Tools

ToolDescription
scrapingbee_scrapeFetch and render any web page through ScrapingBee (headless browser + proxy rotation), returning the resulting HTML. Handles JS-heavy sites, geolocation, and ad-blocking. Example: scrapingbee_scrape({ url: "https://example.com";, render_js: true, _apiKey: "your-key" })
scrapingbee_ai_extractExtract structured data from a web page using ScrapingBee's AI. Pass a natural-language question or field description via ai_query and get back structured JSON. Example: scrapingbee_ai_extract({ url: "https://example.com/product";, ai_query: "product name and price", _apiKey: "your-key" })
scrapingbee_googleScrape Google Search results via ScrapingBee's Google SERP API. Returns structured JSON with organic results, AI overviews, local results, related searches, and more. Example: scrapingbee_google({ search: "best coffee grinder", country_code: "us", _apiKey: "your-key" })

Quick Start

Add to your MCP client (Claude Desktop, Cursor, Windsurf, etc.):

{
  "mcpServers": {
    "scrapingbee": {
      "url": "https://gateway.pipeworx.io/scrapingbee/mcp"
    }
  }
}
What this endpoint actually serves

tools/list at https://gateway.pipeworx.io/scrapingbee/mcp returns the tools in the table above plus the shared Pipeworx meta-tools — ask_pipeworx, discover_tools, search_within, remember/recall and the rest of the gateway-wide set. So the tool count you see is larger than this table: a single-pack endpoint currently lists roughly 30 shared tools alongside the pack's own. The connection's initialize response states its exact scope, and is the authoritative answer for a given day.

This is deliberate, not multiplexing by accident. The meta-tools are what let a scoped connection answer a question this pack does not cover — via ask_pipeworx, which routes across the whole catalog — without you adding a second MCP server. There is currently no way to mount a pack endpoint without them; if the extra schemas cost you more context than the routing is worth, connect to the full gateway once rather than to several pack endpoints.

Or connect to the full Pipeworx gateway to get every pack's tools listed directly, instead of just this one's:

{
  "mcpServers": {
    "pipeworx": {
      "url": "https://gateway.pipeworx.io/mcp"
    }
  }
}

Both URLs reach the same gateway and the same 1683+ data sources. The only difference is which pack's tools are listed directly; ask_pipeworx reaches all of them from either one.

No MCP client? Call it over HTTP

This pack takes your own API key (_apiKey) — we don't front one for it, so there's no curl here that would run without it. Inspect any tool: GET https://gateway.pipeworx.io/v1/tools/scrapingbee_scrape. Find one: POST https://gateway.pipeworx.io/v1/tools/search_packs with {"query":"..."}.

Standalone (no gateway account)

This package also runs as a local stdio MCP server — no Pipeworx account, no gateway round-trip:

{
  "mcpServers": {
    "scrapingbee": {
      "command": "npx",
      "args": ["-y", "@pipeworx/mcp-scrapingbee"]
    }
  }
}

Or run it directly to confirm it starts:

npx -y @pipeworx/mcp-scrapingbee

It speaks MCP over stdin/stdout and answers initialize/tools/list/tools/call for only this pack's tools — none of the shared meta-tools the gateway connection above adds. Same source, same tools, no ask_pipeworx routing.

Using with ask_pipeworx

Instead of calling tools directly, you can ask questions in plain English — this works on the pack endpoint above as well as on the full gateway:

ask_pipeworx({ question: "your question about Scrapingbee data" })

The gateway picks the right tool and fills the arguments automatically.

More

License

MIT

الأسئلة الشائعة

ما هو Scrapingbee؟

ScrapingBee MCP — wraps the ScrapingBee headless-scraping API (scrapingbee.com)

كيف أثبّت Scrapingbee؟

يعمل كخادم بعيد. في Claude Code: claude mcp add --transport http scrapingbee 'https://gateway.pipeworx.io/scrapingbee/mcp'. وفي العملاء الآخرين، الصق إعداد JSON من هذه الصفحة في إعدادات MCP الخاصة بهم.

هل يحتاج Scrapingbee إلى مفتاح API؟

لا يذكر إدراجه في السجل أي مفتاح أو سر إلزامي. قد تتطلب بعض الميزات حسابًا لدى الخدمة التي يتصل بها.

هل Scrapingbee مفتوح المصدر؟

نعم. شيفرته متاحة على GitHub بترخيص MIT.

من يصون Scrapingbee؟

ينشره pipeworx-io. يدرجه AI.tn لكنه لا يصونه ولا يوصي به.

من سجل MCP الرسمي. الإدراج ليس توصية: راجع شيفرة الخادم وصلاحياته قبل منحه الوصول إلى بياناتك.