English Français العربية

io.github.shulex-voc/smart-crawler

السجل الرسمي البحث والويب

E-commerce competitor intelligence, VOC sentiment, Amazon ASIN analysis, Reddit growth playbooks.

الشيفرة المصدرية التوثيق

التثبيت

أضف هذا إلى إعدادات MCP في عميلك (Claude Desktop: claude_desktop_config.json، وCursor: ‏.cursor/mcp.json، ويستخدم VS Code وغيره الصيغة نفسها «mcpServers»).

Remote (streamable-http)
Claude Code 
claude mcp add --transport http smart-crawler 'https://smartcrawler.io/mcp/' --header 'Authorization: <API Key in the form '\''Bearer sck_...'\''. Generate a key in the smart-crawler console under '\''API 接入'\''.>'
إعداد JSON (Claude Desktop وCursor وVS Code) 
{
    "mcpServers": {
        "smart-crawler": {
            "type": "http",
            "url": "https://smartcrawler.io/mcp/",
            "headers": {
                "Authorization": "<API Key in the form 'Bearer sck_...'. Generate a key in the smart-crawler console under 'API 接入'.>"
            }
        }
    }
}

التوثيق

مأخوذ من ملف README للمشروع على GitHub ويُحدَّث أسبوعيًا. تفتح الروابط على GitHub.

المحتويات
  1. smart-crawler MCP
  2. Connect
  3. Tools (highlights)
  4. License

smart-crawler MCP

E-commerce competitor intelligence, VOC review sentiment, Amazon ASIN analysis, Google Shopping landscape, on-demand URL scraping, and Reddit subreddit growth playbooks — exposed to AI agents as a hosted Model Context Protocol server.

  • Endpoint: https://smartcrawler.io/mcp/ (streamable-http)
  • Auth: Authorization: Bearer sck_... — generate a key in the smart-crawler console
  • Registry: io.github.shulex-voc/smart-crawler

This repository hosts the public MCP manifest for the smart-crawler service. It is the discovery/connection entry point — the service itself is hosted.

Connect

Claude Code
export SMARTCRAWLER_API_KEY=sck_...
claude mcp add --scope user --transport http smart-crawler \
  https://smartcrawler.io/mcp/ \
  --header "Authorization: Bearer $SMARTCRAWLER_API_KEY"

--scope user makes the server visible in every project. Without it, claude mcp add defaults to local scope (only the current directory), a common "I added it but /mcp is empty" pitfall. Verify with claude mcp list or /mcp.

Codex (~/.codex/config.toml)
[mcp_servers.smart-crawler]
url = "https://smartcrawler.io/mcp/"
bearer_token_env_var = "SMARTCRAWLER_API_KEY"
Any MCP client

Point your client at https://smartcrawler.io/mcp/ over streamable-http and send your API key as a Bearer token. See mcp.json for the full tool list and server.json for the registry manifest.

Tools (highlights)

ToolWhat it does
reddit_subreddit_playbookFull growth playbook for a subreddit's top contributors
search_competitor_productsSearch competitor catalog by brand / country / keyword / price
get_voc_reviewsConsumer VOC reviews from Trustpilot / Reviews.io / Google Maps
amazon_voc_reportAmazon ASIN reviews + AI VOC analysis (pain points, listing tips)
competitor_landscapeGoogle Shopping merchant-share ranking for a keyword
scrape_urlOne-URL scrape with short-lived agent memory
query_warehouseWarehouse-first natural-language query (0 credits)

Full list in mcp.json.

License

MIT

الأسئلة الشائعة

ما هو io.github.shulex-voc/smart-crawler؟

E-commerce competitor intelligence, VOC sentiment, Amazon ASIN analysis, Reddit growth playbooks.

كيف أثبّت io.github.shulex-voc/smart-crawler؟

يعمل كخادم بعيد. في Claude Code: claude mcp add --transport http smart-crawler 'https://smartcrawler.io/mcp/' --header 'Authorization: <API Key in the form '\''Bearer sck_...'\''. Generate a key in the smart-crawler console under '\''API 接入'\''.>'. وفي العملاء الآخرين، الصق إعداد JSON من هذه الصفحة في إعدادات MCP الخاصة بهم.

هل يحتاج io.github.shulex-voc/smart-crawler إلى مفتاح API؟

نعم. يتطلب Authorization، وتضبطها في إعداداته.

هل io.github.shulex-voc/smart-crawler مفتوح المصدر؟

شيفرته علنية على GitHub، لكن المستودع لا يعلن ترخيصًا قياسيًا.

من يصون io.github.shulex-voc/smart-crawler؟

ينشره shulex-voc. يدرجه AI.tn لكنه لا يصونه ولا يوصي به.

من سجل MCP الرسمي. الإدراج ليس توصية: راجع شيفرة الخادم وصلاحياته قبل منحه الوصول إلى بياناتك.