English Français العربية

CrawlKit Scrapers

السجل الرسمي البحث والويب

Scrape Booking, Airbnb, Amazon, Zillow, Indeed, Yelp, Reddit, Google Shopping/Jobs via Apify MCP

الشيفرة المصدرية الموقع التوثيق

التثبيت

أضف هذا إلى إعدادات MCP في عميلك (Claude Desktop: claude_desktop_config.json، وCursor: ‏.cursor/mcp.json، ويستخدم VS Code وغيره الصيغة نفسها «mcpServers»).

Remote (streamable-http)
Claude Code 
claude mcp add --transport http crawlkit-scrapers 'https://mcp.apify.com/?actors=sweet_stickball/booking-scraper,sweet_stickball/airbnb-scraper,sweet_stickball/amazon-reviews-scraper,sweet_stickball/aliexpress-scraper,sweet_stickball/google-shopping-scraper,sweet_stickball/zillow-scraper,sweet_stickball/reddit-scraper,sweet_stickball/google-jobs-scraper,sweet_stickball/indeed-job-scraper,sweet_stickball/yelp-scraper,sweet_stickball/google-news-scraper,sweet_stickball/google-flights-scraper,sweet_stickball/shopify-store-scraper,sweet_stickball/telegram-public-channel-scraper,sweet_stickball/bing-ddg-serp' --header 'Authorization: <Bearer <your Apify API token> (or sign in with OAuth)>'
إعداد JSON (Claude Desktop وCursor وVS Code) 
{
    "mcpServers": {
        "crawlkit-scrapers": {
            "type": "http",
            "url": "https://mcp.apify.com/?actors=sweet_stickball/booking-scraper,sweet_stickball/airbnb-scraper,sweet_stickball/amazon-reviews-scraper,sweet_stickball/aliexpress-scraper,sweet_stickball/google-shopping-scraper,sweet_stickball/zillow-scraper,sweet_stickball/reddit-scraper,sweet_stickball/google-jobs-scraper,sweet_stickball/indeed-job-scraper,sweet_stickball/yelp-scraper,sweet_stickball/google-news-scraper,sweet_stickball/google-flights-scraper,sweet_stickball/shopify-store-scraper,sweet_stickball/telegram-public-channel-scraper,sweet_stickball/bing-ddg-serp",
            "headers": {
                "Authorization": "<Bearer <your Apify API token> (or sign in with OAuth)>"
            }
        }
    }
}

التوثيق

مأخوذ من ملف README للمشروع على GitHub ويُحدَّث أسبوعيًا. تفتح الروابط على GitHub.

المحتويات
  1. CrawlKit Scrapers
  2. Quick Start
  3. Actors
  4. MCP Integration
  5. Examples
  6. Tutorials
  7. License

CrawlKit Scrapers

24 production scrapers for e-commerce, travel, real estate, jobs, social media, finance and more. All Actors run on Apify — no infrastructure to manage, pay per result.

Quick Start

pip install httpx
export APIFY_TOKEN="your_api_token_here"
python examples/booking.py

Get your API token at console.apify.com/account#/integrations.

Actors

E-commerce
ActorPrice/resultDescription
AliExpress Scraper$0.0063Product search: title, price, discount, rating, store
Amazon Reviews Scraper$0.0042Product reviews: rating, text, date, verified — 9 marketplaces
Google Shopping Scraper$0.0024Shopping results: prices, sellers, ratings — 12 countries
Shopify Scraper$0.0007Store products: prices, variants, stock, images, tags
Walmart Scraper$0.0031Product search/pages: price, rating, seller, availability
Travel
ActorPrice/resultDescription
Airbnb Scraper$0.0028Search results: listing, price, rating, reviews, room type
Booking.com Scraper$0.0035Hotel search: name, price, rating, stars, district, coordinates
Google Flights Scraper$0.00017Flight fares: price, airline, times, duration, stops
Real Estate
ActorPrice/resultDescription
Realtor.com Scraper$0.0007Property listings: price, beds, baths, sqft, coordinates
Zillow Scraper$0.0016Listings: price, Zestimate, beds, baths, sqft
Jobs
ActorPrice/resultDescription
Google Jobs Scraper$0.0063Job listings: title, company, location, salary, apply links
Indeed Jobs Scraper$0.0005Job listings: title, company, salary — 6 countries
Glassdoor Scraper$0.0023Company reviews + salary ranges by title
Social Media
ActorPrice/resultDescription
Reddit Scraper$0.0028Subreddit posts/comments: title, text, author, date
Telegram Channel Scraper$0.0035Public channel messages: text, dates, views, media
YouTube Transcript Scraper$0.0035Video transcripts with timestamps + metadata + comments
Reviews
ActorPrice/resultDescription
App Store Reviews Scraper$0.00007iOS + Google Play reviews: text, rating, date, app version
Trustpilot Reviews Scraper$0.00048Reviews + company TrustScore, review count
Yelp Scraper$0.0035Business reviews: name, address, rating, review text
Finance
ActorPrice/resultDescription
SEC EDGAR & Yahoo Finance$0.00035SEC filings (10-K, 10-Q, 8-K) + stock quotes + financials
Search & Tech
ActorPrice/resultDescription
Bing & DuckDuckGo SERP$0.0031Search results: titles, URLs, snippets, positions
Google News Scraper$0.0028News articles: headlines, sources, dates, URLs
Google Trends Scraper$0.0021Interest over time + related queries, up to 5 keywords
Tech Stack Detector$0.0016Website tech stack: CMS, frameworks, analytics, CDN, hosting

MCP Integration

All CrawlKit Actors are available through the Apify MCP server, making them callable by AI agents (Claude, Cursor, etc.) with zero code.

Endpoint: https://mcp.apify.com

See tutorials/mcp_integration.md for setup instructions.

Examples

FileWhat it does
booking.pyScrape hotels in Paris from Booking.com
amazon_reviews.pyFetch product reviews from Amazon
youtube.pyExtract a video transcript from YouTube
google_trends.pyGet interest-over-time data for keywords
zillow.pyScrape real estate listings from Zillow

All examples use httpx + the Apify REST API. No SDK required.

Tutorials

  • Getting Started — API token, first run, reading results
  • MCP Integration — Connect CrawlKit to Claude, Cursor and other AI agents
  • Pricing — Pay-per-result model, tiers, volume discounts

License

MIT

الأسئلة الشائعة

ما هو CrawlKit Scrapers؟

Scrape Booking, Airbnb, Amazon, Zillow, Indeed, Yelp, Reddit, Google Shopping/Jobs via Apify MCP

كيف أثبّت CrawlKit Scrapers؟

يعمل كخادم بعيد. في Claude Code: claude mcp add --transport http crawlkit-scrapers 'https://mcp.apify.com/?actors=sweet_stickball/booking-scraper,sweet_stickball/airbnb-scraper,sweet_stickball/amazon-reviews-scraper,sweet_stickball/aliexpress-scraper,sweet_stickball/google-shopping-scraper,sweet_stickball/zillow-scraper,sweet_stickball/reddit-scraper,sweet_stickball/google-jobs-scraper,sweet_stickball/indeed-job-scraper,sweet_stickball/yelp-scraper,sweet_stickball/google-news-scraper,sweet_stickball/google-flights-scraper,sweet_stickball/shopify-store-scraper,sweet_stickball/telegram-public-channel-scraper,sweet_stickball/bing-ddg-serp' --header 'Authorization: <Bearer <your Apify API token> (or sign in with OAuth)>'. وفي العملاء الآخرين، الصق إعداد JSON من هذه الصفحة في إعدادات MCP الخاصة بهم.

هل يحتاج CrawlKit Scrapers إلى مفتاح API؟

نعم. يتطلب Authorization، وتضبطها في إعداداته.

هل CrawlKit Scrapers مفتوح المصدر؟

نعم. شيفرته متاحة على GitHub بترخيص MIT.

من يصون CrawlKit Scrapers؟

ينشره CrawlKit560. يدرجه AI.tn لكنه لا يصونه ولا يوصي به.

من سجل MCP الرسمي. الإدراج ليس توصية: راجع شيفرة الخادم وصلاحياته قبل منحه الوصول إلى بياناتك.