CrawlKit Scrapers

Registre officiel Recherche et web

Scrape Booking, Airbnb, Amazon, Zillow, Indeed, Yelp, Reddit, Google Shopping/Jobs via Apify MCP

Installation

Ajoutez ceci à la configuration MCP de votre client (Claude Desktop : claude_desktop_config.json ; Cursor : .cursor/mcp.json ; VS Code et les autres utilisent la même forme « mcpServers »).

Remote (streamable-http)
Claude Code
claude mcp add --transport http crawlkit-scrapers 'https://mcp.apify.com/?actors=sweet_stickball/booking-scraper,sweet_stickball/airbnb-scraper,sweet_stickball/amazon-reviews-scraper,sweet_stickball/aliexpress-scraper,sweet_stickball/google-shopping-scraper,sweet_stickball/zillow-scraper,sweet_stickball/reddit-scraper,sweet_stickball/google-jobs-scraper,sweet_stickball/indeed-job-scraper,sweet_stickball/yelp-scraper,sweet_stickball/google-news-scraper,sweet_stickball/google-flights-scraper,sweet_stickball/shopify-store-scraper,sweet_stickball/telegram-public-channel-scraper,sweet_stickball/bing-ddg-serp' --header 'Authorization: <Bearer <your Apify API token> (or sign in with OAuth)>'
Configuration JSON (Claude Desktop, Cursor, VS Code)
{
    "mcpServers": {
        "crawlkit-scrapers": {
            "type": "http",
            "url": "https://mcp.apify.com/?actors=sweet_stickball/booking-scraper,sweet_stickball/airbnb-scraper,sweet_stickball/amazon-reviews-scraper,sweet_stickball/aliexpress-scraper,sweet_stickball/google-shopping-scraper,sweet_stickball/zillow-scraper,sweet_stickball/reddit-scraper,sweet_stickball/google-jobs-scraper,sweet_stickball/indeed-job-scraper,sweet_stickball/yelp-scraper,sweet_stickball/google-news-scraper,sweet_stickball/google-flights-scraper,sweet_stickball/shopify-store-scraper,sweet_stickball/telegram-public-channel-scraper,sweet_stickball/bing-ddg-serp",
            "headers": {
                "Authorization": "<Bearer <your Apify API token> (or sign in with OAuth)>"
            }
        }
    }
}

Documentation

Tirée du README du projet sur GitHub, actualisée chaque semaine. Les liens ouvrent GitHub.

Sommaire
  1. CrawlKit Scrapers
  2. Quick Start
  3. Actors
  4. MCP Integration
  5. Examples
  6. Tutorials
  7. License

CrawlKit Scrapers

24 production scrapers for e-commerce, travel, real estate, jobs, social media, finance and more. All Actors run on Apify — no infrastructure to manage, pay per result.

Quick Start

pip install httpx
export APIFY_TOKEN="your_api_token_here"
python examples/booking.py

Get your API token at console.apify.com/account#/integrations.

Actors

E-commerce
ActorPrice/resultDescription
AliExpress Scraper$0.0063Product search: title, price, discount, rating, store
Amazon Reviews Scraper$0.0042Product reviews: rating, text, date, verified — 9 marketplaces
Google Shopping Scraper$0.0024Shopping results: prices, sellers, ratings — 12 countries
Shopify Scraper$0.0007Store products: prices, variants, stock, images, tags
Walmart Scraper$0.0031Product search/pages: price, rating, seller, availability
Travel
ActorPrice/resultDescription
Airbnb Scraper$0.0028Search results: listing, price, rating, reviews, room type
Booking.com Scraper$0.0035Hotel search: name, price, rating, stars, district, coordinates
Google Flights Scraper$0.00017Flight fares: price, airline, times, duration, stops
Real Estate
ActorPrice/resultDescription
Realtor.com Scraper$0.0007Property listings: price, beds, baths, sqft, coordinates
Zillow Scraper$0.0016Listings: price, Zestimate, beds, baths, sqft
Jobs
ActorPrice/resultDescription
Google Jobs Scraper$0.0063Job listings: title, company, location, salary, apply links
Indeed Jobs Scraper$0.0005Job listings: title, company, salary — 6 countries
Glassdoor Scraper$0.0023Company reviews + salary ranges by title
Social Media
ActorPrice/resultDescription
Reddit Scraper$0.0028Subreddit posts/comments: title, text, author, date
Telegram Channel Scraper$0.0035Public channel messages: text, dates, views, media
YouTube Transcript Scraper$0.0035Video transcripts with timestamps + metadata + comments
Reviews
ActorPrice/resultDescription
App Store Reviews Scraper$0.00007iOS + Google Play reviews: text, rating, date, app version
Trustpilot Reviews Scraper$0.00048Reviews + company TrustScore, review count
Yelp Scraper$0.0035Business reviews: name, address, rating, review text
Finance
ActorPrice/resultDescription
SEC EDGAR & Yahoo Finance$0.00035SEC filings (10-K, 10-Q, 8-K) + stock quotes + financials
Search & Tech
ActorPrice/resultDescription
Bing & DuckDuckGo SERP$0.0031Search results: titles, URLs, snippets, positions
Google News Scraper$0.0028News articles: headlines, sources, dates, URLs
Google Trends Scraper$0.0021Interest over time + related queries, up to 5 keywords
Tech Stack Detector$0.0016Website tech stack: CMS, frameworks, analytics, CDN, hosting

MCP Integration

All CrawlKit Actors are available through the Apify MCP server, making them callable by AI agents (Claude, Cursor, etc.) with zero code.

Endpoint: https://mcp.apify.com

See tutorials/mcp_integration.md for setup instructions.

Examples

FileWhat it does
booking.pyScrape hotels in Paris from Booking.com
amazon_reviews.pyFetch product reviews from Amazon
youtube.pyExtract a video transcript from YouTube
google_trends.pyGet interest-over-time data for keywords
zillow.pyScrape real estate listings from Zillow

All examples use httpx + the Apify REST API. No SDK required.

Tutorials

  • Getting Started — API token, first run, reading results
  • MCP Integration — Connect CrawlKit to Claude, Cursor and other AI agents
  • Pricing — Pay-per-result model, tiers, volume discounts

License

MIT

Questions fréquentes

Qu'est-ce que CrawlKit Scrapers ?

Scrape Booking, Airbnb, Amazon, Zillow, Indeed, Yelp, Reddit, Google Shopping/Jobs via Apify MCP

Comment installer CrawlKit Scrapers ?

Il fonctionne comme serveur distant. Dans Claude Code : claude mcp add --transport http crawlkit-scrapers 'https://mcp.apify.com/?actors=sweet_stickball/booking-scraper,sweet_stickball/airbnb-scraper,sweet_stickball/amazon-reviews-scraper,sweet_stickball/aliexpress-scraper,sweet_stickball/google-shopping-scraper,sweet_stickball/zillow-scraper,sweet_stickball/reddit-scraper,sweet_stickball/google-jobs-scraper,sweet_stickball/indeed-job-scraper,sweet_stickball/yelp-scraper,sweet_stickball/google-news-scraper,sweet_stickball/google-flights-scraper,sweet_stickball/shopify-store-scraper,sweet_stickball/telegram-public-channel-scraper,sweet_stickball/bing-ddg-serp' --header 'Authorization: <Bearer <your Apify API token> (or sign in with OAuth)>'. Pour les autres clients, collez la configuration JSON de cette page dans leurs réglages MCP.

Faut-il une clé API pour CrawlKit Scrapers ?

Oui. Il attend Authorization, à renseigner dans sa configuration.

CrawlKit Scrapers est-il open source ?

Oui. Son code est sur GitHub sous licence MIT.

Qui maintient CrawlKit Scrapers ?

Il est publié par CrawlKit560. AI.tn le référence sans le maintenir ni le recommander.

Issu du registre MCP officiel. Être listé n'est pas une recommandation : vérifiez le code et les permissions d'un serveur avant de lui donner accès à vos données.