CrawlKit Scrapers
Scrape Booking, Airbnb, Amazon, Zillow, Indeed, Yelp, Reddit, Google Shopping/Jobs via Apify MCP
Installation
Ajoutez ceci à la configuration MCP de votre client (Claude Desktop : claude_desktop_config.json ; Cursor : .cursor/mcp.json ; VS Code et les autres utilisent la même forme « mcpServers »).
claude mcp add --transport http crawlkit-scrapers 'https://mcp.apify.com/?actors=sweet_stickball/booking-scraper,sweet_stickball/airbnb-scraper,sweet_stickball/amazon-reviews-scraper,sweet_stickball/aliexpress-scraper,sweet_stickball/google-shopping-scraper,sweet_stickball/zillow-scraper,sweet_stickball/reddit-scraper,sweet_stickball/google-jobs-scraper,sweet_stickball/indeed-job-scraper,sweet_stickball/yelp-scraper,sweet_stickball/google-news-scraper,sweet_stickball/google-flights-scraper,sweet_stickball/shopify-store-scraper,sweet_stickball/telegram-public-channel-scraper,sweet_stickball/bing-ddg-serp' --header 'Authorization: <Bearer <your Apify API token> (or sign in with OAuth)>'
{
"mcpServers": {
"crawlkit-scrapers": {
"type": "http",
"url": "https://mcp.apify.com/?actors=sweet_stickball/booking-scraper,sweet_stickball/airbnb-scraper,sweet_stickball/amazon-reviews-scraper,sweet_stickball/aliexpress-scraper,sweet_stickball/google-shopping-scraper,sweet_stickball/zillow-scraper,sweet_stickball/reddit-scraper,sweet_stickball/google-jobs-scraper,sweet_stickball/indeed-job-scraper,sweet_stickball/yelp-scraper,sweet_stickball/google-news-scraper,sweet_stickball/google-flights-scraper,sweet_stickball/shopify-store-scraper,sweet_stickball/telegram-public-channel-scraper,sweet_stickball/bing-ddg-serp",
"headers": {
"Authorization": "<Bearer <your Apify API token> (or sign in with OAuth)>"
}
}
}
}
Documentation
Tirée du README du projet sur GitHub, actualisée chaque semaine. Les liens ouvrent GitHub.
CrawlKit Scrapers
24 production scrapers for e-commerce, travel, real estate, jobs, social media, finance and more. All Actors run on Apify — no infrastructure to manage, pay per result.
Quick Start
pip install httpx
export APIFY_TOKEN="your_api_token_here"
python examples/booking.py
Get your API token at console.apify.com/account#/integrations.
Actors
E-commerce
| Actor | Price/result | Description |
|---|---|---|
| AliExpress Scraper | $0.0063 | Product search: title, price, discount, rating, store |
| Amazon Reviews Scraper | $0.0042 | Product reviews: rating, text, date, verified — 9 marketplaces |
| Google Shopping Scraper | $0.0024 | Shopping results: prices, sellers, ratings — 12 countries |
| Shopify Scraper | $0.0007 | Store products: prices, variants, stock, images, tags |
| Walmart Scraper | $0.0031 | Product search/pages: price, rating, seller, availability |
Travel
| Actor | Price/result | Description |
|---|---|---|
| Airbnb Scraper | $0.0028 | Search results: listing, price, rating, reviews, room type |
| Booking.com Scraper | $0.0035 | Hotel search: name, price, rating, stars, district, coordinates |
| Google Flights Scraper | $0.00017 | Flight fares: price, airline, times, duration, stops |
Real Estate
| Actor | Price/result | Description |
|---|---|---|
| Realtor.com Scraper | $0.0007 | Property listings: price, beds, baths, sqft, coordinates |
| Zillow Scraper | $0.0016 | Listings: price, Zestimate, beds, baths, sqft |
Jobs
| Actor | Price/result | Description |
|---|---|---|
| Google Jobs Scraper | $0.0063 | Job listings: title, company, location, salary, apply links |
| Indeed Jobs Scraper | $0.0005 | Job listings: title, company, salary — 6 countries |
| Glassdoor Scraper | $0.0023 | Company reviews + salary ranges by title |
Social Media
| Actor | Price/result | Description |
|---|---|---|
| Reddit Scraper | $0.0028 | Subreddit posts/comments: title, text, author, date |
| Telegram Channel Scraper | $0.0035 | Public channel messages: text, dates, views, media |
| YouTube Transcript Scraper | $0.0035 | Video transcripts with timestamps + metadata + comments |
Reviews
| Actor | Price/result | Description |
|---|---|---|
| App Store Reviews Scraper | $0.00007 | iOS + Google Play reviews: text, rating, date, app version |
| Trustpilot Reviews Scraper | $0.00048 | Reviews + company TrustScore, review count |
| Yelp Scraper | $0.0035 | Business reviews: name, address, rating, review text |
Finance
| Actor | Price/result | Description |
|---|---|---|
| SEC EDGAR & Yahoo Finance | $0.00035 | SEC filings (10-K, 10-Q, 8-K) + stock quotes + financials |
Search & Tech
| Actor | Price/result | Description |
|---|---|---|
| Bing & DuckDuckGo SERP | $0.0031 | Search results: titles, URLs, snippets, positions |
| Google News Scraper | $0.0028 | News articles: headlines, sources, dates, URLs |
| Google Trends Scraper | $0.0021 | Interest over time + related queries, up to 5 keywords |
| Tech Stack Detector | $0.0016 | Website tech stack: CMS, frameworks, analytics, CDN, hosting |
MCP Integration
All CrawlKit Actors are available through the Apify MCP server, making them callable by AI agents (Claude, Cursor, etc.) with zero code.
Endpoint: https://mcp.apify.com
See tutorials/mcp_integration.md for setup instructions.
Examples
| File | What it does |
|---|---|
| booking.py | Scrape hotels in Paris from Booking.com |
| amazon_reviews.py | Fetch product reviews from Amazon |
| youtube.py | Extract a video transcript from YouTube |
| google_trends.py | Get interest-over-time data for keywords |
| zillow.py | Scrape real estate listings from Zillow |
All examples use httpx + the Apify REST API. No SDK required.
Tutorials
- Getting Started — API token, first run, reading results
- MCP Integration — Connect CrawlKit to Claude, Cursor and other AI agents
- Pricing — Pay-per-result model, tiers, volume discounts
License
MIT
Questions fréquentes
Qu'est-ce que CrawlKit Scrapers ?
Scrape Booking, Airbnb, Amazon, Zillow, Indeed, Yelp, Reddit, Google Shopping/Jobs via Apify MCP
Comment installer CrawlKit Scrapers ?
Il fonctionne comme serveur distant. Dans Claude Code : claude mcp add --transport http crawlkit-scrapers 'https://mcp.apify.com/?actors=sweet_stickball/booking-scraper,sweet_stickball/airbnb-scraper,sweet_stickball/amazon-reviews-scraper,sweet_stickball/aliexpress-scraper,sweet_stickball/google-shopping-scraper,sweet_stickball/zillow-scraper,sweet_stickball/reddit-scraper,sweet_stickball/google-jobs-scraper,sweet_stickball/indeed-job-scraper,sweet_stickball/yelp-scraper,sweet_stickball/google-news-scraper,sweet_stickball/google-flights-scraper,sweet_stickball/shopify-store-scraper,sweet_stickball/telegram-public-channel-scraper,sweet_stickball/bing-ddg-serp' --header 'Authorization: <Bearer <your Apify API token> (or sign in with OAuth)>'. Pour les autres clients, collez la configuration JSON de cette page dans leurs réglages MCP.
Faut-il une clé API pour CrawlKit Scrapers ?
Oui. Il attend Authorization, à renseigner dans sa configuration.
CrawlKit Scrapers est-il open source ?
Oui. Son code est sur GitHub sous licence MIT.
Qui maintient CrawlKit Scrapers ?
Il est publié par CrawlKit560. AI.tn le référence sans le maintenir ni le recommander.
Issu du registre MCP officiel. Être listé n'est pas une recommandation : vérifiez le code et les permissions d'un serveur avant de lui donner accès à vos données.