CrawlKit Scrapers
Scrape Booking, Airbnb, Amazon, Zillow, Indeed, Yelp, Reddit, Google Shopping/Jobs via Apify MCP
Install
Add this to your client's MCP configuration (Claude Desktop: claude_desktop_config.json; Cursor: .cursor/mcp.json; VS Code and others use the same "mcpServers" shape).
claude mcp add --transport http crawlkit-scrapers 'https://mcp.apify.com/?actors=sweet_stickball/booking-scraper,sweet_stickball/airbnb-scraper,sweet_stickball/amazon-reviews-scraper,sweet_stickball/aliexpress-scraper,sweet_stickball/google-shopping-scraper,sweet_stickball/zillow-scraper,sweet_stickball/reddit-scraper,sweet_stickball/google-jobs-scraper,sweet_stickball/indeed-job-scraper,sweet_stickball/yelp-scraper,sweet_stickball/google-news-scraper,sweet_stickball/google-flights-scraper,sweet_stickball/shopify-store-scraper,sweet_stickball/telegram-public-channel-scraper,sweet_stickball/bing-ddg-serp' --header 'Authorization: <Bearer <your Apify API token> (or sign in with OAuth)>'{
"mcpServers": {
"crawlkit-scrapers": {
"type": "http",
"url": "https://mcp.apify.com/?actors=sweet_stickball/booking-scraper,sweet_stickball/airbnb-scraper,sweet_stickball/amazon-reviews-scraper,sweet_stickball/aliexpress-scraper,sweet_stickball/google-shopping-scraper,sweet_stickball/zillow-scraper,sweet_stickball/reddit-scraper,sweet_stickball/google-jobs-scraper,sweet_stickball/indeed-job-scraper,sweet_stickball/yelp-scraper,sweet_stickball/google-news-scraper,sweet_stickball/google-flights-scraper,sweet_stickball/shopify-store-scraper,sweet_stickball/telegram-public-channel-scraper,sweet_stickball/bing-ddg-serp",
"headers": {
"Authorization": "<Bearer <your Apify API token> (or sign in with OAuth)>"
}
}
}
}Documentation
From the project's README on GitHub, refreshed weekly. Links open on GitHub.
CrawlKit Scrapers
24 production scrapers for e-commerce, travel, real estate, jobs, social media, finance and more. All Actors run on Apify — no infrastructure to manage, pay per result.
Quick Start
pip install httpx
export APIFY_TOKEN="your_api_token_here"
python examples/booking.pyGet your API token at console.apify.com/account#/integrations.
Actors
E-commerce
| Actor | Price/result | Description |
|---|---|---|
| AliExpress Scraper | $0.0063 | Product search: title, price, discount, rating, store |
| Amazon Reviews Scraper | $0.0042 | Product reviews: rating, text, date, verified — 9 marketplaces |
| Google Shopping Scraper | $0.0024 | Shopping results: prices, sellers, ratings — 12 countries |
| Shopify Scraper | $0.0007 | Store products: prices, variants, stock, images, tags |
| Walmart Scraper | $0.0031 | Product search/pages: price, rating, seller, availability |
Travel
| Actor | Price/result | Description |
|---|---|---|
| Airbnb Scraper | $0.0028 | Search results: listing, price, rating, reviews, room type |
| Booking.com Scraper | $0.0035 | Hotel search: name, price, rating, stars, district, coordinates |
| Google Flights Scraper | $0.00017 | Flight fares: price, airline, times, duration, stops |
Real Estate
| Actor | Price/result | Description |
|---|---|---|
| Realtor.com Scraper | $0.0007 | Property listings: price, beds, baths, sqft, coordinates |
| Zillow Scraper | $0.0016 | Listings: price, Zestimate, beds, baths, sqft |
Jobs
| Actor | Price/result | Description |
|---|---|---|
| Google Jobs Scraper | $0.0063 | Job listings: title, company, location, salary, apply links |
| Indeed Jobs Scraper | $0.0005 | Job listings: title, company, salary — 6 countries |
| Glassdoor Scraper | $0.0023 | Company reviews + salary ranges by title |
Social Media
| Actor | Price/result | Description |
|---|---|---|
| Reddit Scraper | $0.0028 | Subreddit posts/comments: title, text, author, date |
| Telegram Channel Scraper | $0.0035 | Public channel messages: text, dates, views, media |
| YouTube Transcript Scraper | $0.0035 | Video transcripts with timestamps + metadata + comments |
Reviews
| Actor | Price/result | Description |
|---|---|---|
| App Store Reviews Scraper | $0.00007 | iOS + Google Play reviews: text, rating, date, app version |
| Trustpilot Reviews Scraper | $0.00048 | Reviews + company TrustScore, review count |
| Yelp Scraper | $0.0035 | Business reviews: name, address, rating, review text |
Finance
| Actor | Price/result | Description |
|---|---|---|
| SEC EDGAR & Yahoo Finance | $0.00035 | SEC filings (10-K, 10-Q, 8-K) + stock quotes + financials |
Search & Tech
| Actor | Price/result | Description |
|---|---|---|
| Bing & DuckDuckGo SERP | $0.0031 | Search results: titles, URLs, snippets, positions |
| Google News Scraper | $0.0028 | News articles: headlines, sources, dates, URLs |
| Google Trends Scraper | $0.0021 | Interest over time + related queries, up to 5 keywords |
| Tech Stack Detector | $0.0016 | Website tech stack: CMS, frameworks, analytics, CDN, hosting |
MCP Integration
All CrawlKit Actors are available through the Apify MCP server, making them callable by AI agents (Claude, Cursor, etc.) with zero code.
Endpoint: https://mcp.apify.com
See tutorials/mcp_integration.md for setup instructions.
Examples
| File | What it does |
|---|---|
| booking.py | Scrape hotels in Paris from Booking.com |
| amazon_reviews.py | Fetch product reviews from Amazon |
| youtube.py | Extract a video transcript from YouTube |
| google_trends.py | Get interest-over-time data for keywords |
| zillow.py | Scrape real estate listings from Zillow |
All examples use httpx + the Apify REST API. No SDK required.
Tutorials
- Getting Started — API token, first run, reading results
- MCP Integration — Connect CrawlKit to Claude, Cursor and other AI agents
- Pricing — Pay-per-result model, tiers, volume discounts
License
MIT
Frequently asked questions
What is CrawlKit Scrapers?
Scrape Booking, Airbnb, Amazon, Zillow, Indeed, Yelp, Reddit, Google Shopping/Jobs via Apify MCP
How do I install CrawlKit Scrapers?
It runs as a remote server. In Claude Code: claude mcp add --transport http crawlkit-scrapers 'https://mcp.apify.com/?actors=sweet_stickball/booking-scraper,sweet_stickball/airbnb-scraper,sweet_stickball/amazon-reviews-scraper,sweet_stickball/aliexpress-scraper,sweet_stickball/google-shopping-scraper,sweet_stickball/zillow-scraper,sweet_stickball/reddit-scraper,sweet_stickball/google-jobs-scraper,sweet_stickball/indeed-job-scraper,sweet_stickball/yelp-scraper,sweet_stickball/google-news-scraper,sweet_stickball/google-flights-scraper,sweet_stickball/shopify-store-scraper,sweet_stickball/telegram-public-channel-scraper,sweet_stickball/bing-ddg-serp' --header 'Authorization: <Bearer <your Apify API token> (or sign in with OAuth)>'. For other clients, paste the JSON configuration from this page into their MCP settings.
Does CrawlKit Scrapers need an API key?
Yes. It expects Authorization, which you set in its configuration.
Is CrawlKit Scrapers open source?
Yes. Its code is on GitHub under the MIT license.
Who maintains CrawlKit Scrapers?
It is published by CrawlKit560. AI.tn lists it but does not maintain or endorse it.
From the official MCP Registry. Listing is not an endorsement: review a server's code and permissions before giving it access to your data.