X402 Scraper Engine
Web scraping, Llama 3 digests and Twitter intelligence, paid per call in USDC via x402 on Base.
Install
The installation steps are in the documentation below. Documentation
Documentation
From the project's README on GitHub, refreshed weekly. Links open on GitHub.
Contents
⚡ x402 Multi-Tier Agent Intelligence & Scraper Engine
Production Multi-Tiered Agent Intelligence & Context Compression API running natively on Base L2 USDC with HTTP 402 micro-settlement.
Convert webpages into clean Markdown, synthesize token-dense Llama 3 digests, audit smart contracts/websites for security risks, or query Twitter sentiment with zero API subscriptions.
🌐 Live Production Endpoints
| Resource | URL | Method | Price (Base USDC) | Description |
|---|---|---|---|---|
| Health & Info | https://x402-scraper-engine.gejoe-tt.workers.dev/health | GET | Free | Live engine status & pricing catalog |
| Clean Scrape | https://x402-scraper-engine.gejoe-tt.workers.dev/v1/scrape | POST | 0.005 USDC | Zero-bloat HTML to Markdown extraction |
| Edge LLM Digest | https://x402-scraper-engine.gejoe-tt.workers.dev/v1/digest | POST | 0.025 USDC | Llama 3 Edge Context Synthesis & entity extraction |
| Security Signal Audit | https://x402-scraper-engine.gejoe-tt.workers.dev/v1/audit | POST | 0.080 USDC | Phishing, contract & credibility risk scoring |
| Deep Web Search | https://x402-scraper-engine.gejoe-tt.workers.dev/v1/search | POST | 0.050 USDC | Multi-source web research & synthesized summaries |
| Twitter Search | https://x402-scraper-engine.gejoe-tt.workers.dev/v1/twitter/search | POST | 0.050 USDC | Cashtags ($BASE), sentiment & topics |
| Twitter Profile | https://x402-scraper-engine.gejoe-tt.workers.dev/v1/twitter/profile | POST | 0.030 USDC | Bio & recent tweets for any handle |
| Bazaar Discovery | https://x402-scraper-engine.gejoe-tt.workers.dev/.well-known/x402.json | GET | Free | x402 V2 + Bazaar machine discovery |
| OpenAPI 3.1 Spec | https://x402-scraper-engine.gejoe-tt.workers.dev/openapi.json | GET | Free | Full machine-readable schema |
💡 Why Multi-Tiered x402?
- Zero Signups & No API Keys: No credit cards, accounts, or monthly commitments.
- Pay-Per-Call Micropayments: $0.005 to $0.080 USDC on Base L2 instead of $50–$100/mo SaaS subscriptions.
- Context Compression Savings:
/v1/digestsaves 80%+ on downstream Claude/GPT-4o token bills by summarizing 10,000 words into a dense 300-word structured brief on the edge. - Crypto Agent Security:
/v1/auditprovides instantaneous scam, drainer, and contract safety checks before agents execute transactions. - Bypasses X API Paywall: Query real-time Twitter sentiment and profiles without the $100/mo fee.
- x402 V2 + Bazaar Standard: Compatible with automated agent marketplaces (Agentic.market, LangChain, Coinbase AgentKit).
🚀 Quickstart: cURL Examples
1. Scrape Webpage (0.005 USDC)
# Challenge request (returns HTTP 402 with PAYMENT-REQUIRED header)
curl -i -X POST https://x402-scraper-engine.gejoe-tt.workers.dev/v1/scrape \
-H "Content-Type: application/json" \
-d '{"url": "https://news.ycombinator.com"}'
# Resubmit with Base L2 Transaction Receipt
curl -X POST https://x402-scraper-engine.gejoe-tt.workers.dev/v1/scrape \
-H "Content-Type: application/json" \
-H "X-Payment-Receipt: 0x...your_tx_hash..." \
-d '{"url": "https://news.ycombinator.com"}'
2. Edge LLM Context Synthesis (0.025 USDC)
curl -i -X POST https://x402-scraper-engine.gejoe-tt.workers.dev/v1/digest \
-H "Content-Type: application/json" \
-d '{"url": "https://docs.base.org", "focus": "smart contract deployment"}'
3. Website & Contract Security Audit (0.080 USDC)
curl -i -X POST https://x402-scraper-engine.gejoe-tt.workers.dev/v1/audit \
-H "Content-Type: application/json" \
-d '{"url": "https://example-dex.org", "contract_address": "0x833589fCD6eDb6E08f4c7C32D4f71b54bdA02913"}'
🤖 Model Context Protocol (MCP) Configuration
Add the 6-tool suite to Claude Desktop, Cursor, Windsurf, or ElizaOS:
{
"mcpServers": {
"x402-agent-intelligence": {
"command": "npx",
"args": ["-y", "github:ami-guru/x402-scraper-engine"],
"env": {
"BASE_RPC_URL": "https://mainnet.base.org",
"AGENT_PRIVATE_KEY": "0xYourAgentFundedPrivateKey"
}
}
}
}
⚡ Autonomous Agent TypeScript SDK (3 Lines of Code)
Import into any Coinbase AgentKit, ElizaOS, LangChain, or custom bot:
import { X402Client } from 'x402-scraper-engine/client';
const agentClient = new X402Client({
privateKey: process.env.AGENT_PRIVATE_KEY, // Base L2 wallet
rpcUrl: 'https://mainnet.base.org'
});
// 1. Scrape webpage to clean Markdown (0.005 USDC)
const page = await agentClient.scrape('https://news.ycombinator.com');
// 2. Synthesize token-dense context with Edge Llama 3 (0.025 USDC)
const digest = await agentClient.digest('https://docs.base.org', 'deployment');
// 3. Search real-time Twitter/X sentiment without $100/mo API fee (0.050 USDC)
const tweets = await agentClient.searchTwitter('$BASE');
// 4. Security & Phishing audit for DeFi sites (0.080 USDC)
const security = await agentClient.audit('https://suspicious-dex.com');
📄 License
MIT © 2026 ASOT Marketing and Investment
Frequently asked questions
What is X402 Scraper Engine?
Web scraping, Llama 3 digests and Twitter intelligence, paid per call in USDC via x402 on Base.
How do I install X402 Scraper Engine?
Follow the installation steps in its documentation, shown on this page and in its repository.
Is X402 Scraper Engine open source?
Yes. Its code is on GitHub under the MIT license.
Who maintains X402 Scraper Engine?
It is published by ami-guru. AI.tn lists it but does not maintain or endorse it.
From the community awesome-mcp-servers lists and the project's GitHub repository. Listing is not an endorsement: review a server's code and permissions before giving it access to your data.