X402 Scraper Engine
Web scraping, Llama 3 digests and Twitter intelligence, paid per call in USDC via x402 on Base.
Installation
Les étapes d'installation sont dans la documentation ci-dessous. Documentation
Documentation
Tirée du README du projet sur GitHub, actualisée chaque semaine. Les liens ouvrent GitHub.
Sommaire
⚡ x402 Multi-Tier Agent Intelligence & Scraper Engine
Production Multi-Tiered Agent Intelligence & Context Compression API running natively on Base L2 USDC with HTTP 402 micro-settlement.
Convert webpages into clean Markdown, synthesize token-dense Llama 3 digests, audit smart contracts/websites for security risks, or query Twitter sentiment with zero API subscriptions.
🌐 Live Production Endpoints
| Resource | URL | Method | Price (Base USDC) | Description |
|---|---|---|---|---|
| Health & Info | https://x402-scraper-engine.gejoe-tt.workers.dev/health | GET | Free | Live engine status & pricing catalog |
| Clean Scrape | https://x402-scraper-engine.gejoe-tt.workers.dev/v1/scrape | POST | 0.005 USDC | Zero-bloat HTML to Markdown extraction |
| Edge LLM Digest | https://x402-scraper-engine.gejoe-tt.workers.dev/v1/digest | POST | 0.025 USDC | Llama 3 Edge Context Synthesis & entity extraction |
| Security Signal Audit | https://x402-scraper-engine.gejoe-tt.workers.dev/v1/audit | POST | 0.080 USDC | Phishing, contract & credibility risk scoring |
| Deep Web Search | https://x402-scraper-engine.gejoe-tt.workers.dev/v1/search | POST | 0.050 USDC | Multi-source web research & synthesized summaries |
| Twitter Search | https://x402-scraper-engine.gejoe-tt.workers.dev/v1/twitter/search | POST | 0.050 USDC | Cashtags ($BASE), sentiment & topics |
| Twitter Profile | https://x402-scraper-engine.gejoe-tt.workers.dev/v1/twitter/profile | POST | 0.030 USDC | Bio & recent tweets for any handle |
| Bazaar Discovery | https://x402-scraper-engine.gejoe-tt.workers.dev/.well-known/x402.json | GET | Free | x402 V2 + Bazaar machine discovery |
| OpenAPI 3.1 Spec | https://x402-scraper-engine.gejoe-tt.workers.dev/openapi.json | GET | Free | Full machine-readable schema |
💡 Why Multi-Tiered x402?
- Zero Signups & No API Keys: No credit cards, accounts, or monthly commitments.
- Pay-Per-Call Micropayments: $0.005 to $0.080 USDC on Base L2 instead of $50–$100/mo SaaS subscriptions.
- Context Compression Savings:
/v1/digestsaves 80%+ on downstream Claude/GPT-4o token bills by summarizing 10,000 words into a dense 300-word structured brief on the edge. - Crypto Agent Security:
/v1/auditprovides instantaneous scam, drainer, and contract safety checks before agents execute transactions. - Bypasses X API Paywall: Query real-time Twitter sentiment and profiles without the $100/mo fee.
- x402 V2 + Bazaar Standard: Compatible with automated agent marketplaces (Agentic.market, LangChain, Coinbase AgentKit).
🚀 Quickstart: cURL Examples
1. Scrape Webpage (0.005 USDC)
# Challenge request (returns HTTP 402 with PAYMENT-REQUIRED header)
curl -i -X POST https://x402-scraper-engine.gejoe-tt.workers.dev/v1/scrape \
-H "Content-Type: application/json" \
-d '{"url": "https://news.ycombinator.com"}'
# Resubmit with Base L2 Transaction Receipt
curl -X POST https://x402-scraper-engine.gejoe-tt.workers.dev/v1/scrape \
-H "Content-Type: application/json" \
-H "X-Payment-Receipt: 0x...your_tx_hash..." \
-d '{"url": "https://news.ycombinator.com"}'
2. Edge LLM Context Synthesis (0.025 USDC)
curl -i -X POST https://x402-scraper-engine.gejoe-tt.workers.dev/v1/digest \
-H "Content-Type: application/json" \
-d '{"url": "https://docs.base.org", "focus": "smart contract deployment"}'
3. Website & Contract Security Audit (0.080 USDC)
curl -i -X POST https://x402-scraper-engine.gejoe-tt.workers.dev/v1/audit \
-H "Content-Type: application/json" \
-d '{"url": "https://example-dex.org", "contract_address": "0x833589fCD6eDb6E08f4c7C32D4f71b54bdA02913"}'
🤖 Model Context Protocol (MCP) Configuration
Add the 6-tool suite to Claude Desktop, Cursor, Windsurf, or ElizaOS:
{
"mcpServers": {
"x402-agent-intelligence": {
"command": "npx",
"args": ["-y", "github:ami-guru/x402-scraper-engine"],
"env": {
"BASE_RPC_URL": "https://mainnet.base.org",
"AGENT_PRIVATE_KEY": "0xYourAgentFundedPrivateKey"
}
}
}
}
⚡ Autonomous Agent TypeScript SDK (3 Lines of Code)
Import into any Coinbase AgentKit, ElizaOS, LangChain, or custom bot:
import { X402Client } from 'x402-scraper-engine/client';
const agentClient = new X402Client({
privateKey: process.env.AGENT_PRIVATE_KEY, // Base L2 wallet
rpcUrl: 'https://mainnet.base.org'
});
// 1. Scrape webpage to clean Markdown (0.005 USDC)
const page = await agentClient.scrape('https://news.ycombinator.com');
// 2. Synthesize token-dense context with Edge Llama 3 (0.025 USDC)
const digest = await agentClient.digest('https://docs.base.org', 'deployment');
// 3. Search real-time Twitter/X sentiment without $100/mo API fee (0.050 USDC)
const tweets = await agentClient.searchTwitter('$BASE');
// 4. Security & Phishing audit for DeFi sites (0.080 USDC)
const security = await agentClient.audit('https://suspicious-dex.com');
📄 License
MIT © 2026 ASOT Marketing and Investment
Questions fréquentes
Qu'est-ce que X402 Scraper Engine ?
Web scraping, Llama 3 digests and Twitter intelligence, paid per call in USDC via x402 on Base.
Comment installer X402 Scraper Engine ?
Suivez les étapes d'installation de sa documentation, affichée sur cette page et dans son dépôt.
X402 Scraper Engine est-il open source ?
Oui. Son code est sur GitHub sous licence MIT.
Qui maintient X402 Scraper Engine ?
Il est publié par ami-guru. AI.tn le référence sans le maintenir ni le recommander.
Issu des listes communautaires awesome-mcp-servers et du dépôt GitHub du projet. Être listé n'est pas une recommandation : vérifiez le code et les permissions d'un serveur avant de lui donner accès à vos données.