X402 Scraper Engine

مجتمعي البحث والويب

Web scraping, Llama 3 digests and Twitter intelligence, paid per call in USDC via x402 on Base.

التثبيت

خطوات التثبيت موجودة في التوثيق أدناه. التوثيق

التوثيق

مأخوذ من ملف README للمشروع على GitHub ويُحدَّث أسبوعيًا. تفتح الروابط على GitHub.

المحتويات
  1. ⚡ x402 Multi-Tier Agent Intelligence & Scraper Engine
  2. 🌐 Live Production Endpoints
  3. 💡 Why Multi-Tiered x402?
  4. 🚀 Quickstart: cURL Examples
  5. 🤖 Model Context Protocol (MCP) Configuration
  6. ⚡ Autonomous Agent TypeScript SDK (3 Lines of Code)
  7. 📄 License

⚡ x402 Multi-Tier Agent Intelligence & Scraper Engine

Production Multi-Tiered Agent Intelligence & Context Compression API running natively on Base L2 USDC with HTTP 402 micro-settlement.
Convert webpages into clean Markdown, synthesize token-dense Llama 3 digests, audit smart contracts/websites for security risks, or query Twitter sentiment with zero API subscriptions.


🌐 Live Production Endpoints

ResourceURLMethodPrice (Base USDC)Description
Health & Infohttps://x402-scraper-engine.gejoe-tt.workers.dev/healthGETFreeLive engine status & pricing catalog
Clean Scrapehttps://x402-scraper-engine.gejoe-tt.workers.dev/v1/scrapePOST0.005 USDCZero-bloat HTML to Markdown extraction
Edge LLM Digesthttps://x402-scraper-engine.gejoe-tt.workers.dev/v1/digestPOST0.025 USDCLlama 3 Edge Context Synthesis & entity extraction
Security Signal Audithttps://x402-scraper-engine.gejoe-tt.workers.dev/v1/auditPOST0.080 USDCPhishing, contract & credibility risk scoring
Deep Web Searchhttps://x402-scraper-engine.gejoe-tt.workers.dev/v1/searchPOST0.050 USDCMulti-source web research & synthesized summaries
Twitter Searchhttps://x402-scraper-engine.gejoe-tt.workers.dev/v1/twitter/searchPOST0.050 USDCCashtags ($BASE), sentiment & topics
Twitter Profilehttps://x402-scraper-engine.gejoe-tt.workers.dev/v1/twitter/profilePOST0.030 USDCBio & recent tweets for any handle
Bazaar Discoveryhttps://x402-scraper-engine.gejoe-tt.workers.dev/.well-known/x402.jsonGETFreex402 V2 + Bazaar machine discovery
OpenAPI 3.1 Spechttps://x402-scraper-engine.gejoe-tt.workers.dev/openapi.jsonGETFreeFull machine-readable schema

💡 Why Multi-Tiered x402?

  • Zero Signups & No API Keys: No credit cards, accounts, or monthly commitments.
  • Pay-Per-Call Micropayments: $0.005 to $0.080 USDC on Base L2 instead of $50–$100/mo SaaS subscriptions.
  • Context Compression Savings: /v1/digest saves 80%+ on downstream Claude/GPT-4o token bills by summarizing 10,000 words into a dense 300-word structured brief on the edge.
  • Crypto Agent Security: /v1/audit provides instantaneous scam, drainer, and contract safety checks before agents execute transactions.
  • Bypasses X API Paywall: Query real-time Twitter sentiment and profiles without the $100/mo fee.
  • x402 V2 + Bazaar Standard: Compatible with automated agent marketplaces (Agentic.market, LangChain, Coinbase AgentKit).

🚀 Quickstart: cURL Examples

1. Scrape Webpage (0.005 USDC)
# Challenge request (returns HTTP 402 with PAYMENT-REQUIRED header)
curl -i -X POST https://x402-scraper-engine.gejoe-tt.workers.dev/v1/scrape \
  -H "Content-Type: application/json" \
  -d '{"url": "https://news.ycombinator.com"}'

# Resubmit with Base L2 Transaction Receipt
curl -X POST https://x402-scraper-engine.gejoe-tt.workers.dev/v1/scrape \
  -H "Content-Type: application/json" \
  -H "X-Payment-Receipt: 0x...your_tx_hash..." \
  -d '{"url": "https://news.ycombinator.com"}'
2. Edge LLM Context Synthesis (0.025 USDC)
curl -i -X POST https://x402-scraper-engine.gejoe-tt.workers.dev/v1/digest \
  -H "Content-Type: application/json" \
  -d '{"url": "https://docs.base.org", "focus": "smart contract deployment"}'
3. Website & Contract Security Audit (0.080 USDC)
curl -i -X POST https://x402-scraper-engine.gejoe-tt.workers.dev/v1/audit \
  -H "Content-Type: application/json" \
  -d '{"url": "https://example-dex.org", "contract_address": "0x833589fCD6eDb6E08f4c7C32D4f71b54bdA02913"}'

🤖 Model Context Protocol (MCP) Configuration

Add the 6-tool suite to Claude Desktop, Cursor, Windsurf, or ElizaOS:

{
  "mcpServers": {
    "x402-agent-intelligence": {
      "command": "npx",
      "args": ["-y", "github:ami-guru/x402-scraper-engine"],
      "env": {
        "BASE_RPC_URL": "https://mainnet.base.org",
        "AGENT_PRIVATE_KEY": "0xYourAgentFundedPrivateKey"
      }
    }
  }
}

⚡ Autonomous Agent TypeScript SDK (3 Lines of Code)

Import into any Coinbase AgentKit, ElizaOS, LangChain, or custom bot:

import { X402Client } from 'x402-scraper-engine/client';

const agentClient = new X402Client({
  privateKey: process.env.AGENT_PRIVATE_KEY, // Base L2 wallet
  rpcUrl: 'https://mainnet.base.org'
});

// 1. Scrape webpage to clean Markdown (0.005 USDC)
const page = await agentClient.scrape('https://news.ycombinator.com');

// 2. Synthesize token-dense context with Edge Llama 3 (0.025 USDC)
const digest = await agentClient.digest('https://docs.base.org', 'deployment');

// 3. Search real-time Twitter/X sentiment without $100/mo API fee (0.050 USDC)
const tweets = await agentClient.searchTwitter('$BASE');

// 4. Security & Phishing audit for DeFi sites (0.080 USDC)
const security = await agentClient.audit('https://suspicious-dex.com');

📄 License

MIT © 2026 ASOT Marketing and Investment

الأسئلة الشائعة

ما هو X402 Scraper Engine؟

Web scraping, Llama 3 digests and Twitter intelligence, paid per call in USDC via x402 on Base.

كيف أثبّت X402 Scraper Engine؟

اتبع خطوات التثبيت في توثيقه المعروض في هذه الصفحة وفي مستودعه.

هل X402 Scraper Engine مفتوح المصدر؟

نعم. شيفرته متاحة على GitHub بترخيص MIT.

من يصون X402 Scraper Engine؟

ينشره ami-guru. يدرجه AI.tn لكنه لا يصونه ولا يوصي به.

من القوائم المجتمعية awesome-mcp-servers ومستودع المشروع على GitHub. الإدراج ليس توصية: راجع شيفرة الخادم وصلاحياته قبل منحه الوصول إلى بياناتك.