X402 Scraper Engine

Community Search and web

Web scraping, Llama 3 digests and Twitter intelligence, paid per call in USDC via x402 on Base.

Install

The installation steps are in the documentation below. Documentation

Documentation

From the project's README on GitHub, refreshed weekly. Links open on GitHub.

Contents
  1. ⚡ x402 Multi-Tier Agent Intelligence & Scraper Engine
  2. 🌐 Live Production Endpoints
  3. 💡 Why Multi-Tiered x402?
  4. 🚀 Quickstart: cURL Examples
  5. 🤖 Model Context Protocol (MCP) Configuration
  6. ⚡ Autonomous Agent TypeScript SDK (3 Lines of Code)
  7. 📄 License

⚡ x402 Multi-Tier Agent Intelligence & Scraper Engine

Production Multi-Tiered Agent Intelligence & Context Compression API running natively on Base L2 USDC with HTTP 402 micro-settlement.
Convert webpages into clean Markdown, synthesize token-dense Llama 3 digests, audit smart contracts/websites for security risks, or query Twitter sentiment with zero API subscriptions.


🌐 Live Production Endpoints

ResourceURLMethodPrice (Base USDC)Description
Health & Infohttps://x402-scraper-engine.gejoe-tt.workers.dev/healthGETFreeLive engine status & pricing catalog
Clean Scrapehttps://x402-scraper-engine.gejoe-tt.workers.dev/v1/scrapePOST0.005 USDCZero-bloat HTML to Markdown extraction
Edge LLM Digesthttps://x402-scraper-engine.gejoe-tt.workers.dev/v1/digestPOST0.025 USDCLlama 3 Edge Context Synthesis & entity extraction
Security Signal Audithttps://x402-scraper-engine.gejoe-tt.workers.dev/v1/auditPOST0.080 USDCPhishing, contract & credibility risk scoring
Deep Web Searchhttps://x402-scraper-engine.gejoe-tt.workers.dev/v1/searchPOST0.050 USDCMulti-source web research & synthesized summaries
Twitter Searchhttps://x402-scraper-engine.gejoe-tt.workers.dev/v1/twitter/searchPOST0.050 USDCCashtags ($BASE), sentiment & topics
Twitter Profilehttps://x402-scraper-engine.gejoe-tt.workers.dev/v1/twitter/profilePOST0.030 USDCBio & recent tweets for any handle
Bazaar Discoveryhttps://x402-scraper-engine.gejoe-tt.workers.dev/.well-known/x402.jsonGETFreex402 V2 + Bazaar machine discovery
OpenAPI 3.1 Spechttps://x402-scraper-engine.gejoe-tt.workers.dev/openapi.jsonGETFreeFull machine-readable schema

💡 Why Multi-Tiered x402?

  • Zero Signups & No API Keys: No credit cards, accounts, or monthly commitments.
  • Pay-Per-Call Micropayments: $0.005 to $0.080 USDC on Base L2 instead of $50–$100/mo SaaS subscriptions.
  • Context Compression Savings: /v1/digest saves 80%+ on downstream Claude/GPT-4o token bills by summarizing 10,000 words into a dense 300-word structured brief on the edge.
  • Crypto Agent Security: /v1/audit provides instantaneous scam, drainer, and contract safety checks before agents execute transactions.
  • Bypasses X API Paywall: Query real-time Twitter sentiment and profiles without the $100/mo fee.
  • x402 V2 + Bazaar Standard: Compatible with automated agent marketplaces (Agentic.market, LangChain, Coinbase AgentKit).

🚀 Quickstart: cURL Examples

1. Scrape Webpage (0.005 USDC)
# Challenge request (returns HTTP 402 with PAYMENT-REQUIRED header)
curl -i -X POST https://x402-scraper-engine.gejoe-tt.workers.dev/v1/scrape \
  -H "Content-Type: application/json" \
  -d '{"url": "https://news.ycombinator.com"}'

# Resubmit with Base L2 Transaction Receipt
curl -X POST https://x402-scraper-engine.gejoe-tt.workers.dev/v1/scrape \
  -H "Content-Type: application/json" \
  -H "X-Payment-Receipt: 0x...your_tx_hash..." \
  -d '{"url": "https://news.ycombinator.com"}'
2. Edge LLM Context Synthesis (0.025 USDC)
curl -i -X POST https://x402-scraper-engine.gejoe-tt.workers.dev/v1/digest \
  -H "Content-Type: application/json" \
  -d '{"url": "https://docs.base.org", "focus": "smart contract deployment"}'
3. Website & Contract Security Audit (0.080 USDC)
curl -i -X POST https://x402-scraper-engine.gejoe-tt.workers.dev/v1/audit \
  -H "Content-Type: application/json" \
  -d '{"url": "https://example-dex.org", "contract_address": "0x833589fCD6eDb6E08f4c7C32D4f71b54bdA02913"}'

🤖 Model Context Protocol (MCP) Configuration

Add the 6-tool suite to Claude Desktop, Cursor, Windsurf, or ElizaOS:

{
  "mcpServers": {
    "x402-agent-intelligence": {
      "command": "npx",
      "args": ["-y", "github:ami-guru/x402-scraper-engine"],
      "env": {
        "BASE_RPC_URL": "https://mainnet.base.org",
        "AGENT_PRIVATE_KEY": "0xYourAgentFundedPrivateKey"
      }
    }
  }
}

⚡ Autonomous Agent TypeScript SDK (3 Lines of Code)

Import into any Coinbase AgentKit, ElizaOS, LangChain, or custom bot:

import { X402Client } from 'x402-scraper-engine/client';

const agentClient = new X402Client({
  privateKey: process.env.AGENT_PRIVATE_KEY, // Base L2 wallet
  rpcUrl: 'https://mainnet.base.org'
});

// 1. Scrape webpage to clean Markdown (0.005 USDC)
const page = await agentClient.scrape('https://news.ycombinator.com');

// 2. Synthesize token-dense context with Edge Llama 3 (0.025 USDC)
const digest = await agentClient.digest('https://docs.base.org', 'deployment');

// 3. Search real-time Twitter/X sentiment without $100/mo API fee (0.050 USDC)
const tweets = await agentClient.searchTwitter('$BASE');

// 4. Security & Phishing audit for DeFi sites (0.080 USDC)
const security = await agentClient.audit('https://suspicious-dex.com');

📄 License

MIT © 2026 ASOT Marketing and Investment

Frequently asked questions

What is X402 Scraper Engine?

Web scraping, Llama 3 digests and Twitter intelligence, paid per call in USDC via x402 on Base.

How do I install X402 Scraper Engine?

Follow the installation steps in its documentation, shown on this page and in its repository.

Is X402 Scraper Engine open source?

Yes. Its code is on GitHub under the MIT license.

Who maintains X402 Scraper Engine?

It is published by ami-guru. AI.tn lists it but does not maintain or endorse it.

From the community awesome-mcp-servers lists and the project's GitHub repository. Listing is not an endorsement: review a server's code and permissions before giving it access to your data.