English Français العربية

io.github.ihen404/x402-scraper

Registre officiel Recherche et web

Autonomous HTTP 402 Web Scraping Mesh on Base for $0.02 USDC.

Code source Documentation

Que pouvez-vous faire avec io.github.ihen404/x402-scraper ?

  • Zero API Keys Required: Agents discover, pay, and execute scraping requests mid-task without unhandled API key exceptions or rate limits.
  • Predictable Operational Cost: Flat $0.02 USDC/request settlement on Base, offering a transparent OpEx alternative to dynamic per-gigabyte proxy services.
  • Token-Optimized Markdown: HTML, navigation boilerplate, and DOM elements are automatically stripped into clean, token-dense Markdown to reduce LLM context window costs.
  • Asynchronous Queue Resilience: Underpinned by a decoupled better-sqlite3 queue and PM2 worker mesh to prevent payload failures under high concurrency.
  • Ecosystem Ready: Native support for Model Context Protocol (MCP) manifests (/mcp.json) and ERC-8004 identity registration on Base.

Installation

Ajoutez ceci à la configuration MCP de votre client (Claude Desktop : claude_desktop_config.json ; Cursor : .cursor/mcp.json ; VS Code et les autres utilisent la même forme « mcpServers »).

Remote (streamable-http)
Claude Code 
claude mcp add --transport http x402-scraper 'https://your-domain.com/mcp.json'
Configuration JSON (Claude Desktop, Cursor, VS Code) 
{
    "mcpServers": {
        "x402-scraper": {
            "type": "http",
            "url": "https://your-domain.com/mcp.json"
        }
    }
}

Documentation

Tirée du README du projet sur GitHub, actualisée chaque semaine. Les liens ouvrent GitHub.

Sommaire
  1. @ihentrel/x402-scraper-langchain
  2. Key Features & Strategic Positioning
  3. Quickstart
  4. Model Context Protocol (MCP) Integration
  5. On-Chain Verification
  6. License

@ihentrel/x402-scraper-langchain

Protocol-native web scraping utility tool engineered for autonomous AI agents, powered by Coinbase AgentKit, LangChain, and x402 on-chain micro-settlements.

Key Features & Strategic Positioning

  • Zero API Keys Required: Agents discover, pay, and execute scraping requests mid-task without unhandled API key exceptions or rate limits.
  • Predictable Operational Cost: Flat $0.02 USDC/request settlement on Base, offering a transparent OpEx alternative to dynamic per-gigabyte proxy services.
  • Token-Optimized Markdown: HTML, navigation boilerplate, and DOM elements are automatically stripped into clean, token-dense Markdown to reduce LLM context window costs.
  • Asynchronous Queue Resilience: Underpinned by a decoupled better-sqlite3 queue and PM2 worker mesh to prevent payload failures under high concurrency.
  • Ecosystem Ready: Native support for Model Context Protocol (MCP) manifests (/mcp.json) and ERC-8004 identity registration on Base.

Quickstart

1. Installation
npm install @ihentrel/x402-scraper-langchain @coinbase/agentkit @langchain/openai
2. Basic Agent Usage
import { AgentKit, ViemWalletProvider, walletActionProvider } from "@coinbase/agentkit";
import { getLangChainTools } from "@coinbase/agentkit-langchain";
import { ChatOpenAI } from "@langchain/openai";
import { createReactAgent } from "@langchain/langgraph/prebuilt";
import { x402ActionProvider } from "@ihentrel/x402-scraper-langchain";

async function main() {
  const agentKit = await AgentKit.from({
    actionProviders: [walletActionProvider(), x402ActionProvider()],
  });

  const tools = await getLangChainTools(agentKit);
  const agent = createReactAgent({
    llm: new ChatOpenAI({ modelName: "gpt-4o-mini" }),
    tools,
  });

  const response = await agent.invoke({
    messages: [
      {
        role: "user",
        content: "Use the x402 scraper tool to fetch data from https://api.example.com/x402-resource",
      },
    ],
  });

  console.log(response.messages[response.messages.length - 1].content);
}

main();

Model Context Protocol (MCP) Integration

For drop-in compatibility with MCP clients (e.g., Claude Desktop, Cursor, CrewAI):

{
  "mcpServers": {
    "x402-scraper": {
      "url": "https://raw.githubusercontent.com/ihen404/langchain-x402/main/mcp.json"
    }
  }
}

On-Chain Verification

  • Network: Base Mainnet / Base Sepolia
  • Protocol Standard: ERC-8004 Agent Identity
  • Settlement Asset: USDC ($0.02 / request)

License

MIT © Ike Ambrose Hentrel II

Questions fréquentes

Qu'est-ce que io.github.ihen404/x402-scraper ?

Autonomous HTTP 402 Web Scraping Mesh on Base for $0.02 USDC.

Comment installer io.github.ihen404/x402-scraper ?

Il fonctionne comme serveur distant. Dans Claude Code : claude mcp add --transport http x402-scraper 'https://your-domain.com/mcp.json'. Pour les autres clients, collez la configuration JSON de cette page dans leurs réglages MCP.

Faut-il une clé API pour io.github.ihen404/x402-scraper ?

Son entrée au registre n'indique aucune clé ni secret obligatoire. Certaines fonctions peuvent tout de même demander un compte auprès du service auquel il se connecte.

io.github.ihen404/x402-scraper est-il open source ?

Son code est public sur GitHub, mais le dépôt ne déclare pas de licence standard.

Qui maintient io.github.ihen404/x402-scraper ?

Il est publié par ihen404. AI.tn le référence sans le maintenir ni le recommander.

Issu du registre MCP officiel. Être listé n'est pas une recommandation : vérifiez le code et les permissions d'un serveur avant de lui donner accès à vos données.