English Français العربية

GenPark Bloom Filter URL Dedup Crawler

Official registry Search and web

In-memory Bloom filter for URL and document hash deduplication preventing redundant web crawler inge

Source code Website Documentation

What can you do with GenPark Bloom Filter URL Dedup Crawler?

  • 100% Python Standard Library: Zero third-party runtime dependencies.
  • MCP Native: Plugs directly into Claude Desktop, Cursor, LobeChat, and autonomous agent DAGs.
  • Production Resilience: Strict schema conformance, zero data loss, enterprise hardened.

Install

Add this to your client's MCP configuration (Claude Desktop: claude_desktop_config.json; Cursor: .cursor/mcp.json; VS Code and others use the same "mcpServers" shape).

MCPB package https://github.com/Alpha-Park/genpark-bloom-filter-url-dedup-crawler-skill/releases/download/v1.0.1/genpark-bloom-filter-url-dedup-crawler-skill-v1.0.1.mcpb

Documentation

From the project's README on GitHub, refreshed weekly. Links open on GitHub.

Contents
  1. GenPark Bloom Filter URL Dedup Crawler
  2. 🌟 Key Features
  3. 🚀 Installation & Usage
  4. 📄 License

GenPark Bloom Filter URL Dedup Crawler

In-memory Bloom filter for URL and document hash deduplication preventing redundant web crawler ingestion.

Part of the GenPark AI Agent Skills Ecosystem.

🌟 Key Features

  • 100% Python Standard Library: Zero third-party runtime dependencies.
  • MCP Native: Plugs directly into Claude Desktop, Cursor, LobeChat, and autonomous agent DAGs.
  • Production Resilience: Strict schema conformance, zero data loss, enterprise hardened.

🚀 Installation & Usage

Run as an MCP server:

python mcp_server.py

Use directly as a library:

from client import *

See example_usage.py for comprehensive integration demonstrations.

📄 License

MIT License. Maintained by GenPark AI.

Frequently asked questions

What is GenPark Bloom Filter URL Dedup Crawler?

In-memory Bloom filter for URL and document hash deduplication preventing redundant web crawler inge

How do I install GenPark Bloom Filter URL Dedup Crawler?

Follow the installation steps in its documentation, shown on this page and in its repository.

Does GenPark Bloom Filter URL Dedup Crawler need an API key?

Its registry entry lists no required key or secret. Some features may still need an account with the service it connects to.

Is GenPark Bloom Filter URL Dedup Crawler open source?

Its code is public on GitHub, but the repository does not declare a standard license.

Who maintains GenPark Bloom Filter URL Dedup Crawler?

It is published by alphaparkinc. AI.tn lists it but does not maintain or endorse it.

From the official MCP Registry. Listing is not an endorsement: review a server's code and permissions before giving it access to your data.