Web Hygiene MCP

السجل الرسمي البحث والويب

Live web checks for AI agents: sitemaps, robots.txt, URL status, broken links, feeds, citations.

التثبيت

أضف هذا إلى إعدادات MCP في عميلك (Claude Desktop: claude_desktop_config.json، وCursor: ‏.cursor/mcp.json، ويستخدم VS Code وغيره الصيغة نفسها «mcpServers»).

Remote (streamable-http)
Claude Code
claude mcp add --transport http web-hygiene-mcp 'https://bruco3--web-hygiene-mcp.apify.actor/mcp' --header 'Authorization: <Bearer <your Apify API token> - get one free at https://console.apify.com/settings/integrations. Tool calls are billed to your Apify account, pay per event.>'
إعداد JSON (Claude Desktop وCursor وVS Code)
{
    "mcpServers": {
        "web-hygiene-mcp": {
            "type": "http",
            "url": "https://bruco3--web-hygiene-mcp.apify.actor/mcp",
            "headers": {
                "Authorization": "<Bearer <your Apify API token> - get one free at https://console.apify.com/settings/integrations. Tool calls are billed to your Apify account, pay per event.>"
            }
        }
    }
}

التوثيق

مأخوذ من ملف README للمشروع على GitHub ويُحدَّث أسبوعيًا. تفتح الروابط على GitHub.

المحتويات
  1. Web Hygiene MCP
  2. Connect
  3. Try it — three prompts
  4. Why
  5. Details, pricing, issues
  6. Legal

Web Hygiene MCP

· Official MCP Registry: io.github.Luca-003/web-hygiene-mcp

Remote MCP server (Streamable HTTP) that gives AI agents seven tools answering from the live web — never from a cache or the model's memory:

ToolWhat it does
site_overview(site)robots.txt (sitemaps declared, AI crawlers addressed, blanket disallow), llms.txt, sitemaps with URL count sample, feeds
list_site_urls(site_or_sitemap, max_urls, include_regex, exclude_regex)URLs a site publishes in its sitemaps, with lastmod (≤ 2,000)
check_url(url)HTTP status, full redirect chain, final URL, response time, content type
`check_links(urls \site_or_sitemap, max_urls, problems_only)`Bulk check: 404s, 5xx, timeouts, SSL errors, redirect chains, slow pages (≤ 300)
discover_feeds(site)RSS / Atom / JSON feeds of a website
read_feed(feed_or_site, max_items, include_content)Normalised feed items: title, link, date in UTC, author, summary, enclosures (≤ 100)
`verify_citations(text \urls \citations, check_archive, max_citations)`Per cited URL: verified / mismatch / not-found / redirected-home / paywalled / blocked …, real title/date/author, quote match evidence, Internet Archive copy for dead links (≤ 50)

Connect

URL:    https://bruco3--web-hygiene-mcp.apify.actor/mcp
Header: Authorization: Bearer <YOUR_APIFY_API_TOKEN>

Claude Desktop / Cursor / any Streamable HTTP client:

{
  "mcpServers": {
    "web-hygiene": {
      "url": "https://bruco3--web-hygiene-mcp.apify.actor/mcp",
      "headers": { "Authorization": "Bearer YOUR_APIFY_API_TOKEN" }
    }
  }
}

A free Apify account gives you an API token and $5 of monthly credits. Tool calls are billed pay-per-event to your Apify account: a check_url costs a fraction of a cent; verifying the 10 sources of an answer about two cents. No subscription, nothing to run.

Try it — three prompts

  1. "Check the sources in the answer you just gave me: does each link exist, and is the quote really on the page?" → verify_citations
  2. "Before we cite anything from example.com, what does the site publish and allow?" → site_overview
  3. "Check every link in this README and tell me which are broken or redirected." → check_links

Claude Code: ready-made plugin with two skills — /plugin marketplace add Luca-003/web-hygiene-claude-plugin then /plugin install web-hygiene@luca-003 (repo).

Why

Language models are confident about links and sources they have never fetched. These tools let an agent look before it claims: verify a URL exists and where it leads, check robots.txt and llms.txt before quoting a site, read what a site really publishes, confirm a cited page carries the quoted passage.

Details, pricing, issues

Full documentation, pricing table and issue tracker: **https://apify.com/bruco3/web-hygiene-mcp**

Related Actors for whole-site / whole-document jobs: Sitemap URL Extractor · Broken Link Checker · Feed Monitor · Citation & Link Verifier

The tools request only public files sites publish for automated readers (sitemaps, feeds, robots.txt, llms.txt) and public pages you name, with a clear User-Agent. No personal data is collected or stored.

This repository holds the registry metadata (server.json) and documentation; the server runs on Apify.

الأسئلة الشائعة

ما هو Web Hygiene MCP؟

Live web checks for AI agents: sitemaps, robots.txt, URL status, broken links, feeds, citations.

كيف أثبّت Web Hygiene MCP؟

يعمل كخادم بعيد. في Claude Code: claude mcp add --transport http web-hygiene-mcp 'https://bruco3--web-hygiene-mcp.apify.actor/mcp' --header 'Authorization: <Bearer <your Apify API token> - get one free at https://console.apify.com/settings/integrations. Tool calls are billed to your Apify account, pay per event.>'. وفي العملاء الآخرين، الصق إعداد JSON من هذه الصفحة في إعدادات MCP الخاصة بهم.

هل يحتاج Web Hygiene MCP إلى مفتاح API؟

نعم. يتطلب Authorization، وتضبطها في إعداداته.

هل Web Hygiene MCP مفتوح المصدر؟

شيفرته علنية على GitHub، لكن المستودع لا يعلن ترخيصًا قياسيًا.

من يصون Web Hygiene MCP؟

ينشره Luca-003. يدرجه AI.tn لكنه لا يصونه ولا يوصي به.

من سجل MCP الرسمي. الإدراج ليس توصية: راجع شيفرة الخادم وصلاحياته قبل منحه الوصول إلى بياناتك.