io.github.tacps126/webdata-tools-mcp

webdata-tools-mcp

An MCP server that gives AI agents twenty-seven web-data tools: job postings (company career sites, remote jobs, startups on Wellfound, US tech jobs on Dice, Indeed, Naukri), hiring signals, Google News, official government updates (US, UK, EU, India), public tenders and contract awards (US, EU, UK, France, Spain, Canada, Australia and more), official weather and disaster warnings (US, Europe, India, Brazil, worldwide), public funding calls (US Grants.gov, EU Horizon Europe and more, UKRI, Australia), notices from all 748 Indian district websites, new laws and bills (EU, UK, US), research papers and patents, field trends and idea validation, Trustpilot and app-store reviews, Reddit mentions and buying-intent leads, website contacts, German and Austrian property listings, Shopify products and store analysis, trade-show exhibitor lists and upcoming events. Two ready-made prompts turn the research tools into an innovation analyst that works the same with any model.

Each tool runs a ready-made Apify Actor and returns clean JSON. You pay Apify per result (about $1–3 per 1,000 results); there is no subscription and nothing is sent anywhere except Apify.

Tools

Every tool also takes an optional extra_input object for any other field the Actor documents. Every result comes back as text and as structured content (tool, count, shown, truncated, items), and every tool is marked read-only, so clients can run it without asking.

More about the tools: https://tacps126.github.io/mcp.html

Prompts and agent skill

Two ready-made prompts turn the research tools into an analyst, whichever model you use (Claude, GPT, Gemini, a local model): the evidence, the reading guide and the answer shape are fixed, so results stay comparable.

For agents that load skills (Claude Code, Codex and others), copy skills/innovation-analyst into your skills folder.

Setup

1. Create a free Apify account and copy your API token from Console → Settings → API & Integrations.
2. Add the server to your client. The token goes in APIFY_TOKEN.

Claude Desktop, one click: download webdata-tools-mcp-<version>.mcpb from the latest release and open it. Claude Desktop installs it and asks for your Apify token.

Claude Desktop / Cursor / Windsurf (mcpServers config):

{
  "mcpServers": {
    "webdata": {
      "command": "npx",
      "args": ["-y", "webdata-tools-mcp"],
      "env": { "APIFY_TOKEN": "<your Apify token>" }
    }
  }
}

Claude Code:

claude mcp add webdata -e APIFY_TOKEN=<your Apify token> -- npx -y webdata-tools-mcp

Requires Node.js 18 or newer.

Releases are tagged and published by CI from main (.github/workflows/release.yml).

Try it

• "Which of these companies are hiring data engineers right now? https://boards.greenhouse.io/stripe, https://jobs.lever.co/spotify";
• "Find remote senior engineer jobs open to people in Canada posted this week."
• "Who on Reddit is looking for an alternative to HubSpot this month?"
• "Analyze these Shopify stores and give me their country, product count and contact e-mail: allbirds.com, gymshark.com"
• "Show the 1 and 2 star Trustpilot reviews of example.com from the last 30 days and group the complaints."
• "Find news from the last 7 days about open-source LLM licensing, with the real publisher links."
• "What should a seed-stage founder build in sodium-ion batteries? Compare it with solid-state." (field-opportunity-analysis prompt)
• "Find the most influential papers of the last three years on retrieval augmented generation."
• "Get contact emails for these 20 agency websites." (use only for lawful business outreach)

Settings

Cost safety

• Every call is capped at $0.50 of Apify spend (WEBDATA_MAX_CHARGE_USD changes it). Apify stops the run when the cap is reached.
• max_items defaults to small numbers (20–100) and has a hard maximum per tool.
• Long text fields are shortened to 600 characters, and one result is limited to about 60,000 characters, so a call cannot flood the agent's context.

No install: Apify's hosted MCP server

You can also use Apify's own server with these Actors selected, with nothing to install:

{
  "mcpServers": {
    "apify": { "url": "https://mcp.apify.com?tools=tacps126/google-news,tacps126/hiring-signals,tacps126/trustpilot-reviews" }
  }
}

It signs you in with OAuth. The tools take the Actors' raw input fields instead of the simplified arguments above.

Development

npm install
npm test                                  # offline: mapping, errors, size limits, MCP handshake
node scripts/sync-actor-inputs.mjs        # refresh test/fixtures from the published Actors
APIFY_TOKEN=... node scripts/smoke.mjs    # live check, a few cents

test/fixtures/actor-inputs.json lists the input fields of each published Actor; the tests fail if a tool sends a field the Actor does not accept.

Responsible use

The Actors read publicly available pages. You are responsible for following each site's terms and the law that applies to you (GDPR, CAN-SPAM) when you use the data, especially contact details.

Listed on

Also on npm, the official MCP Registry (io.github.tacps126/webdata-tools-mcp), and Smithery.

License

MIT