Web Research Agent
Company profiles, site audits and page-to-JSON extraction for AI agents.
What can you do with Web Research Agent?
company_profile(url): name, description, logo, socials, emails, key pages, price mentions, tech stack.site_audit(url, max_links?): 0–100 score, SEO, performance, security-header and broken-link issues.page_to_json(url, max_text?): meta, OG, JSON-LD, headings, links, images, clean text.email_check(email? | domain?): syntax, MX/null-MX, SPF, DMARC policy, disposable/free/role flags, verdict and 0–100 score (live DNS, no SMTP probe).sitemap_urls(url, limit?, max_sitemaps?, since?): every URL a site publishes in its sitemaps, with lastmod;sincereturns only changed pages.page_diff(url, previous_text? | previous_hash?, selector?): content hash plus added/removed lines since your last check — a stateless change monitor.
Install
Add this to your client's MCP configuration (Claude Desktop: claude_desktop_config.json; Cursor: .cursor/mcp.json; VS Code and others use the same "mcpServers" shape).
claude mcp add --transport http web-research-agent 'https://web-research-agent-mcp.mcpize.run/mcp'
{
"mcpServers": {
"web-research-agent": {
"type": "http",
"url": "https://web-research-agent-mcp.mcpize.run/mcp"
}
}
}
Documentation
From the project's README on GitHub, refreshed weekly. Links open on GitHub.
web-research-agent-mcp
MCP server that gives Claude, Cursor or any MCP client six research tools: company_profile, site_audit, page_to_json, email_check, sitemap_urls and page_diff.
It is backed by the Web Research Agent API on RapidAPI. You need your own RapidAPI key. The free plan gives you 50 calls/month.
Setup
- Subscribe on RapidAPI (Free plan) and copy your
X-RapidAPI-Key. - Add the server to your MCP config:
json { "mcpServers": { "web-research-agent": { "command": "npx", "args": ["-y", "github:elaysuu/web-research-agent-mcp"], "env": { "RAPIDAPI_KEY": "YOUR_KEY" } } } }## Tools
company_profile(url): name, description, logo, socials, emails, key pages, price mentions, tech stack.site_audit(url, max_links?): 0–100 score, SEO, performance, security-header and broken-link issues.page_to_json(url, max_text?): meta, OG, JSON-LD, headings, links, images, clean text.email_check(email? | domain?): syntax, MX/null-MX, SPF, DMARC policy, disposable/free/role flags, verdict and 0–100 score (live DNS, no SMTP probe).sitemap_urls(url, limit?, max_sitemaps?, since?): every URL a site publishes in its sitemaps, with lastmod;sincereturns only changed pages.page_diff(url, previous_text? | previous_hash?, selector?): content hash plus added/removed lines since your last check — a stateless change monitor.
The crawler respects robots.txt and refuses private and internal addresses. MIT license.
Hosted / pay-per-call
Also available hosted on MCPize with pay-per-call pricing (no RapidAPI key needed). Self-hosters of the backend can use direct mode with env WRA_DIRECT_URL and WRA_DIRECT_TOKEN.
Also by the author
- AI Agent Prompt Pack: prompts for research and tool-using agents (source citing, fact-checking, guardrails). $9 on Payhip, or 9 USDC on Base at Setrov Store.
- Other products (game textures, kids printables): Setrov Studio on Payhip.
Frequently asked questions
What is Web Research Agent?
Company profiles, site audits and page-to-JSON extraction for AI agents.
How do I install Web Research Agent?
It runs as a remote server. In Claude Code: claude mcp add --transport http web-research-agent 'https://web-research-agent-mcp.mcpize.run/mcp'. For other clients, paste the JSON configuration from this page into their MCP settings.
Does Web Research Agent need an API key?
Its registry entry lists no required key or secret. Some features may still need an account with the service it connects to.
Is Web Research Agent open source?
Its code is public on GitHub, but the repository does not declare a standard license.
Who maintains Web Research Agent?
It is published by elaysuu. AI.tn lists it but does not maintain or endorse it.
From the official MCP Registry. Listing is not an endorsement: review a server's code and permissions before giving it access to your data.