io.github.rog0x/web
Web scraping, search, monitoring, and HTML-to-markdown for AI agents
What can you do with io.github.rog0x/web?
- No API keys required — uses DuckDuckGo for search, direct HTTP for everything else
- Fast — parallel extraction, 15s timeout per request
- Clean output — strips scripts, styles, ads; extracts meaningful content
- Lightweight — minimal dependencies, no headless browser needed
- Production-ready — proper error handling, timeouts, input validation
Install
Add this to your client's MCP configuration (Claude Desktop: claude_desktop_config.json; Cursor: .cursor/mcp.json; VS Code and others use the same "mcpServers" shape).
@rog0x/mcp-web-toolsclaude mcp add web -- npx -y @rog0x/mcp-web-tools@1.0.1
{
"mcpServers": {
"web": {
"command": "npx",
"args": [
"-y",
"@rog0x/mcp-web-tools@1.0.1"
]
}
}
}
Documentation
From the project's README on GitHub, refreshed weekly. Links open on GitHub.
MCP Web Tools
A powerful MCP (Model Context Protocol) server that gives AI agents web superpowers. Extract content, search the web, monitor sites, and convert HTML to markdown — all through a clean tool interface.
Tools
| Tool | Description |
|---|---|
web_extract | Extract structured content from any URL (title, headings, paragraphs, links, images, metadata) |
web_search | Search the web via DuckDuckGo — no API key needed |
web_monitor | Check if a site is up, measure response time, get HTTP headers |
html_to_markdown | Convert any URL or HTML to clean markdown |
web_multi_extract | Extract content from multiple URLs in parallel |
Installation
For Claude Code
Add to your Claude Code MCP settings (~/.claude/settings.json):
{
"mcpServers": {
"web-tools": {
"command": "npx",
"args": ["@rog0x/mcp-web-tools"]
}
}
}
For Claude Desktop
Add to claude_desktop_config.json:
{
"mcpServers": {
"web-tools": {
"command": "npx",
"args": ["@rog0x/mcp-web-tools"]
}
}
}
Manual Installation
npm install -g @rog0x/mcp-web-tools
mcp-web-tools
Usage Examples
Extract content from a webpage
Use web_extract to get the main content from https://example.com
Search the web
Use web_search to find "best TypeScript frameworks 2026"
Monitor a website
Use web_monitor to check if https://api.example.com is responding
Convert page to markdown
Use html_to_markdown to convert https://docs.example.com/guide to readable markdown
Batch extraction
Use web_multi_extract to get content from these URLs: [url1, url2, url3]
Features
- No API keys required — uses DuckDuckGo for search, direct HTTP for everything else
- Fast — parallel extraction, 15s timeout per request
- Clean output — strips scripts, styles, ads; extracts meaningful content
- Lightweight — minimal dependencies, no headless browser needed
- Production-ready — proper error handling, timeouts, input validation
Requirements
- Node.js 18+
License
MIT — rog0x
Frequently asked questions
What is io.github.rog0x/web?
Web scraping, search, monitoring, and HTML-to-markdown for AI agents
How do I install io.github.rog0x/web?
It runs on your machine. In Claude Code: claude mcp add web -- npx -y @rog0x/mcp-web-tools@1.0.1. For other clients, paste the JSON configuration from this page into their MCP settings.
Does io.github.rog0x/web need an API key?
Its registry entry lists no required key or secret. Some features may still need an account with the service it connects to.
Is io.github.rog0x/web open source?
Yes. Its code is on GitHub under the MIT license.
Who maintains io.github.rog0x/web?
It is published by rog0x. AI.tn lists it but does not maintain or endorse it.
From the official MCP Registry. Listing is not an endorsement: review a server's code and permissions before giving it access to your data.