WebFetch Enhanced
Drop-in MCP replacement for the built-in WebFetch tool. Adds domain-scoped custom HTTP headers via YAML config, with bot-block detection, HTML-to-text extraction, retries, proxies, and prompt-injection sanitization.
What is WebFetch Enhanced?
WebFetch Enhanced is a Model Context Protocol (MCP) server that allows AI assistants like Claude, Cursor, and VS Code to drop-in mcp replacement for the built-in webfetch tool. adds domain-scoped custom http headers via yaml config, with bot-block detection, html-to-text extraction, retries, proxies, and prompt-injectio...
Drop-in MCP replacement for the built-in WebFetch tool. Adds domain-scoped custom HTTP headers via YAML config, with bot-block detection, HTML-to-text extraction, retries, proxies, and prompt-injection sanitization.
This server falls under the Search & Data Extraction category on MCPgee, the world's largest MCP server directory with 33,000+ servers.
Features
- Drop-in MCP replacement for the built-in WebFetch tool. Adds
Use Cases
Maintainer
Works with
Installation
NPM
npx -y getwebfetch-mcpManual Installation
npx -y getwebfetch-mcpConfiguration
Configuration Details
claude_desktop_config.json
Performance
Response Metrics
Resource Usage
How to Set Up and Use WebFetch Enhanced
getwebfetch-mcp is an enhanced drop-in MCP replacement for the built-in WebFetch tool that adds domain-scoped custom HTTP headers via YAML configuration, making it possible to bypass bot-blocking on protected sites. It ships with HTML-to-text extraction, automatic retries, proxy support, and prompt-injection sanitization to keep AI agents safe from malicious page content. Developers and power users connect it to Claude Desktop or any MCP-compatible client when the default fetch tool fails on sites that require special headers or authentication cookies.
Prerequisites
- Node.js 18 or later installed
- An MCP-compatible client such as Claude Desktop or Claude Code
- npx available on your PATH (comes with Node.js)
- Optional: a YAML headers config file for domain-scoped header injection
Install the package
Run the server directly with npx — no global install is required. The -y flag accepts the install prompt automatically.
npx -y getwebfetch-mcpLocate your Claude Desktop config file
Open claude_desktop_config.json in your Claude Desktop application data directory. On macOS this is ~/Library/Application Support/Claude/claude_desktop_config.json.
Add the server to your MCP config
Add getwebfetch-mcp as an MCP server entry. The server launches via npx and needs no additional environment variables for basic operation.
{
"mcpServers": {
"webfetch": {
"command": "npx",
"args": ["-y", "getwebfetch-mcp"]
}
}
}Create a headers config file (optional)
To inject custom headers for specific domains (e.g. auth cookies or User-Agent overrides), create a YAML file with per-domain header rules and pass its path to the server.
# headers.yaml example
example.com:
Cookie: "session=abc123"
User-Agent: "Mozilla/5.0 (compatible)"
api.example.com:
Authorization: "Bearer YOUR_TOKEN"Restart Claude Desktop and test
Restart Claude Desktop so it picks up the new MCP server. Ask Claude to fetch a URL that previously failed with the built-in WebFetch tool.
WebFetch Enhanced Examples
Client configuration
Minimal Claude Desktop configuration for getwebfetch-mcp.
{
"mcpServers": {
"webfetch": {
"command": "npx",
"args": ["-y", "getwebfetch-mcp"]
}
}
}Prompts to try
Example prompts that leverage the enhanced fetch capabilities.
- "Fetch the content from https://example.com/protected-page and summarize it"
- "Retrieve this behind-a-paywall article and extract the key points"
- "Fetch https://api.example.com/data and parse the JSON response"Troubleshooting WebFetch Enhanced
Bot-block or CAPTCHA pages returned instead of real content
Create a YAML headers config file with a realistic User-Agent and any session cookies for that domain, then pass the config path to the server in the args array.
Server not appearing in Claude Desktop after config change
Fully quit and relaunch Claude Desktop (not just close the window). Verify the JSON in claude_desktop_config.json is valid — trailing commas or missing brackets will silently prevent the server from loading.
npx command not found or takes too long on first run
Ensure Node.js 18+ is installed and npx is on your PATH. On first run npx downloads the package, which may take a moment — subsequent runs use the cache.
Frequently Asked Questions about WebFetch Enhanced
What is WebFetch Enhanced?
WebFetch Enhanced is a Model Context Protocol (MCP) server that drop-in mcp replacement for the built-in webfetch tool. adds domain-scoped custom http headers via yaml config, with bot-block detection, html-to-text extraction, retries, proxies, and prompt-injection sanitization. It connects AI assistants to external tools and data sources through a standardized interface.
How do I install WebFetch Enhanced?
Install via npm with the command: npx -y getwebfetch-mcp. Then add the server configuration to your AI client's JSON config file (e.g., claude_desktop_config.json or .cursor/mcp.json).
Which AI clients work with WebFetch Enhanced?
WebFetch Enhanced works with all major MCP-compatible AI clients including Claude Desktop, Claude Code, Cursor, VS Code (GitHub Copilot), Windsurf, and Cline.
Is WebFetch Enhanced free to use?
Yes, WebFetch Enhanced is open source and available under the MIT License license. You can use it freely in both personal and commercial projects.
WebFetch Enhanced Alternatives — Similar Search & Data Extraction Servers
Looking for alternatives to WebFetch Enhanced? Here are other popular search & data extraction servers you can use with Claude, Cursor, and VS Code.
TrendRadar
★ 58.0kA real-time hotspot monitoring and news aggregation assistant that provides AI-powered analysis of trending topics across multiple platforms via the Model Context Protocol. It enables users to track news and receive automated notifications through va
Scrapling
★ 52.7k🕷️ An adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl!
PDF Math Translate
★ 33.9k[EMNLP 2025 Demo] PDF scientific paper translation with preserved formats - 基于 AI 完整保留排版的 PDF 文档全文双语翻译，支持 Google/DeepL/Ollama/OpenAI 等服务，提供 CLI/GUI/MCP/Docker/Zotero
GPT Researcher
★ 27.2kAn autonomous agent that conducts deep research on any data using any LLM providers
Agent Reach
★ 20.1kGive your AI agent eyes to see the entire internet. Read & search Twitter, Reddit, YouTube, GitHub, Bilibili, XiaoHongShu — one CLI, zero API fees.
Xiaohongshu
★ 13.7kMCP for xiaohongshu.com
Browse More Search & Data Extraction MCP Servers
Explore all search & data extraction servers available in the MCPgee directory. Each server includes setup guides for Claude, Cursor, and VS Code.
Set Up WebFetch Enhanced in Your Editor
Choose your AI client for step-by-step setup instructions.
Quick Config Preview
Add this to your claude_desktop_config.json or .cursor/mcp.json
Ready to use WebFetch Enhanced?
Browse our complete directory of 33,000+ MCP servers, read setup guides for your editor, and start building with the Model Context Protocol.