Website Downloader
๐๏ธ ๐ - This MCP server provides a tool to download entire websites using wget. It preserves the website structure and converts links to work locally.
What is Website Downloader?
Website Downloader is a Model Context Protocol (MCP) server that allows AI assistants like Claude, Cursor, and VS Code to ๐๏ธ ๐ - this mcp server provides a tool to download entire websites using wget. it preserves the website structure and converts links to work locally.
๐๏ธ ๐ - This MCP server provides a tool to download entire websites using wget. It preserves the website structure and converts links to work locally.
This server falls under the Search & Data Extraction category on MCPgee, the world's largest MCP server directory with 33,000+ servers.
Features
- ๐๏ธ ๐ - This MCP server provides a tool to download entire we
Use Cases
Maintainer
Works with
Installation
NPM
npx -y website-downloaderManual Installation
npx -y website-downloaderConfiguration
Configuration Details
claude_desktop_config.json
Performance
Response Metrics
Resource Usage
How to Set Up and Use Website Downloader
Website Downloader is an MCP server that wraps the wget utility to let AI assistants download entire websites โ recursively mirroring all pages, assets, and directory structures โ then convert all internal links to relative paths so the site works fully offline. It is useful for archiving documentation sites, creating offline-accessible reference material, or preparing web content for local analysis and processing.
Prerequisites
- wget installed on the host system (macOS: brew install wget; Ubuntu/Debian: sudo apt-get install wget; Windows: choco install wget)
- Node.js 18 or higher installed
- Git for cloning the repository
- An MCP-compatible client such as Claude Desktop or Cursor
- Sufficient disk space for the downloaded website
Install wget
wget must be available on your system PATH. Install it using your operating system's package manager.
# macOS
brew install wget
# Ubuntu / Debian
sudo apt-get install wget
# Verify
wget --versionInstall the website-downloader package
Install the npm package globally, or use npx to run it without a permanent install. The package is published as website-downloader on npm.
npm install -g website-downloader
# OR use directly with npx (no install needed)
npx -y website-downloaderCreate an output directory
Create a directory where downloaded websites will be saved. Specify this path when invoking the download_website tool.
mkdir -p ~/website-downloadsAdd the server to your MCP client configuration
Add the website-downloader entry to your claude_desktop_config.json. The server exposes a single tool called download_website with parameters: url (required), outputPath (optional), and depth (optional, defaults to infinite recursion).
Restart your MCP client
Save the config and restart Claude Desktop. The server's download_website tool will be available. Downloads are restricted to the same domain as the target URL to prevent unbounded crawling.
Website Downloader Examples
Client configuration
Claude Desktop configuration using npx to run the website-downloader server without a permanent global installation.
{
"mcpServers": {
"website-downloader": {
"command": "npx",
"args": ["-y", "website-downloader"]
}
}
}Prompts to try
Use these prompts with Claude after connecting the Website Downloader MCP server.
- "Download the entire Node.js documentation site from https://nodejs.org/en/docs to ~/website-downloads/nodejs-docs."
- "Mirror https://docs.example.com with a maximum depth of 3 levels and save it to /tmp/docs-mirror."
- "Download https://en.wikipedia.org/wiki/Rust_(programming_language) with depth 1 so I can read it offline."
- "Archive the React documentation from https://react.dev to my downloads folder, preserving all page structure."Troubleshooting Website Downloader
Error: wget not found or 'command not found: wget'
wget must be installed separately from the MCP server. On macOS run 'brew install wget', on Ubuntu/Debian run 'sudo apt-get install wget', on Windows install via Chocolatey ('choco install wget'). Verify with 'wget --version'.
Download runs but output directory is empty or partial
Ensure the outputPath directory exists and is writable. Some websites block wget's user agent โ if the download produces only an index.html with no assets, the target server may be restricting automated crawlers.
Download takes too long or uses too much disk space
Use the depth parameter to limit recursion (e.g. depth: 2 for two levels deep). Without a depth limit, the download is infinite and large sites can consume significant disk space. Always specify outputPath to a location with adequate free space.
Frequently Asked Questions about Website Downloader
What is Website Downloader?
Website Downloader is a Model Context Protocol (MCP) server that ๐๏ธ ๐ - this mcp server provides a tool to download entire websites using wget. it preserves the website structure and converts links to work locally. It connects AI assistants to external tools and data sources through a standardized interface.
How do I install Website Downloader?
Install via npm with the command: npx -y website-downloader. Then add the server configuration to your AI client's JSON config file (e.g., claude_desktop_config.json or .cursor/mcp.json).
Which AI clients work with Website Downloader?
Website Downloader works with all major MCP-compatible AI clients including Claude Desktop, Claude Code, Cursor, VS Code (GitHub Copilot), Windsurf, and Cline.
Is Website Downloader free to use?
Yes, Website Downloader is open source and available under the MIT license. You can use it freely in both personal and commercial projects.
Website Downloader Alternatives โ Similar Search & Data Extraction Servers
Looking for alternatives to Website Downloader? Here are other popular search & data extraction servers you can use with Claude, Cursor, and VS Code.
TrendRadar
โ 58.0kA real-time hotspot monitoring and news aggregation assistant that provides AI-powered analysis of trending topics across multiple platforms via the Model Context Protocol. It enables users to track news and receive automated notifications through va
Scrapling
โ 52.7k๐ท๏ธ An adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl!
PDF Math Translate
โ 33.9k[EMNLP 2025 Demo] PDF scientific paper translation with preserved formats - ๅบไบ AI ๅฎๆดไฟ็ๆ็็ PDF ๆๆกฃๅ จๆๅ่ฏญ็ฟป่ฏ๏ผๆฏๆ Google/DeepL/Ollama/OpenAI ็ญๆๅก๏ผๆไพ CLI/GUI/MCP/Docker/Zotero
GPT Researcher
โ 27.2kAn autonomous agent that conducts deep research on any data using any LLM providers
Agent Reach
โ 20.1kGive your AI agent eyes to see the entire internet. Read & search Twitter, Reddit, YouTube, GitHub, Bilibili, XiaoHongShu โ one CLI, zero API fees.
Xiaohongshu
โ 13.7kMCP for xiaohongshu.com
Browse More Search & Data Extraction MCP Servers
Explore all search & data extraction servers available in the MCPgee directory. Each server includes setup guides for Claude, Cursor, and VS Code.
Set Up Website Downloader in Your Editor
Choose your AI client for step-by-step setup instructions.
Quick Config Preview
Add this to your claude_desktop_config.json or .cursor/mcp.json
Ready to use Website Downloader?
Browse our complete directory of 33,000+ MCP servers, read setup guides for your editor, and start building with the Model Context Protocol.