Web Browser
A Minimum Control Program (MCP) server implementation for web browsing capabilities using BeautifulSoup4
What is Web Browser?
Web Browser is a Model Context Protocol (MCP) server that allows AI assistants like Claude, Cursor, and VS Code to minimum control program (mcp) server implementation for web browsing capabilities using beautifulsoup4
A Minimum Control Program (MCP) server implementation for web browsing capabilities using BeautifulSoup4
This server falls under the Browser Automation category on MCPgee, the world's largest MCP server directory with 33,000+ servers.
Features
- A Minimum Control Program (MCP) server implementation for we
Use Cases
Maintainer
Works with
Installation
NPM
npx -y web-browser-mcp-serverManual Installation
npx -y web-browser-mcp-serverConfiguration
Configuration Details
claude_desktop_config.json
Performance
Response Metrics
Resource Usage
How to Set Up and Use Web Browser
web-browser-mcp-server is a lightweight Python MCP server that gives AI assistants the ability to fetch and parse web pages using BeautifulSoup4. It exposes a browse_webpage tool that retrieves page content, extracts metadata (titles, links), and supports CSS selector-based targeting to pull specific elements like headlines, article text, or navigation links. Developers use it to let AI agents read live web content, scrape structured data, and gather information from URLs without a full headless browser.
Prerequisites
- Python 3.11 or higher
- uv package manager (https://astral.sh/uv)
- An MCP-compatible client such as Claude Desktop or Cursor
- Internet access for the server to fetch web pages
Install via uv
Install the web-browser-mcp-server package as a uv tool so it is available as a command.
uv tool install web-browser-mcp-serverAdd the server to your MCP client configuration
Open your claude_desktop_config.json (or equivalent) and add the server entry. The server runs via `uv tool run` and accepts an optional REQUEST_TIMEOUT environment variable.
{
"mcpServers": {
"web-browser-mcp-server": {
"command": "uv",
"args": ["tool", "run", "web-browser-mcp-server"],
"env": {
"REQUEST_TIMEOUT": "30"
}
}
}
}Alternative: install via Smithery
You can also install using Smithery which handles the Claude Desktop configuration automatically.
npx -y @smithery/cli install web-browser-mcp-server --client claudeRestart Claude Desktop
Restart your MCP client so the server is loaded. The browse_webpage tool will appear in the tool list once the server starts successfully.
Browse web pages from your AI client
Ask your AI assistant to fetch a URL. The browse_webpage tool supports basic page retrieval and optional CSS selectors for targeted extraction of specific page elements.
Web Browser Examples
Client configuration
Claude Desktop configuration using uv tool run with a 30-second request timeout.
{
"mcpServers": {
"web-browser-mcp-server": {
"command": "uv",
"args": ["tool", "run", "web-browser-mcp-server"],
"env": {
"REQUEST_TIMEOUT": "30"
}
}
}
}Prompts to try
Example prompts for browsing and extracting web content.
- "Fetch the content of https://example.com and summarize it"
- "Get the headlines from https://news.ycombinator.com using the .titleline selector"
- "Browse https://docs.python.org/3/library/json.html and extract the main article text"
- "Fetch https://github.com/trending and list the top 5 trending repositories"
- "Read https://httpbin.org/get and show me the response headers and metadata"Troubleshooting Web Browser
browse_webpage times out on slow sites
Increase the REQUEST_TIMEOUT environment variable in your config. The default is 30 seconds; set it to 60 or higher for slow or large pages: `"REQUEST_TIMEOUT": "60"`.
uv tool run web-browser-mcp-server: command not found
Ensure uv is installed (`which uv`) and the package is installed (`uv tool list`). If the tool is not listed, run `uv tool install web-browser-mcp-server` first, then restart your MCP client.
CSS selector returns no results
Verify the selector against the page's actual HTML — some sites use dynamically generated class names that change. Try a broader selector or use the page title/link extraction instead, which works without selectors.
Frequently Asked Questions about Web Browser
What is Web Browser?
Web Browser is a Model Context Protocol (MCP) server that minimum control program (mcp) server implementation for web browsing capabilities using beautifulsoup4 It connects AI assistants to external tools and data sources through a standardized interface.
How do I install Web Browser?
Install via npm with the command: npx -y web-browser-mcp-server. Then add the server configuration to your AI client's JSON config file (e.g., claude_desktop_config.json or .cursor/mcp.json).
Which AI clients work with Web Browser?
Web Browser works with all major MCP-compatible AI clients including Claude Desktop, Claude Code, Cursor, VS Code (GitHub Copilot), Windsurf, and Cline.
Is Web Browser free to use?
Yes, Web Browser is open source and available under the MIT License license. You can use it freely in both personal and commercial projects.
Web Browser Alternatives — Similar Browser Automation Servers
Looking for alternatives to Web Browser? Here are other popular browser automation servers you can use with Claude, Cursor, and VS Code.
Chrome DevTools MCP
★ 40.6kAI-powered Chrome automation server with natural language element detection. Control Chrome browser through MCP protocol for testing, debugging, and performance analysis. Features 91% accuracy in element location, works with free AI models, and suppo
UI TARS Desktop
★ 34.9k📇 🏠 - Browser automation capabilities using Puppeteer, both support local and remote browser connection.
Playwright
★ 32.8kA production-ready browser automation server that enables AI assistants to interact with web pages using tools for navigation, element interaction, and data extraction. It features a built-in Inspector UI and robust crash recovery for reliable automa
Page Agent
★ 18.0kJavaScript in-page GUI agent. Control web interfaces with natural language.
Chrome
★ 11.7kAn extension-based MCP server that enables AI assistants to control your browser, leveraging existing sessions and login states for automation and content analysis. It provides over 20 tools for semantic tab search, interactive element manipulation,
LAMDA
★ 7.8kThe most powerful Android RPA agent framework, next generation mobile automation.
Browse More Browser Automation MCP Servers
Explore all browser automation servers available in the MCPgee directory. Each server includes setup guides for Claude, Cursor, and VS Code.
Set Up Web Browser in Your Editor
Choose your AI client for step-by-step setup instructions.
Quick Config Preview
Add this to your claude_desktop_config.json or .cursor/mcp.json
Ready to use Web Browser?
Browse our complete directory of 33,000+ MCP servers, read setup guides for your editor, and start building with the Model Context Protocol.