Oxylabs Web Scraper
A scraper tool that leverages the Oxylabs Web Scraper API to fetch and process web content with flexible options for parsing and rendering pages, enabling efficient content extraction from complex websites.
What is Oxylabs Web Scraper?
Oxylabs Web Scraper is a Model Context Protocol (MCP) server that allows AI assistants like Claude, Cursor, and VS Code to scraper tool that leverages the oxylabs web scraper api to fetch and process web content with flexible options for parsing and rendering pages, enabling efficient content extraction from complex websi...
A scraper tool that leverages the Oxylabs Web Scraper API to fetch and process web content with flexible options for parsing and rendering pages, enabling efficient content extraction from complex websites.
This server falls under the Search & Data Extraction category on MCPgee, the world's largest MCP server directory with 33,000+ servers.
Features
- A scraper tool that leverages the Oxylabs Web Scraper API to
Use Cases
Maintainer
Works with
Installation
NPM
npx -y oxylabs-mcpPIP
pip install oxylabs-mcpManual Installation
npx -y oxylabs-mcpConfiguration
Configuration Details
claude_desktop_config.json
Performance
Response Metrics
Resource Usage
How to Set Up and Use Oxylabs Web Scraper
The Oxylabs MCP Server (oxylabs-mcp) is the official Python-based integration between Oxylabs' Web Scraper API and AI assistants via the Model Context Protocol. It supports universal web scraping, Google and Amazon search result extraction, Amazon product page scraping, and AI-powered scraping via Oxylabs AI Studio — enabling AI agents to extract structured data from any website, including JavaScript-rendered pages, with built-in proxy rotation and geographic targeting handled transparently by Oxylabs' infrastructure.
Prerequisites
- uv Python package manager installed (recommended) or pip with Python 3.10+
- An Oxylabs Web Scraper API account with a username and password (1-week free trial at oxylabs.io)
- Optionally an Oxylabs AI Studio API key for ai_scraper, ai_crawler, ai_browser_agent, and ai_search tools
- An MCP client such as Claude Desktop, Cursor, or Cline
Install uv (recommended method)
uv is the recommended way to run oxylabs-mcp because uvx handles the Python environment automatically. Install it with the official install script.
curl -LsSf https://astral.sh/uv/install.sh | shOr install via pip
If you prefer pip, install the package directly. Python 3.10 or later is required.
pip install oxylabs-mcpObtain your Oxylabs credentials
Log into app.oxylabs.io and note your Web Scraper API username and password. If you want AI Studio tools, also copy your AI Studio API key. Only include credentials for tools you plan to use.
Configure your MCP client
Open your MCP client config file (for Claude Desktop on macOS: ~/Library/Application Support/Claude/claude_desktop_config.json) and add the oxylabs server entry using uvx.
{
"mcpServers": {
"oxylabs": {
"command": "uvx",
"args": ["oxylabs-mcp"],
"env": {
"OXYLABS_USERNAME": "your_username",
"OXYLABS_PASSWORD": "your_password",
"OXYLABS_AI_STUDIO_API_KEY": "your_ai_studio_key"
}
}
}
}Restart your MCP client and test
Restart Claude Desktop or your MCP client. The tools that appear will depend on which credentials you provided. Try asking the AI to scrape a URL to confirm the server is connected.
Oxylabs Web Scraper Examples
Client configuration
Full Claude Desktop configuration for Oxylabs MCP using uvx with both Web Scraper API and AI Studio credentials.
{
"mcpServers": {
"oxylabs": {
"command": "uvx",
"args": ["oxylabs-mcp"],
"env": {
"OXYLABS_USERNAME": "your_username",
"OXYLABS_PASSWORD": "your_password",
"OXYLABS_AI_STUDIO_API_KEY": "your_ai_studio_key",
"LOG_LEVEL": "INFO"
}
}
}
}Prompts to try
Ask your AI assistant to extract web data using Oxylabs' scraping infrastructure.
- "Scrape https://www.amazon.com/dp/B09G9FPHY6 and return the product title, price, and rating"
- "Search Amazon for 'mechanical keyboard' and list the top 5 results with prices"
- "Get Google Search results for 'Python MCP server tutorial' from a US location"
- "Use the universal scraper to fetch and parse https://news.ycombinator.com into clean text"
- "Use the AI browser agent to fill out the search form on example.com and return the results"Troubleshooting Oxylabs Web Scraper
uvx command not found after installing uv
Close and reopen your terminal after installing uv. If still missing, add ~/.local/bin to your PATH: export PATH="$HOME/.local/bin:$PATH" (add to ~/.zshrc or ~/.bashrc for persistence).
Scraping requests fail with 401 or credential errors
Your OXYLABS_USERNAME and OXYLABS_PASSWORD are your Web Scraper API credentials, not your Oxylabs.io login email/password. Retrieve them from app.oxylabs.io under the API Access section.
Only some tools appear in the client, others are missing
Tools are gated by which credentials are present. Web Scraper API tools (universal_scraper, google_search_scraper, amazon_search_scraper, amazon_product_scraper) require OXYLABS_USERNAME and OXYLABS_PASSWORD. AI Studio tools (ai_scraper, ai_crawler, ai_browser_agent, ai_search) require OXYLABS_AI_STUDIO_API_KEY. Remove unused credential variables to avoid exposing non-functional tools.
Frequently Asked Questions about Oxylabs Web Scraper
What is Oxylabs Web Scraper?
Oxylabs Web Scraper is a Model Context Protocol (MCP) server that scraper tool that leverages the oxylabs web scraper api to fetch and process web content with flexible options for parsing and rendering pages, enabling efficient content extraction from complex websites. It connects AI assistants to external tools and data sources through a standardized interface.
How do I install Oxylabs Web Scraper?
Install via npm with the command: npx -y oxylabs-mcp. Then add the server configuration to your AI client's JSON config file (e.g., claude_desktop_config.json or .cursor/mcp.json).
Which AI clients work with Oxylabs Web Scraper?
Oxylabs Web Scraper works with all major MCP-compatible AI clients including Claude Desktop, Claude Code, Cursor, VS Code (GitHub Copilot), Windsurf, and Cline.
Is Oxylabs Web Scraper free to use?
Yes, Oxylabs Web Scraper is open source and available under the MIT License license. You can use it freely in both personal and commercial projects.
Oxylabs Web Scraper Alternatives — Similar Search & Data Extraction Servers
Looking for alternatives to Oxylabs Web Scraper? Here are other popular search & data extraction servers you can use with Claude, Cursor, and VS Code.
TrendRadar
★ 58.0kA real-time hotspot monitoring and news aggregation assistant that provides AI-powered analysis of trending topics across multiple platforms via the Model Context Protocol. It enables users to track news and receive automated notifications through va
Scrapling
★ 52.7k🕷️ An adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl!
PDF Math Translate
★ 33.9k[EMNLP 2025 Demo] PDF scientific paper translation with preserved formats - 基于 AI 完整保留排版的 PDF 文档全文双语翻译，支持 Google/DeepL/Ollama/OpenAI 等服务，提供 CLI/GUI/MCP/Docker/Zotero
GPT Researcher
★ 27.2kAn autonomous agent that conducts deep research on any data using any LLM providers
Agent Reach
★ 20.1kGive your AI agent eyes to see the entire internet. Read & search Twitter, Reddit, YouTube, GitHub, Bilibili, XiaoHongShu — one CLI, zero API fees.
Xiaohongshu
★ 13.7kMCP for xiaohongshu.com
Browse More Search & Data Extraction MCP Servers
Explore all search & data extraction servers available in the MCPgee directory. Each server includes setup guides for Claude, Cursor, and VS Code.
Set Up Oxylabs Web Scraper in Your Editor
Choose your AI client for step-by-step setup instructions.
Quick Config Preview
Add this to your claude_desktop_config.json or .cursor/mcp.json
Ready to use Oxylabs Web Scraper?
Browse our complete directory of 33,000+ MCP servers, read setup guides for your editor, and start building with the Model Context Protocol.