Crawleo
Crawleo MCP Server - Real-Time Web Knowledge for AI Crawleo's Model Context Protocol (MCP) server enables AI assistants like Claude to access real-time web data directly through native tool integration.
What is Crawleo?
Crawleo is a Model Context Protocol (MCP) server that allows AI assistants like Claude, Cursor, and VS Code to crawleo mcp server - real-time web knowledge for ai crawleo's model context protocol (mcp) server enables ai assistants like claude to access real-time web data directly through native tool integratio...
Crawleo MCP Server - Real-Time Web Knowledge for AI Crawleo's Model Context Protocol (MCP) server enables AI assistants like Claude to access real-time web data directly through native tool integration.
This server falls under the Search & Data Extraction category on MCPgee, the world's largest MCP server directory with 33,000+ servers.
Features
- Crawleo MCP Server - Real-Time Web Knowledge for AI Crawleo'
Use Cases
Maintainer
Works with
Installation
Manual Installation
npx crawleo-mcpConfiguration
Configuration Details
claude_desktop_config.json
Performance
Response Metrics
Resource Usage
How to Set Up and Use Crawleo
Crawleo MCP Server connects AI assistants to real-time web data through two primary tools: web.search for live web searches with multi-format output and web.crawl for deep JavaScript-rendered content extraction from any URL. Obtain a Crawleo API key from crawleo.dev and add it to your MCP config to give Claude persistent access to the live web.
Prerequisites
- A Crawleo account with an API key (sign up at crawleo.dev, key begins with sk_)
- Node.js 18+ and npm installed
- Claude Desktop, Claude Code, or another MCP-compatible client
Obtain a Crawleo API key
Sign up at crawleo.dev and navigate to your dashboard to generate an API key. The key begins with 'sk_' and is required for all requests.
Install the Crawleo MCP package
Install the package globally via npm, or use npx to run it on demand without a global install.
npm install -g crawleo-mcp
# Or run without installing:
npx crawleo-mcpConfigure Claude Desktop
Add the Crawleo MCP server to your Claude Desktop configuration file with the CRAWLEO_API_KEY environment variable.
{
"mcpServers": {
"crawleo": {
"command": "npx",
"args": ["-y", "crawleo-mcp"],
"env": {
"CRAWLEO_API_KEY": "sk_your_api_key_here"
}
}
}
}Configure Claude Code CLI (alternative)
Register the server directly from the Claude Code CLI with the API key passed as an environment variable.
claude mcp add --scope user crawleo \
--env CRAWLEO_API_KEY=sk_your_api_key_here \
-- npx -y crawleo-mcpTest with a web search
Restart Claude and ask it to search for something current. Claude will use the web.search tool to return live results from the web.
Crawleo Examples
Client configuration
Claude Desktop configuration using npx to run crawleo-mcp on demand with the required API key.
{
"mcpServers": {
"crawleo": {
"command": "npx",
"args": ["-y", "crawleo-mcp"],
"env": {
"CRAWLEO_API_KEY": "sk_your_api_key_here"
}
}
}
}Prompts to try
Example prompts for real-time web searches, content extraction, and competitor research using Crawleo.
- "Search for recent developments in quantum computing from the past week and summarize the key findings"
- "Crawl the FastAPI documentation quickstart page and extract all the code examples"
- "Search for competitor pricing pages for project management tools and extract their pricing tiers"
- "Find today's top AI news stories from US sources and list them with brief summaries"
- "Extract all the product specifications from this e-commerce page: https://example.com/product"Troubleshooting Crawleo
401 Unauthorized or invalid API key error
Verify CRAWLEO_API_KEY starts with 'sk_' and matches the key shown in your Crawleo dashboard exactly. Regenerate the key if needed. Ensure the env variable is set in the MCP config, not just in your shell profile.
web.crawl returns empty content for JavaScript-heavy sites
Crawleo uses JavaScript rendering by default, but some SPAs may need extra load time. Try the web.search tool first to find the canonical URL, then crawl that specific URL. Request Markdown output format for cleaner extraction from rendered pages.
npx crawleo-mcp hangs on first run
The first run downloads the package, which may take a moment on slow connections. If it hangs for more than 60 seconds, check your npm registry access with: npm ping. Alternatively, install globally first with npm install -g crawleo-mcp, then change the command to 'crawleo-mcp' with empty args.
Frequently Asked Questions about Crawleo
What is Crawleo?
Crawleo is a Model Context Protocol (MCP) server that crawleo mcp server - real-time web knowledge for ai crawleo's model context protocol (mcp) server enables ai assistants like claude to access real-time web data directly through native tool integration. It connects AI assistants to external tools and data sources through a standardized interface.
How do I install Crawleo?
Follow the installation instructions on the Crawleo GitHub repository. Clone the repo, install dependencies, and add the server config to your AI client.
Which AI clients work with Crawleo?
Crawleo works with all major MCP-compatible AI clients including Claude Desktop, Claude Code, Cursor, VS Code (GitHub Copilot), Windsurf, and Cline.
Is Crawleo free to use?
Yes, Crawleo is open source and available under the MIT license. You can use it freely in both personal and commercial projects.
Crawleo Alternatives — Similar Search & Data Extraction Servers
Looking for alternatives to Crawleo? Here are other popular search & data extraction servers you can use with Claude, Cursor, and VS Code.
TrendRadar
★ 58.0kA real-time hotspot monitoring and news aggregation assistant that provides AI-powered analysis of trending topics across multiple platforms via the Model Context Protocol. It enables users to track news and receive automated notifications through va
Scrapling
★ 52.7k🕷️ An adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl!
PDF Math Translate
★ 33.9k[EMNLP 2025 Demo] PDF scientific paper translation with preserved formats - 基于 AI 完整保留排版的 PDF 文档全文双语翻译，支持 Google/DeepL/Ollama/OpenAI 等服务，提供 CLI/GUI/MCP/Docker/Zotero
GPT Researcher
★ 27.2kAn autonomous agent that conducts deep research on any data using any LLM providers
Agent Reach
★ 20.1kGive your AI agent eyes to see the entire internet. Read & search Twitter, Reddit, YouTube, GitHub, Bilibili, XiaoHongShu — one CLI, zero API fees.
Xiaohongshu
★ 13.7kMCP for xiaohongshu.com
Browse More Search & Data Extraction MCP Servers
Explore all search & data extraction servers available in the MCPgee directory. Each server includes setup guides for Claude, Cursor, and VS Code.
Set Up Crawleo in Your Editor
Choose your AI client for step-by-step setup instructions.
Quick Config Preview
Add this to your claude_desktop_config.json or .cursor/mcp.json
Ready to use Crawleo?
Browse our complete directory of 33,000+ MCP servers, read setup guides for your editor, and start building with the Model Context Protocol.