CortexScout
CortexScout is the Deep Research & Web Extraction module within the Cortex-Works ecosystem. Designed for agent workloads that require token-efficient web retrieval, reliable anti-bot handling, and optional Human-in-the-Loop (HITL) fallback.
What is CortexScout?
CortexScout is a Model Context Protocol (MCP) server that allows AI assistants like Claude, Cursor, and VS Code to cortexscout is the deep research & web extraction module within the cortex-works ecosystem. designed for agent workloads that require token-efficient web retrieval, reliable anti-bot handling, and opt...
CortexScout is the Deep Research & Web Extraction module within the Cortex-Works ecosystem. Designed for agent workloads that require token-efficient web retrieval, reliable anti-bot handling, and optional Human-in-the-Loop (HITL) fallback.
This server falls under the Search & Data Extraction category on MCPgee, the world's largest MCP server directory with 33,000+ servers.
Features
- CortexScout is the Deep Research & Web Extraction module wit
Use Cases
Maintainer
Works with
Installation
Manual Installation
npx cortexscoutConfiguration
Configuration Details
claude_desktop_config.json
Performance
Response Metrics
Resource Usage
How to Set Up and Use CortexScout
CortexScout is the deep research and web extraction module within the Cortex-Works ecosystem, delivered as a Rust-based MCP server optimized for token-efficient web retrieval in AI agent workloads. It offers multi-engine web search, batch and crawl-mode URL fetching with content filtering, structured field extraction, Playwright-backed browser automation, anti-bot bypass capabilities, and optional Human-in-the-Loop (HITL) fallback for sites that resist automation. AI developers and agent builders choose CortexScout when they need reliable, production-grade web access for autonomous research pipelines without the token overhead of raw HTML.
Prerequisites
- A prebuilt cortex-scout-mcp binary from the GitHub releases page, or Rust and the protobuf compiler for building from source
- Chromium, Chrome, or Brave browser installed for browser automation features
- An OpenAI-compatible API key (optional, for deep research LLM synthesis)
- An MCP-compatible client such as Claude Desktop, Cursor, or VS Code with MCP support
Download the prebuilt binary
Download the cortex-scout-mcp binary for your OS and architecture from the GitHub releases page and make it executable.
chmod +x cortex-scout-mcp
# Verify it runs
./cortex-scout-mcp --helpConfigure your MCP client
Add CortexScout to your MCP settings using the stdio transport. The binary is passed environment variables as arguments before the binary path.
{
"mcpServers": {
"cortex-scout": {
"type": "stdio",
"command": "env",
"args": [
"RUST_LOG=warn",
"MAX_CONTENT_CHARS=10000",
"SEARCH_ENGINES=google,bing,duckduckgo,brave",
"CORTEX_SCOUT_TOOL_TIMEOUT_SECS=90",
"/absolute/path/to/cortex-scout-mcp"
]
}
}
}Enable persistent memory (optional)
Set LANCEDB_URI to a directory path to persist research results across sessions. The memory_search tool will use this LanceDB-backed vector store for recall.
Enable deep research synthesis (optional)
Add OpenAI-compatible credentials to activate the deep_research tool, which performs multi-hop search and synthesizes a cited report.
Restart your MCP client and test
Restart Claude Desktop or your IDE. Ask the assistant to search the web for something simple to confirm CortexScout is connected and routing requests through the configured search engines.
CortexScout Examples
Client configuration
Full Claude Desktop configuration including deep research enabled via OpenAI and persistent LanceDB memory. Replace paths and keys with actual values.
{
"mcpServers": {
"cortex-scout": {
"type": "stdio",
"command": "env",
"args": [
"RUST_LOG=warn",
"MAX_CONTENT_CHARS=10000",
"SEARCH_ENGINES=google,bing,duckduckgo,brave",
"CORTEX_SCOUT_TOOL_TIMEOUT_SECS=90",
"LANCEDB_URI=/home/user/.cortex-scout/lancedb",
"DEEP_RESEARCH_ENABLED=1",
"OPENAI_API_KEY=sk-your-key-here",
"OPENAI_BASE_URL=https://api.openai.com/v1",
"DEEP_RESEARCH_LLM_MODEL=gpt-4o-mini",
"/absolute/path/to/cortex-scout-mcp"
]
}
}
}Prompts to try
These prompts show CortexScout's web search, extraction, browser automation, and deep research capabilities.
- "Search for recent benchmarks comparing Rust async runtimes and give me a summary."
- "Fetch https://news.ycombinator.com and extract the top 10 story titles and scores."
- "Do a deep research report with depth 2 on the current state of MCP server adoption."
- "Automate a browser session to navigate to GitHub, search for 'cortex-scout', and take a screenshot."
- "Extract the author, publication date, and main conclusion from each of these 5 research paper URLs."Troubleshooting CortexScout
Server exits immediately or MCP client shows it as disconnected
RUST_LOG must be set to 'warn'. Setting it to 'info' or 'debug' writes log lines to stderr which interferes with the MCP stdio protocol. Also verify the binary path in args is absolute and the file has execute permission.
Browser automation steps fail silently
CortexScout auto-detects Chrome, Chromium, or Brave. If none is found, set the CHROME_EXECUTABLE environment variable to the full path of your browser binary. For headless environments, ensure the browser supports headless mode.
Search returns no results for certain engines
Some search engines may block or throttle automated requests. Narrow the SEARCH_ENGINES variable to only the engines that are working (e.g. SEARCH_ENGINES=duckduckgo,brave). CortexScout will fall back automatically if one engine fails.
Frequently Asked Questions about CortexScout
What is CortexScout?
CortexScout is a Model Context Protocol (MCP) server that cortexscout is the deep research & web extraction module within the cortex-works ecosystem. designed for agent workloads that require token-efficient web retrieval, reliable anti-bot handling, and optional human-in-the-loop (hitl) fallback. It connects AI assistants to external tools and data sources through a standardized interface.
How do I install CortexScout?
Follow the installation instructions on the CortexScout GitHub repository. Clone the repo, install dependencies, and add the server config to your AI client.
Which AI clients work with CortexScout?
CortexScout works with all major MCP-compatible AI clients including Claude Desktop, Claude Code, Cursor, VS Code (GitHub Copilot), Windsurf, and Cline.
Is CortexScout free to use?
Yes, CortexScout is open source and available under the MIT License license. You can use it freely in both personal and commercial projects.
CortexScout Alternatives — Similar Search & Data Extraction Servers
Looking for alternatives to CortexScout? Here are other popular search & data extraction servers you can use with Claude, Cursor, and VS Code.
TrendRadar
★ 58.0kA real-time hotspot monitoring and news aggregation assistant that provides AI-powered analysis of trending topics across multiple platforms via the Model Context Protocol. It enables users to track news and receive automated notifications through va
Scrapling
★ 52.7k🕷️ An adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl!
PDF Math Translate
★ 33.9k[EMNLP 2025 Demo] PDF scientific paper translation with preserved formats - 基于 AI 完整保留排版的 PDF 文档全文双语翻译，支持 Google/DeepL/Ollama/OpenAI 等服务，提供 CLI/GUI/MCP/Docker/Zotero
GPT Researcher
★ 27.2kAn autonomous agent that conducts deep research on any data using any LLM providers
Agent Reach
★ 20.1kGive your AI agent eyes to see the entire internet. Read & search Twitter, Reddit, YouTube, GitHub, Bilibili, XiaoHongShu — one CLI, zero API fees.
Xiaohongshu
★ 13.7kMCP for xiaohongshu.com
Browse More Search & Data Extraction MCP Servers
Explore all search & data extraction servers available in the MCPgee directory. Each server includes setup guides for Claude, Cursor, and VS Code.
Set Up CortexScout in Your Editor
Choose your AI client for step-by-step setup instructions.
Quick Config Preview
Add this to your claude_desktop_config.json or .cursor/mcp.json
Ready to use CortexScout?
Browse our complete directory of 33,000+ MCP servers, read setup guides for your editor, and start building with the Model Context Protocol.