crawl-mcp-server

v1.0.0APIsstable

An MCP server for web content extraction that converts HTML pages into clean, LLM-optimized Markdown using Mozilla's Readability. It supports batch processing, intelligent multi-page crawling, and configurable caching while respecting robots.txt stan

crawlmcpai-integration
Share:
38
Stars
0
Downloads
0
Weekly
0/5

About

An MCP server for web content extraction that converts HTML pages into clean, LLM-optimized Markdown using Mozilla's Readability. It supports batch processing, intelligent multi-page crawling, and configurable caching while respecting robots.txt stan

Features

  • An MCP server for web content extraction that converts HTML

Use Cases

An MCP server for web content extraction that converts HTML pages into clean, LL
Git-Fg

Maintainer

LicenseMIT
Languagetypescript
Versionv1.0.0
UpdatedMay 6, 2026
Statushealthy
Maintenanceactive

Works with

ClaudeOpenAIwindowsmacoslinux

Installation

Manual Installation

npx crawl

Examples

No examples available for this server.

Configuration

Configuration Details

Config File

claude_desktop_config.json

Web UI

Not available

Security

Authentication

RequiredNo

Features

Data Encryption
Audit Logging
RBAC Support

Performance

Response Metrics

Response Time< 200ms
ThroughputMedium

Resource Usage

Memory UsageLow
CPU UsageLow

More APIs MCP Servers

Explore other servers in the APIs category.

Quick Config Preview

{ "mcpServers": { "crawl": { "command": "npx", "args": ["-y", "crawl"] } } }

Add this to your claude_desktop_config.json or .cursor/mcp.json

Read the full setup guide →

Ready to use crawl-mcp-server?

Browse our complete directory of 33,000+ MCP servers, read setup guides for your editor, and start building with the Model Context Protocol.

33,000+ ServersFree & Open SourceStep-by-Step Guides