MCPgee
MCPgee
MCPgeeMCPgee

Scrapegraph

v1.0.0•Search & Data Extraction•stable

ScapeGraph MCP Server

mcp-serverscrapingwebcrawler
Share:
73
Stars
0
Downloads
0
Weekly
0/5
View on GitHub

What is Scrapegraph?

Scrapegraph is a Model Context Protocol (MCP) server that allows AI assistants like Claude, Cursor, and VS Code to scapegraph mcp server

ScapeGraph MCP Server

This server falls under the Search & Data Extraction category on MCPgee, the world's largest MCP server directory with 33,000+ servers.

Features

  • ScapeGraph MCP Server

Use Cases

Scrape and crawl web content for data extraction.
ScrapeGraphAI

Maintainer

LicenseMIT
Languagepython
Versionv1.0.0
UpdatedMay 20, 2026
Statushealthy
Maintenanceactive

Works with

ClaudeOpenAIwindowsmacoslinux
View SourceBrowse All Servers

Installation

Manual Installation

npx scrapegraph

Configuration

Configuration Details

Config File

claude_desktop_config.json

Performance

Response Metrics

Response Time< 200ms
ThroughputMedium

Resource Usage

Memory UsageLow
CPU UsageLow

How to Set Up and Use Scrapegraph

The ScrapeGraph MCP server integrates the ScrapeGraph AI API into MCP-compatible AI clients, providing tools for AI-powered web scraping, structured data extraction, multi-page crawling, and web search. It connects to the ScrapeGraph API v2 and exposes tools like scrape, extract, search, crawl, and schema generation so that language models can retrieve and structure web content on demand without writing any scraping code.

Prerequisites

  • A ScrapeGraph AI account and API key from https://dashboard.scrapegraphai.com
  • Node.js with npx installed (for Smithery installation), or Python 3.13+ with pip
  • An MCP-compatible client such as Claude Desktop or Cursor
1

Obtain a ScrapeGraph API key

Create an account at the ScrapeGraph Dashboard and generate an API key. Keep this key available—it will be set as the SGAI_API_KEY environment variable or passed in the MCP config.

2

Install via Smithery (recommended)

Use the Smithery CLI to automatically install and configure the ScrapeGraph MCP server for Claude Desktop. Replace 'claude' with your client name if using Cursor or another client.

npx -y @smithery/cli install @ScrapeGraphAI/scrapegraph-mcp --client claude
3

Or configure manually in Claude Desktop

Open ~/Library/Application Support/Claude/claude_desktop_config.json (macOS) and add the ScrapeGraph server entry with your API key substituted in.

{
  "mcpServers": {
    "@ScrapeGraphAI-scrapegraph-mcp": {
      "command": "npx",
      "args": [
        "-y",
        "@smithery/cli@latest",
        "run",
        "@ScrapeGraphAI/scrapegraph-mcp",
        "--config",
        "{\"scrapegraphApiKey\":\"YOUR-SGAI-API-KEY\"}"
      ]
    }
  }
}
4

Or connect to the hosted remote server

For a no-install option, configure your client to connect to the ScrapeGraph hosted remote MCP server using your API key as an HTTP header.

{
  "mcpServers": {
    "scrapegraph-mcp": {
      "command": "npx",
      "args": [
        "[email protected]",
        "https://scrapegraph-mcp.onrender.com/mcp",
        "--header",
        "X-API-Key:YOUR_API_KEY"
      ]
    }
  }
}
5

Restart your MCP client and test a scrape

Restart Claude Desktop or your chosen client. Ask it to scrape or extract content from a URL to confirm the tools are working.

Scrapegraph Examples

Client configuration

Claude Desktop configuration using the Smithery runner with your ScrapeGraph API key inline.

{
  "mcpServers": {
    "@ScrapeGraphAI-scrapegraph-mcp": {
      "command": "npx",
      "args": [
        "-y",
        "@smithery/cli@latest",
        "run",
        "@ScrapeGraphAI/scrapegraph-mcp",
        "--config",
        "{\"scrapegraphApiKey\":\"YOUR-SGAI-API-KEY\"}"
      ]
    }
  }
}

Prompts to try

Example prompts to use with the ScrapeGraph MCP server once configured.

- "Convert https://scrapegraphai.com to markdown"
- "Extract all product names and prices from https://example-shop.com/products"
- "Search the web for the latest news about AI agents and summarize the top 5 results"
- "Crawl https://docs.example.com and extract all the page links"
- "Generate a JSON schema for extracting job listings from a careers page"

Troubleshooting Scrapegraph

API key errors or 401 Unauthorized responses

Ensure your SGAI_API_KEY is correct and your ScrapeGraph account is active. Check the dashboard at https://dashboard.scrapegraphai.com for key validity and remaining credits.

Tool names not recognized (e.g. 'smartscraper' not found)

The v3 server renames tools: use 'extract' instead of 'smartscraper', 'search' instead of 'searchscraper', and 'scrape' with output_format='markdown' instead of 'markdownify'. Ensure you are running the latest version of the server.

Timeout errors on large pages or slow sites

Set the SGAI_TIMEOUT environment variable to a larger value (e.g. 300 for 5 minutes). You can add this to the env block in your MCP config, or set it in your shell before starting the server.

Frequently Asked Questions about Scrapegraph

What is Scrapegraph?

Scrapegraph is a Model Context Protocol (MCP) server that scapegraph mcp server It connects AI assistants to external tools and data sources through a standardized interface.

How do I install Scrapegraph?

Follow the installation instructions on the Scrapegraph GitHub repository. Clone the repo, install dependencies, and add the server config to your AI client.

Which AI clients work with Scrapegraph?

Scrapegraph works with all major MCP-compatible AI clients including Claude Desktop, Claude Code, Cursor, VS Code (GitHub Copilot), Windsurf, and Cline.

Is Scrapegraph free to use?

Yes, Scrapegraph is open source and available under the MIT license. You can use it freely in both personal and commercial projects.

Learn More About MCP Servers

Getting Started with MCP

Set up your first MCP server in minutes

MCP Setup Guide

Configure MCP in Claude, Cursor & VS Code

All MCP Tutorials

18+ hands-on guides for developers

MCP FAQ

40+ answers about Model Context Protocol

Scrapegraph Alternatives — Similar Search & Data Extraction Servers

Looking for alternatives to Scrapegraph? Here are other popular search & data extraction servers you can use with Claude, Cursor, and VS Code.

TrendRadar

★ 58.0k

A real-time hotspot monitoring and news aggregation assistant that provides AI-powered analysis of trending topics across multiple platforms via the Model Context Protocol. It enables users to track news and receive automated notifications through va

Scrapling

★ 52.7k

🕷️ An adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl!

PDF Math Translate

★ 33.9k

[EMNLP 2025 Demo] PDF scientific paper translation with preserved formats - 基于 AI 完整保留排版的 PDF 文档全文双语翻译，支持 Google/DeepL/Ollama/OpenAI 等服务，提供 CLI/GUI/MCP/Docker/Zotero

GPT Researcher

★ 27.2k

An autonomous agent that conducts deep research on any data using any LLM providers

Agent Reach

★ 20.1k

Give your AI agent eyes to see the entire internet. Read & search Twitter, Reddit, YouTube, GitHub, Bilibili, XiaoHongShu — one CLI, zero API fees.

Xiaohongshu

★ 13.7k

MCP for xiaohongshu.com

Browse More Search & Data Extraction MCP Servers

Explore all search & data extraction servers available in the MCPgee directory. Each server includes setup guides for Claude, Cursor, and VS Code.

Search & Data ExtractionBrowse All Servers

Quick Config Preview

{ "mcpServers": { "scrapegraph": { "command": "npx", "args": ["-y", "scrapegraph"] } } }

Add this to your claude_desktop_config.json or .cursor/mcp.json

Read the full setup guide →

Ready to use Scrapegraph?

Browse our complete directory of 33,000+ MCP servers, read setup guides for your editor, and start building with the Model Context Protocol.

33,000+ ServersFree & Open SourceStep-by-Step Guides
Explore All ServersRead Our Guides