Redd Archiver

v1.0.0Search & Data Extractionstable

A PostgreSQL-backed archive generator that creates browsable HTML archives from link aggregator platforms including Reddit, Voat, and Ruqqus.

archivalarchivedata-preservationdockerfull-text-search
Share:
334
Stars
0
Downloads
0
Weekly
0/5

What is Redd Archiver?

Redd Archiver is a Model Context Protocol (MCP) server that allows AI assistants like Claude, Cursor, and VS Code to postgresql-backed archive generator that creates browsable html archives from link aggregator platforms including reddit, voat, and ruqqus.

A PostgreSQL-backed archive generator that creates browsable HTML archives from link aggregator platforms including Reddit, Voat, and Ruqqus.

This server falls under the Search & Data Extraction category on MCPgee, the world's largest MCP server directory with 33,000+ servers.

Features

  • A PostgreSQL-backed archive generator that creates browsable

Use Cases

Archive Reddit and link aggregators
Full-text search of archives
Browsable HTML archive generation
19-84

Maintainer

LicenseUnlicense
Languagepython
Versionv1.0.0
UpdatedMay 19, 2026
Statushealthy
Maintenanceactive

Works with

ClaudeOpenAIwindowsmacoslinux

Installation

Manual Installation

npx redd-archiver

Configuration

Configuration Details

Config File

claude_desktop_config.json

Performance

Response Metrics

Response Time< 200ms
ThroughputMedium

Resource Usage

Memory UsageLow
CPU UsageLow

How to Set Up and Use Redd Archiver

Redd Archiver is a PostgreSQL-backed archive generator that ingests link aggregator dump files from Reddit, Voat, and Ruqqus and produces fully self-contained, browsable HTML archives with full-text search, theme support, and 30+ REST API endpoints. It operates via Docker or a local Python environment, and exposes 29 MCP tools that give AI agents direct access to archived posts, comments, users, and subreddits — enabling conversational exploration of billions of archived social media posts without relying on live platform APIs.

Prerequisites

  • Docker and Docker Compose (recommended) or Python 3.10+ with PostgreSQL 14+
  • At least 4 GB RAM for processing large dump files
  • Archive dump files in .zst format (Reddit), SQL dump (Voat), or .7z (Ruqqus) from Academic Torrents or archive.org
  • An MCP-compatible client such as Claude Desktop or Claude Code
  • No external API keys required
1

Clone the repository and configure environment

Clone the repo and create your .env file from the example template. Edit the database credentials and any serving configuration you want to customize.

git clone https://github.com/19-84/redd-archiver.git
cd redd-archiver
mkdir -p data output/.postgres-data logs tor-public
cp .env.example .env
nano .env
2

Start the Docker stack

Bring up the full stack with Docker Compose. This starts the PostgreSQL database, the archive builder, and the web serving layer.

docker compose up -d
3

Import an archive dump

Run the archive builder to import a subreddit dump file. This example imports a Reddit privacy subreddit archive in .zst format.

docker compose exec reddarchiver-builder python reddarc.py /data \
  --subreddit privacy \
  --comments-file /data/privacy_comments.zst \
  --output /output/
4

Configure the MCP server

Add the redd-archiver MCP server to your client configuration. The server.py file in the mcp_server directory connects to your running archive via REDDARCHIVER_API_URL.

{
  "mcpServers": {
    "reddarchiver": {
      "command": "uv",
      "args": ["--directory", "/path/to/redd-archiver/mcp_server", "run", "python", "server.py"],
      "env": {
        "REDDARCHIVER_API_URL": "http://localhost:5000"
      }
    }
  }
}
5

Optional: set serving and theme preferences

Customize the archive appearance and serving behavior via environment variables. The server supports 11 color themes and hybrid or dynamic serving modes.

REDDARCHIVER_THEME=nord
REDDARCHIVER_SERVE_MODE=hybrid
REDDARCHIVER_HTTP_CACHE_MAX_AGE=3600

Redd Archiver Examples

Client configuration

MCP client configuration connecting to a locally running redd-archiver instance. Adjust the directory path to match where you cloned the repository.

{
  "mcpServers": {
    "reddarchiver": {
      "command": "uv",
      "args": ["--directory", "/home/user/redd-archiver/mcp_server", "run", "python", "server.py"],
      "env": {
        "REDDARCHIVER_API_URL": "http://localhost:5000"
      }
    }
  }
}

Prompts to try

Example prompts for exploring archived social media data through the 29 MCP tools.

- "Search the privacy subreddit archive for posts about VPNs from 2020"
- "List the top 10 most upvoted posts in the archive"
- "Find all comments by user throwaway12345 in the archive"
- "Show posts about data breaches and summarize the main concerns"
- "Export all posts from the programming subreddit to CSV"

Troubleshooting Redd Archiver

Docker Compose fails to start with database connection errors

Ensure the .postgres-data directory exists inside the output folder (`mkdir -p output/.postgres-data`). Check that the DATABASE_URL in your .env matches the PostgreSQL credentials configured in docker-compose.yml.

Import takes extremely long or runs out of memory

Reddit dumps can be terabytes in size. Process one subreddit at a time and ensure you have at least 4 GB RAM. Increase REDDARCHIVER_MAX_PARALLEL_WORKERS in .env to speed up batch processing on machines with more cores.

MCP server cannot reach the archive API

Verify the archive web server is running and accessible at the URL set in REDDARCHIVER_API_URL. If using Docker, the service may be on a different port or bind address — check `docker compose ps` to confirm the port mapping.

Frequently Asked Questions about Redd Archiver

What is Redd Archiver?

Redd Archiver is a Model Context Protocol (MCP) server that postgresql-backed archive generator that creates browsable html archives from link aggregator platforms including reddit, voat, and ruqqus. It connects AI assistants to external tools and data sources through a standardized interface.

How do I install Redd Archiver?

Follow the installation instructions on the Redd Archiver GitHub repository. Clone the repo, install dependencies, and add the server config to your AI client.

Which AI clients work with Redd Archiver?

Redd Archiver works with all major MCP-compatible AI clients including Claude Desktop, Claude Code, Cursor, VS Code (GitHub Copilot), Windsurf, and Cline.

Is Redd Archiver free to use?

Yes, Redd Archiver is open source and available under the Unlicense license. You can use it freely in both personal and commercial projects.

Browse More Search & Data Extraction MCP Servers

Explore all search & data extraction servers available in the MCPgee directory. Each server includes setup guides for Claude, Cursor, and VS Code.

Quick Config Preview

{ "mcpServers": { "redd-archiver": { "command": "npx", "args": ["-y", "redd-archiver"] } } }

Add this to your claude_desktop_config.json or .cursor/mcp.json

Read the full setup guide →

Ready to use Redd Archiver?

Browse our complete directory of 33,000+ MCP servers, read setup guides for your editor, and start building with the Model Context Protocol.

33,000+ ServersFree & Open SourceStep-by-Step Guides