How do I install HumanJudge MCP Server?

Follow the setup instructions on the HumanJudge GitHub repository, then add the server configuration to your AI client.

What category is HumanJudge MCP Server?

HumanJudge is categorized under Analytics. Browse more servers in these categories on MCPgee.

HumanJudge

Name: HumanJudge
Author: humanjudge

v1.0.0•Analytics•stable

Human-evaluation infrastructure for AI quality. 25,000+ blind human reviews by 200+ verified reviewers across 58 AI models — query the data via five MCP tools (get_model_scores, compare_models, get_flags, check_content, get_latest).

humanjudgemcpai-integration

Stars

Downloads

Weekly

0/5

View on GitHub

What is HumanJudge?

HumanJudge is a Model Context Protocol (MCP) server that allows AI assistants like Claude, Cursor, and VS Code to human-evaluation infrastructure for ai quality. 25,000+ blind human reviews by 200+ verified reviewers across 58 ai models — query the data via five mcp tools (get_model_scores, compare_models, get_fl...

This server falls under the Analytics category on MCPgee, the world's largest MCP server directory with 33,000+ servers.

Features

Human-evaluation infrastructure for AI quality. 25,000+ blin

Use Cases

Query scores from 25,000+ human reviews of 58 AI models.

Compare model performance using blind human evaluation data.

humanjudge

Maintainer

LicenseMIT License

Languagetypescript

Versionv1.0.0

UpdatedN/A

Statushealthy

Maintenanceactive

Works with

ClaudeOpenAIwindowsmacoslinux

View Source Browse All Servers

Installation

Manual Installation

npx humanjudge

Configuration

Configuration Details

Config File

claude_desktop_config.json

Performance

Response Metrics

Response Time< 200ms

ThroughputMedium

Resource Usage

Memory UsageLow

CPU UsageLow

Frequently Asked Questions about HumanJudge

What is HumanJudge?

HumanJudge is a Model Context Protocol (MCP) server that human-evaluation infrastructure for ai quality. 25,000+ blind human reviews by 200+ verified reviewers across 58 ai models — query the data via five mcp tools (get_model_scores, compare_models, get_flags, check_content, get_latest). It connects AI assistants to external tools and data sources through a standardized interface.

How do I install HumanJudge?

Follow the installation instructions on the HumanJudge GitHub repository. Clone the repo, install dependencies, and add the server config to your AI client.

Which AI clients work with HumanJudge?

HumanJudge works with all major MCP-compatible AI clients including Claude Desktop, Claude Code, Cursor, VS Code (GitHub Copilot), Windsurf, and Cline.

Is HumanJudge free to use?

Yes, HumanJudge is open source and available under the MIT License license. You can use it freely in both personal and commercial projects.

Learn More About MCP Servers

Getting Started with MCP

Set up your first MCP server in minutes

MCP Setup Guide

Configure MCP in Claude, Cursor & VS Code

All MCP Tutorials

18+ hands-on guides for developers

MCP FAQ

40+ answers about Model Context Protocol

HumanJudge Alternatives — Similar Analytics Servers

Looking for alternatives to HumanJudge? Here are other popular analytics servers you can use with Claude, Cursor, and VS Code.

OpenMetadata

★ 14.0k

OpenMetadata is a unified metadata platform for data discovery, data observability, and data governance powered by a central metadata repository, in-depth column level lineage, and seamless team collaboration.

Superset

★ 10.9k

An MCP server that provides AI assistants with full access to Apache Superset instances, enabling interaction with dashboards, charts, datasets, databases, and SQL execution capabilities.

Horizon

★ 4.4k

📡 Your own AI-powered news radar. Generates daily briefings in English & Chinese. | 用 AI 构建你专属的新闻雷达

MCP Server Chart

★ 4.1k

Enables generation of 25+ types of charts and data visualizations using AntV, including bar charts, line charts, maps, mind maps, and specialized diagrams like fishbone and sankey charts. Supports both statistical charts and geographic visualizations

Muapi CLI

★ 997

Official CLI for muapi.ai — generate images, videos & audio from the terminal. MCP server, 14 AI models, npm + pip installable.

Weather MCP Server

★ 907

Weather Data Fetcher MCP server built with Node.js, MCP SDK, and Zod. Provides weather details like temperature and forecast for cities such as Noida and Delhi via a registered tool. Simplifies API integration, enabling structured responses for clien

Browse More Analytics MCP Servers

Explore all analytics servers available in the MCPgee directory. Each server includes setup guides for Claude, Cursor, and VS Code.

Analytics Browse All Servers

Set Up HumanJudge in Your Editor

Choose your AI client for step-by-step setup instructions.

🖥️

Claude Desktop

macOS & Windows app

⌨️

Claude Code

CLI & terminal

📝

Cursor

AI-first code editor

💻

VS Code

GitHub Copilot MCP

🏄

Windsurf

Codeium AI editor

🔌

Cline

VS Code extension

Quick Config Preview

{
  "mcpServers": {
    "humanjudge": {
      "command": "npx",
      "args": ["-y", "humanjudge"]
    }
  }
}

Add this to your claude_desktop_config.json or .cursor/mcp.json

Read the full setup guide →

Ready to use HumanJudge?

Browse our complete directory of 33,000+ MCP servers, read setup guides for your editor, and start building with the Model Context Protocol.

33,000+ ServersFree & Open SourceStep-by-Step Guides

Explore All Servers Read Our Guides