VLLM

v1.0.0Coding Agentsstable

Exposes vLLM capabilities to AI assistants, enabling chat completions, model management, and platform-aware container control with automatic detection of Docker/Podman and GPU availability across Linux, macOS, and Windows.

vllmmcpai-integration
Share:
6
Stars
0
Downloads
0
Weekly
0/5

What is VLLM?

VLLM is a Model Context Protocol (MCP) server that allows AI assistants like Claude, Cursor, and VS Code to exposes vllm capabilities to ai assistants, enabling chat completions, model management, and platform-aware container control with automatic detection of docker/podman and gpu availability across linu...

Exposes vLLM capabilities to AI assistants, enabling chat completions, model management, and platform-aware container control with automatic detection of Docker/Podman and GPU availability across Linux, macOS, and Windows.

This server falls under the Coding Agents category on MCPgee, the world's largest MCP server directory with 33,000+ servers.

Features

  • Exposes vLLM capabilities to AI assistants, enabling chat co

Use Cases

Run local language model inference with GPU support detection.
Chat with vLLM-hosted models and manage model lifecycle operations.
micytao

Maintainer

LicenseApache-2.0
Languagepython
Versionv1.0.0
UpdatedApr 18, 2026
Statushealthy
Maintenanceactive

Works with

ClaudeOpenAIwindowsmacoslinux

Installation

Manual Installation

npx vllm

Configuration

Configuration Details

Config File

claude_desktop_config.json

Performance

Response Metrics

Response Time< 200ms
ThroughputMedium

Resource Usage

Memory UsageLow
CPU UsageLow

Frequently Asked Questions about VLLM

What is VLLM?

VLLM is a Model Context Protocol (MCP) server that exposes vllm capabilities to ai assistants, enabling chat completions, model management, and platform-aware container control with automatic detection of docker/podman and gpu availability across linux, macos, and windows. It connects AI assistants to external tools and data sources through a standardized interface.

How do I install VLLM?

Follow the installation instructions on the VLLM GitHub repository. Clone the repo, install dependencies, and add the server config to your AI client.

Which AI clients work with VLLM?

VLLM works with all major MCP-compatible AI clients including Claude Desktop, Claude Code, Cursor, VS Code (GitHub Copilot), Windsurf, and Cline.

Is VLLM free to use?

Yes, VLLM is open source and available under the Apache-2.0 license. You can use it freely in both personal and commercial projects.

Browse More Coding Agents MCP Servers

Explore all coding agents servers available in the MCPgee directory. Each server includes setup guides for Claude, Cursor, and VS Code.

Quick Config Preview

{ "mcpServers": { "vllm": { "command": "npx", "args": ["-y", "vllm"] } } }

Add this to your claude_desktop_config.json or .cursor/mcp.json

Read the full setup guide →

Ready to use VLLM?

Browse our complete directory of 33,000+ MCP servers, read setup guides for your editor, and start building with the Model Context Protocol.

33,000+ ServersFree & Open SourceStep-by-Step Guides