OpenInference

v0.2.16Monitoring & Observabilitystable

OpenTelemetry Instrumentation for AI Observability

aiopsgeminihacktoberfesthaystacklangchain
Share:
986
Stars
0
Downloads
0
Weekly
0/5

What is OpenInference?

OpenInference is a Model Context Protocol (MCP) server that allows AI assistants like Claude, Cursor, and VS Code to opentelemetry instrumentation for ai observability

OpenTelemetry Instrumentation for AI Observability

This server falls under the Monitoring & Observability category on MCPgee, the world's largest MCP server directory with 33,000+ servers.

Features

  • OpenTelemetry Instrumentation for AI Observability

Use Cases

OpenTelemetry instrumentation for AI
LLM observability and performance tracking
Arize-ai

Maintainer

LicenseApache-2.0
Languagepython
Versionv0.2.16
UpdatedMay 22, 2026
Statushealthy
Maintenanceactive

Works with

ClaudeOpenAIwindowsmacoslinux

Installation

NPM

npx -y @arizeai/openinference-instrumentation-mcp

Manual Installation

npx -y @arizeai/openinference-instrumentation-mcp

Configuration

Configuration Details

Config File

claude_desktop_config.json

Performance

Response Metrics

Response Time< 200ms
ThroughputMedium

Resource Usage

Memory UsageLow
CPU UsageLow

How to Set Up and Use OpenInference

OpenInference is an open-source observability framework built on top of OpenTelemetry that adds AI-specific tracing conventions for LLM applications, agents, and MCP interactions. The `openinference-instrumentation-mcp` package instruments Model Context Protocol client-server communications, capturing span-level traces of every tool call, protocol message, and response so teams can debug, monitor, and optimize their AI pipelines. It integrates natively with Arize Phoenix, Arize AX, and any OpenTelemetry-compatible observability backend, making it the standard instrumentation layer for production LLM applications built on LangChain, LlamaIndex, LangGraph, and Haystack.

Prerequisites

  • Python 3.8+ with pip
  • An OpenTelemetry-compatible observability backend: Arize Phoenix (open source), Arize AX, Jaeger, or any OTLP-compatible collector
  • An existing Python application using MCP client libraries
  • Optional: Node.js 18+ for the npm package (@arizeai/openinference-instrumentation-mcp)
1

Install the Python MCP instrumentation package

Install openinference-instrumentation-mcp via pip. This adds OpenTelemetry spans for all MCP protocol interactions in your Python application.

pip install openinference-instrumentation-mcp
2

Or install the npm package for Node.js projects

For TypeScript or JavaScript MCP applications, install the npm package instead.

npm install @arizeai/openinference-instrumentation-mcp
3

Set up an OpenTelemetry tracer provider

Configure your application with an OTLP exporter pointing to your observability backend. Arize Phoenix can be run locally for development.

from opentelemetry import trace
from opentelemetry.sdk.trace import TracerProvider
from opentelemetry.exporter.otlp.proto.http.trace_exporter import OTLPSpanExporter
from opentelemetry.sdk.trace.export import SimpleSpanProcessor

provider = TracerProvider()
exporter = OTLPSpanExporter(endpoint="http://localhost:6006/v1/traces")
provider.add_span_processor(SimpleSpanProcessor(exporter))
trace.set_tracer_provider(provider)
4

Instrument your MCP client

Apply the MCP instrumentor to automatically capture traces for all MCP tool calls and protocol messages without modifying individual call sites.

from openinference.instrumentation.mcp import MCPInstrumentor

MCPInstrumentor().instrument()
5

Run your application and view traces

Start your MCP-powered application. All client-server interactions will be traced and visible in your configured observability backend (e.g. Arize Phoenix at http://localhost:6006).

# Start Phoenix locally
pip install arize-phoenix
python -m phoenix.server.main serve
# Then run your instrumented application

OpenInference Examples

Client configuration

MCP server configuration for the OpenInference instrumentation server when used as an MCP server component.

{
  "mcpServers": {
    "openinference": {
      "command": "npx",
      "args": ["-y", "@arizeai/openinference-instrumentation-mcp"]
    }
  }
}

Prompts to try

Once OpenInference instrumentation is active in your AI application, you can query trace data and analyze behavior.

- "Show me all MCP tool calls made in the last hour that took more than 2 seconds"
- "Which MCP tools are being called most frequently in my agent pipeline?"
- "Find any MCP interactions that returned errors in today's traces"
- "Compare the latency of tool calls between my local and remote MCP servers"

Troubleshooting OpenInference

No traces appearing in the observability backend

Ensure MCPInstrumentor().instrument() is called before any MCP client connections are established. Verify the OTLP endpoint URL is correct and the observability backend is running and reachable.

Sensitive data appearing in traces

OpenInference supports OPENINFERENCE_HIDE_* environment variables to suppress or mask sensitive fields. Set OPENINFERENCE_HIDE_INPUT_TEXT=true or OPENINFERENCE_HIDE_OUTPUT_TEXT=true to redact content from spans.

Import error: 'openinference.instrumentation.mcp' not found

Ensure you installed the correct package: 'pip install openinference-instrumentation-mcp'. The package name uses hyphens but the Python import uses underscores.

Frequently Asked Questions about OpenInference

What is OpenInference?

OpenInference is a Model Context Protocol (MCP) server that opentelemetry instrumentation for ai observability It connects AI assistants to external tools and data sources through a standardized interface.

How do I install OpenInference?

Install via npm with the command: npx -y @arizeai/openinference-instrumentation-mcp. Then add the server configuration to your AI client's JSON config file (e.g., claude_desktop_config.json or .cursor/mcp.json).

Which AI clients work with OpenInference?

OpenInference works with all major MCP-compatible AI clients including Claude Desktop, Claude Code, Cursor, VS Code (GitHub Copilot), Windsurf, and Cline.

Is OpenInference free to use?

Yes, OpenInference is open source and available under the Apache-2.0 license. You can use it freely in both personal and commercial projects.

Browse More Monitoring & Observability MCP Servers

Explore all monitoring & observability servers available in the MCPgee directory. Each server includes setup guides for Claude, Cursor, and VS Code.

Quick Config Preview

{ "mcpServers": { "openinference": { "command": "npx", "args": ["-y", "@arizeai/openinference-instrumentation-mcp"] } } }

Add this to your claude_desktop_config.json or .cursor/mcp.json

Read the full setup guide →

Ready to use OpenInference?

Browse our complete directory of 33,000+ MCP servers, read setup guides for your editor, and start building with the Model Context Protocol.

33,000+ ServersFree & Open SourceStep-by-Step Guides