MAI UI

v1.0.0Coding Agentsstable

MAI-UI: Real-World Centric Foundation GUI Agents ranging from 2B to 235B

device-cloud-collaborationgui-agentgui-groundinggui-navigationmcp
Share:
1,809
Stars
0
Downloads
0
Weekly
0/5

What is MAI UI?

MAI UI is a Model Context Protocol (MCP) server that allows AI assistants like Claude, Cursor, and VS Code to mai-ui: real-world centric foundation gui agents ranging from 2b to 235b

MAI-UI: Real-World Centric Foundation GUI Agents ranging from 2B to 235B

This server falls under the Coding Agents category on MCPgee, the world's largest MCP server directory with 33,000+ servers.

Features

  • MAI-UI: Real-World Centric Foundation GUI Agents ranging fro

Use Cases

Build GUI agents with real-world centric foundation models.
Enable device-cloud collaboration and GUI navigation automation.
Tongyi-MAI

Maintainer

LicenseApache-2.0
Languagejupyter notebook
Versionv1.0.0
UpdatedMay 22, 2026
Statushealthy
Maintenanceactive

Works with

ClaudeOpenAIwindowsmacoslinux

Installation

Manual Installation

npx mai-ui

Configuration

Configuration Details

Config File

claude_desktop_config.json

Performance

Response Metrics

Response Time< 200ms
ThroughputMedium

Resource Usage

Memory UsageLow
CPU UsageLow

How to Set Up and Use MAI UI

MAI-UI provides real-world centric foundation GUI agents ranging from 2B to 235B parameters, enabling automated GUI navigation and grounding. When integrated with Claude, this server lets you build agents that interact with graphical user interfaces through natural language—automating desktop and web application testing and interaction workflows.

Prerequisites

  • Python 3.8+ installed
  • An MCP client such as Claude Desktop, Cursor, or VS Code
  • Machine learning and vision libraries (details in repository README)
1

Clone the MAI-UI repository

Clone the repository to access the GUI agent framework.

git clone https://github.com/Tongyi-MAI/MAI-UI.git
cd MAI-UI
2

Install dependencies

Install Python packages and any required system dependencies for GUI automation.

pip install -r requirements.txt
3

Configure your GUI environment

Set up the target application or interface that the agent will interact with.

4

Add MAI-UI to your MCP configuration

Register MAI-UI as an MCP server.

{
  "mcpServers": {
    "mai-ui": {
      "command": "python",
      "args": ["-m", "mai_ui"]
    }
  }
}
5

Test GUI agent capabilities

Ask Claude to interact with your target GUI to verify the agent is functioning correctly.

MAI UI Examples

Client Configuration Example

Configuration for MAI-UI in your MCP client:

{
  "mcpServers": {
    "mai-ui": {
      "command": "python",
      "args": ["-m", "mai_ui"]
    }
  }
}

Prompts to try

Example prompts for GUI agent automation:

1. "Navigate to the login page and enter username 'admin' and password 'test123'"
2. "Click on the Settings menu and take a screenshot of the current screen"
3. "Fill out the registration form with sample data and submit it"
4. "Perform a series of clicks to navigate to the user profile page and verify the user data"

Troubleshooting MAI UI

GUI grounding fails or detects wrong elements

Verify the target application is visible and stable. Adjust display resolution or GUI scaling if needed. Refer to the repository documentation for model-specific configuration tuning.

Agent actions are slow or unresponsive

Check system resources and ensure the ML model is running on a GPU if available. Larger models (235B) require significant memory; smaller models (2B) are faster for resource-constrained environments.

Frequently Asked Questions about MAI UI

What is MAI UI?

MAI UI is a Model Context Protocol (MCP) server that mai-ui: real-world centric foundation gui agents ranging from 2b to 235b It connects AI assistants to external tools and data sources through a standardized interface.

How do I install MAI UI?

Follow the installation instructions on the MAI UI GitHub repository. Clone the repo, install dependencies, and add the server config to your AI client.

Which AI clients work with MAI UI?

MAI UI works with all major MCP-compatible AI clients including Claude Desktop, Claude Code, Cursor, VS Code (GitHub Copilot), Windsurf, and Cline.

Is MAI UI free to use?

Yes, MAI UI is open source and available under the Apache-2.0 license. You can use it freely in both personal and commercial projects.

Browse More Coding Agents MCP Servers

Explore all coding agents servers available in the MCPgee directory. Each server includes setup guides for Claude, Cursor, and VS Code.

Quick Config Preview

{ "mcpServers": { "mai-ui": { "command": "npx", "args": ["-y", "mai-ui"] } } }

Add this to your claude_desktop_config.json or .cursor/mcp.json

Read the full setup guide →

Ready to use MAI UI?

Browse our complete directory of 33,000+ MCP servers, read setup guides for your editor, and start building with the Model Context Protocol.

33,000+ ServersFree & Open SourceStep-by-Step Guides