LLMS.txt Explorer
A server that helps discover and analyze websites implementing the llms.txt standard, allowing users to check if websites have llms.txt files and list known compliant websites.
What is LLMS.txt Explorer?
LLMS.txt Explorer is a Model Context Protocol (MCP) server that allows AI assistants like Claude, Cursor, and VS Code to server that helps discover and analyze websites implementing the llms.txt standard, allowing users to check if websites have llms.txt files and list known compliant websites.
A server that helps discover and analyze websites implementing the llms.txt standard, allowing users to check if websites have llms.txt files and list known compliant websites.
This server falls under the Developer Tools category on MCPgee, the world's largest MCP server directory with 33,000+ servers.
Features
- A server that helps discover and analyze websites implementi
Use Cases
Maintainer
Works with
Installation
NPM
npx -y @thedaviddias/mcp-llms-txt-explorerManual Installation
npx -y @thedaviddias/mcp-llms-txt-explorerConfiguration
Configuration Details
claude_desktop_config.json
Performance
Response Metrics
Resource Usage
How to Set Up and Use LLMS.txt Explorer
The MCP LLMS.txt Explorer server enables AI assistants to discover and validate websites that implement the emerging llms.txt standard — a convention where sites publish a machine-readable file at /llms.txt to help AI systems understand their content structure. It exposes two tools: one that checks whether a given website has an llms.txt file and returns its validation status, and another that lists a curated database of known compliant websites with filtering options. Developers and AI researchers use it to audit site readiness for AI discovery and to build on the growing llms.txt ecosystem.
Prerequisites
- Node.js 18 or higher (for npx execution)
- An MCP-compatible client such as Claude Desktop, Cursor, or Claude Code
- No API key required — the server uses only public HTTP requests
Install via npx (recommended)
No manual installation needed. Claude Desktop or any MCP client can launch the server on demand using npx. Confirm Node.js is installed first.
npx -y @thedaviddias/mcp-llms-txt-explorerConfigure Claude Desktop
Add the server to your claude_desktop_config.json. The npx command will download and launch the package automatically on first use.
{
"mcpServers": {
"llms-txt-explorer": {
"command": "npx",
"args": ["-y", "@thedaviddias/mcp-llms-txt-explorer"]
}
}
}Restart Claude Desktop
Quit and relaunch Claude Desktop so it picks up the new server entry from the configuration file. The server will appear in the connected tools list.
Check a website for llms.txt
Use the check_website tool through your AI assistant to probe any domain. The tool fetches /llms.txt, validates the format, and returns the file content or a not-found status.
List known compliant websites
Use the list_websites tool to query the curated database of sites that have adopted the llms.txt standard, with optional filtering by category or domain.
LLMS.txt Explorer Examples
Client configuration
Add to claude_desktop_config.json to launch via npx — no pre-installation needed.
{
"mcpServers": {
"llms-txt-explorer": {
"command": "npx",
"args": ["-y", "@thedaviddias/mcp-llms-txt-explorer"]
}
}
}Prompts to try
After connecting, use these prompts to explore the llms.txt ecosystem with the check_website and list_websites tools.
- "Check if anthropic.com has an llms.txt file and show me what it contains"
- "Does vercel.com have a valid llms.txt? Is it well-formed according to the standard?"
- "List all websites in the llms.txt database and group them by category"
- "Check these three sites for llms.txt compliance: openai.com, huggingface.co, and mistral.ai"Troubleshooting LLMS.txt Explorer
check_website returns 'not found' for a site you know has llms.txt
Some sites serve llms.txt only over HTTPS or with specific headers. Verify the file exists by opening https://yourdomain.com/llms.txt in a browser. The tool checks the standard path at the root domain.
npx takes a long time to start on first use
The first run downloads the package from npm. Subsequent starts are fast because npx caches the package. Alternatively, install it globally with 'npm install -g @thedaviddias/mcp-llms-txt-explorer' and point the config to the installed binary.
The server does not appear in Claude Desktop's tool list after editing the config
Make sure the JSON in claude_desktop_config.json is valid (no trailing commas, properly quoted keys). Use a JSON validator, then fully quit and reopen Claude Desktop rather than just closing the window.
Frequently Asked Questions about LLMS.txt Explorer
What is LLMS.txt Explorer?
LLMS.txt Explorer is a Model Context Protocol (MCP) server that server that helps discover and analyze websites implementing the llms.txt standard, allowing users to check if websites have llms.txt files and list known compliant websites. It connects AI assistants to external tools and data sources through a standardized interface.
How do I install LLMS.txt Explorer?
Install via npm with the command: npx -y @thedaviddias/mcp-llms-txt-explorer. Then add the server configuration to your AI client's JSON config file (e.g., claude_desktop_config.json or .cursor/mcp.json).
Which AI clients work with LLMS.txt Explorer?
LLMS.txt Explorer works with all major MCP-compatible AI clients including Claude Desktop, Claude Code, Cursor, VS Code (GitHub Copilot), Windsurf, and Cline.
Is LLMS.txt Explorer free to use?
Yes, LLMS.txt Explorer is open source and available under the MIT License license. You can use it freely in both personal and commercial projects.
LLMS.txt Explorer Alternatives — Similar Developer Tools Servers
Looking for alternatives to LLMS.txt Explorer? Here are other popular developer tools servers you can use with Claude, Cursor, and VS Code.
Ecc
★ 188.2kThe agent harness performance optimization system. Skills, instincts, memory, security, and research-first development for Claude Code, Codex, Opencode, Cursor and beyond.
Javaguide
★ 155.8kJava 面试 & 后端通用面试指南，覆盖计算机基础、数据库、分布式、高并发、系统设计与 AI 应用开发
Gemini CLI
★ 104.5kA secure MCP server that wraps the Google Gemini CLI, allowing clients to query Gemini models using local OAuth sessions without requiring an API key. It provides tools for model interaction and diagnostics with built-in protection against command in
Awesome MCP Servers
★ 87.3k⭐ Curated list of Model Context Protocol (MCP) servers - tools that extend Claude Desktop, Cursor, Windsurf, and other MCP clients with custom capabilities.
MCP Servers
★ 86.0kModel Context Protocol Servers
CC Switch
★ 77.5kA cross-platform desktop All-in-One assistant for Claude Code, Codex, OpenCode, OpenClaw, Gemini CLI & Hermes Agent. Only official website: ccswitch.io
Browse More Developer Tools MCP Servers
Explore all developer tools servers available in the MCPgee directory. Each server includes setup guides for Claude, Cursor, and VS Code.
Set Up LLMS.txt Explorer in Your Editor
Choose your AI client for step-by-step setup instructions.
Quick Config Preview
Add this to your claude_desktop_config.json or .cursor/mcp.json
Ready to use LLMS.txt Explorer?
Browse our complete directory of 33,000+ MCP servers, read setup guides for your editor, and start building with the Model Context Protocol.