llm-chat

Local MCP server that connects to external LLM APIs (OpenAI-compatible) for chat completions and model fallback. Requires an API key and base URL.

OpenAI

ai-ml

Add to Your Project

Copy this JSON into your .mcp.json to enable this server

Add to your .mcp.json:

{
  "mcpServers": {
    "llm-chat": {
      "command": "uv",
      "args": [
        "run",
        "--with-requirements",
        "${CLAUDE_PLUGIN_ROOT}/mcp-servers/llm-chat/requirements.txt",
        "${CLAUDE_PLUGIN_ROOT}/mcp-servers/llm-chat/server.py"
      ],
      "env": {
        "LLM_MODEL": "${LLM_MODEL:-gpt-5.4}",
        "LLM_API_KEY": "${LLM_API_KEY:-}",
        "LLM_BASE_URL": "${LLM_BASE_URL:-https://api.openai.com/v1}",
        "LLM_FALLBACK_MODEL": "${LLM_FALLBACK_MODEL:-gpt-5.4}"
      }
    }
  }
}

Replace placeholder values for: LLM_API_KEY

Security Considerations

Review these signals before enabling this server

Requires secrets

This MCP server needs API keys or credentials. Configure them in your environment before use.

Admin access level

This server has elevated permissions. Review the source code before enabling.

Details

Server configuration and connection parameters

Commanduv

Access Leveladmin

Arguments

Command-line arguments passed to the server process

run--with-requirements${CLAUDE_PLUGIN_ROOT}/mcp-servers/llm-chat/requirements.txt${CLAUDE_PLUGIN_ROOT}/mcp-servers/llm-chat/server.py

Environment Variables

Environment variables set when the server starts

LLM_MODEL=${LLM_MODEL:-gpt-5.4}

LLM_API_KEY=${LLM_API_KEY:-}

LLM_BASE_URL=${LLM_BASE_URL:-https://api.openai.com/v1}

LLM_FALLBACK_MODEL=${LLM_FALLBACK_MODEL:-gpt-5.4}

Required Secrets

Sensitive values you must provide — never committed to source control

LLM_API_KEY

Stats

LanguagePython

Stars11

Forks1

MaintenanceExcellent

Last CommitJul 12, 2026

Actions

Stats

Actions