benchwarmers

Self-hosted panel gateway for LLMs: ask a collection of models at once, keep every answer side by side, rotate explorer models in, and let your verdicts pick the next panel. OpenAI, Anthropic, Gemini and Ollama APIs, an MCP server, Python stdlib.

Installation

MCP client config (paste into mcp.json)

{
  "mcpServers": {
    "benchwarmers": {
      "command": "npx",
      "args": [
        "@wendellresearch-ai/benchwarmers"
      ]
    }
  }
}

Agent install prompt

Copy and paste into Cursor / Claude / other agents to install this MCP for you

Please read this MCP repository and install it into my current environment:
https://github.com/WendellResearch-AI/benchwarmers

Known working client config (can write into mcp.json):
{
  "mcpServers": {
    "benchwarmers": {
      "command": "npx",
      "args": [
        "@wendellresearch-ai/benchwarmers"
      ]
    }
  }
}

Please: 1) check README for deps and env vars; 2) write config for my client; 3) if secrets are missing, tell me what to fill — do not invent values.

GitHub

Related servers