inferbench

Level FSource

Benchmark local LLM inference speed (tokens/sec) on your own hardware — llama.cpp native + cloud APIs, 124-model catalog, optimal-quant picker, and an MCP serve mode.

⭐ 2Development ToolsPythonRepo ↗Updated 2026-10-25

Installation

View source repo →

Related servers