DIO

Level FSource

Drop-in OpenAI- and Ollama-compatible LLM gateway that learns each backend's latency online and routes vLLM / SGLang / TGI / Ollama with SLO-aware admission. No engine patches.

⭐ 3Development ToolsPythonRepo ↗Updated 2026-11-01

Installation

View source repo →

Related servers