models

Level AMCP ecosystemNot an MCP ServerSource

The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]

Overview

LiteLLM is an open-source AI gateway that provides a unified interface to call 100+ LLM providers (such as OpenAI, Anthropic, Gemini, Bedrock, and Azure) in OpenAI format. It works as a Python SDK or a centralized proxy server, with built-in virtual keys, cost tracking, guardrails, load balancing, and an admin dashboard, plus support for connecting MCP servers and A2A agents.

⭐ 62.1kSearch & InfoPythonRepo ↗Updated 2026-10-26

Installation

View source repo →

Related servers