guidance-for-scalable-model-inference-and-agentic-ai-on-amazon-eks

Level CSource

Comprehensive, scalable ML inference architecture using Amazon EKS, leveraging Graviton processors for cost-effective CPU-based inference and GPU instances for accelerated inference. Guidance provides a complete end-to-end platform for deploying LLMs with agentic AI capabilities, including RAG and MCP

⭐ 20Search & InfoPythonRepo ↗Updated 2026-09-04

Installation

View source repo →

Related servers