sample-genai-on-eks-starter-kit
Level BSourceA comprehensive toolkit for deploying production-ready Generative AI infrastructure on Amazon EKS. Includes pre-configured components for: ๐ AI Gateway (LiteLLM) ๐ค LLM Serving (vLLM, SGLang, Ollama) ๐ Vector Databases, ๐ Embedding Models (TEI) ๐ Observability (Langfuse, Phoenix) etc. Fast-track your GenAI deployment with Kubernetes
Installation
View source repo โRelated servers
sample-serverless-mcp-serversSample implementations of AI Agents and MCP Servers running on AWS Serverless cosample-getting-started-with-strands-agents-courseLearn to build AI agents with Strands framework. Covers LLM integration via AmazmempalaceThe best-benchmarked open-source AI memory system. And it's free.private-gptComplete API layer for private AI applications on local models: RAG, skills, toocodebase-memory-mcpLocal code intelligence for developers and AI agents. Connect code, docs and infcontext-modeFree, local plugin that keeps tool output out of your coding agent's context win