guidance-for-scalable-model-inference-and-agentic-ai-on-amazon-eks
Level CSourceComprehensive, scalable ML inference architecture using Amazon EKS, leveraging Graviton processors for cost-effective CPU-based inference and GPU instances for accelerated inference. Guidance provides a complete end-to-end platform for deploying LLMs with agentic AI capabilities, including RAG and MCP
Installation
View source repo →Related servers
accelerated-intelligent-document-processing-on-awsThe IDP Accelerator provides a scalable, serverless approach for automated documguidance-for-deploying-model-context-protocol-servers-on-awsThis Guidance demonstrates how to securely run Model Context Protocol (MCP) servworldmonitorReal-time global intelligence dashboard. AI-powered news aggregation, geopoliticdeer-flowAn open-source long-horizon SuperAgent harness that researches, codes, and creatruflo🌊 The original agent harness. Deploy intelligent multi-player swarms, coordinateheadroomCompress tool outputs, logs, files, and RAG chunks before they reach the LLM. 20