genpark-chunked-prefill-speculative-inference-server-skill

Level CSource

Chunked prefill speculative inference server with paged KV cache (vLLM style)

⭐ 10Office & ProductivityPythonRepo ↗Updated 2026-08-30

Installation

View source repo →

Related servers