Repo

vllm-k8s-stack

Production LLM serving stack on Kubernetes — vLLM, KV-cache-aware routing, HPA on inference metrics, Prometheus/Grafana observability

Built withShell

Comments · 0

No comments yet. Tried it? Tell Ayeni what worked, what didn't, or what you'd want next.

See what other members are building and what each project is looking for.