Repo

llm-inference-platform

@ayenioluwatosinolawaleby Ayeni Oluwatosin Olawale · Vertinab

0

Production-grade LLM inference on AWS EKS — vLLM v0.30.0 + SGLang v0.5.20 serving Llama 3.1 8B and Qwen3 8B, LiteLLM gateway, KEDA autoscaling, Prometheus + Grafana + Loki + AlertManager

Built withPython

See what other members are building and what each project is looking for.