Repo

ai-gateway-benchmark

@lf3551by Aleksei Aleinikov · Independent

0

Reproducible benchmark: how much latency, CPU and memory an AI gateway (LLM gateway) adds. nginx, Kong AI Gateway, Portkey and LiteLLM against the same mock OpenAI-compatible model, same CPU budget, open-loop load.

See what other members are building and what each project is looking for.