← Leke-Oduoye Erioluwa's projects
Repo

Frugal_LLM

Benchmark any OpenAI-compatible LLM endpoint: latency, throughput, cost per token, and quality loss from quantisation.

Built withPythonbenchmarkcostevaluationgpuinference

Comments · 0

No comments yet. Tried it? Tell Leke-Oduoye what worked, what didn't, or what you'd want next.
Sign in to comment

More from members

All projects

See what other members are building and what each project is looking for.