← Aagam Sachin Bothara's projects
@aagam-botharaby Aagam Sachin Bothara · UIC
Python
sglanggpuinfeinferencequnatization
rigtune
Measures which LLM serving settings pay off on your GPU and your traffic, then serves the winner. Benchmarks vLLM, SGLang and llama.cpp configurations; one OpenAI-compatible AP
More from members
All projectsSee what other members are building and what each project is looking for.
Comments · 0