← Serhii Trykhlieb's projects
Repo

TurboPrefill

Multi-GPU prefill acceleration for llama.cpp

Built withC++cudagpuinferencellamallama-cpp

Comments · 0

No comments yet. Tried it? Tell Serhii what worked, what didn't, or what you'd want next.
Sign in to comment

More from members

All projects

See what other members are building and what each project is looking for.