← Randy Smits-Schreuder Goedheijt's projects
@randozartby Randy Smits-Schreuder Goedheijt · Omnivision, by Prestop
VITRIOL
Experimental local LLM inference for old hardware: in-tree llama.cpp fork, sparse KV, MTP, VRAM governor, Rust tooling.
C++cudaggufkv-cachellama-cppllm-inference
More from members
All projectsSee what other members are building and what each project is looking for.
Comments · 0