← Randy Smits-Schreuder Goedheijt's projects
Repo

VITRIOL

@randozartby Randy Smits-Schreuder Goedheijt · Omnivision, by Prestop

Experimental local LLM inference for old hardware: in-tree llama.cpp fork, sparse KV, MTP, VRAM governor, Rust tooling.

Built withC++cudaggufkv-cachellama-cppllm-inference

Comments · 0

No comments yet. Tried it? Tell Randy what worked, what didn't, or what you'd want next.
Sign in to comment

More from members

All projects

See what other members are building and what each project is looking for.