Repo

HACT

Treating the CPU cache hierarchy as a training-time constraint for faster native CPU LLM inference. Preprint + code.

Built with

Pythonarm64cachecpu-inferencehardware-awarellmmachine-learning

Comments · 0

No comments yet. Tried it? Tell Jayanth what worked, what didn't, or what you'd want next.

See what other members are building and what each project is looking for.