Local AI 301: Quantization
Hugging Face Local AI 301 course on quantization; a full technical walkthrough for running models efficiently.
More in Infra
7:12InfraYour KV Cache Can Spot Attacks on Your AI Agents - Ari Azarafrooz, Intrinsec AI
KV cacheagent securitytalk
52:08InfraYour Self-Hosted LLM Needs to Say No - Harshul Jain & Parv Khatri, Audible & SAP
self-hosted LLMguardrailstalk
4:51InfraNVIDIA Dynamo in 5 Minutes: The Frontend, a Drop-In OpenAI API
NVIDIA Dynamoinferencetutorial
