The Future of AI Infrastructure
Google Cloud Tech overview of AI infrastructure trends; useful context on the compute stack behind model serving.
More in Infra
1:34:10InfraLocal AI 301: Quantization
Hugging Facequantizationcourse
7:12InfraYour KV Cache Can Spot Attacks on Your AI Agents - Ari Azarafrooz, Intrinsec AI
KV cacheagent securitytalk
52:08InfraYour Self-Hosted LLM Needs to Say No - Harshul Jain & Parv Khatri, Audible & SAP
self-hosted LLMguardrailstalk
