Local AI 202: Get Massive Speed-ups with Speculative Decoding

Hugging Face · 14,921 views

Hands-on local inference session on speculative decoding for massive speed-ups; practical serving technique with real setup.

More in Infra
16:29Infra
Stop Guessing Your vLLM Config: Benchmarking LLMs on Runpod - Chris Vela, Runpod
AI Engineer · 5,266 views · Oct 2026
vLLMRunpodbenchmarking
39:48Infra
CUDA Live: Introduction to CUDA Rust
NVIDIA Developer · 9,694 views · Oct 2026
CUDARustNVIDIA