Local AI 202: Get Massive Speed-ups with Speculative Decoding

Hugging Face · 14,995 views

Hands-on local inference session on speculative decoding for massive speed-ups; practical serving technique with real setup.

More in Infra