Local AI 202: Get Massive Speed-ups with Speculative Decoding
Hands-on local inference session on speculative decoding for massive speed-ups; practical serving technique with real setup.
More in Infra
Hands-on local inference session on speculative decoding for massive speed-ups; practical serving technique with real setup.