What Makes Open Models Fast in Production — Sujee Maniyam, Nebius

AI Engineer · 4,411 views

Nebius's Sujee Maniyam explains what actually makes open models fast in production, from serving-stack choices to batching and caching trade-offs, with real numbers.

More in Infra
16:29Infra
Stop Guessing Your vLLM Config: Benchmarking LLMs on Runpod - Chris Vela, Runpod
AI Engineer · 5,266 views · Oct 2026
vLLMRunpodbenchmarking
39:48Infra
CUDA Live: Introduction to CUDA Rust
NVIDIA Developer · 9,694 views · Oct 2026
CUDARustNVIDIA