Latent Space: The AI Engineer Podcast · October 20, 2026 · 37 min

The Programmable Data Center — Evan Conrad, SF Compute

Show notes

This was recorded on the sidelines of the new Compute Trading track at AIE NYC . Catch us next at AIE CODE , our last flagship for the top agentic engineers in the world. In the early days of cloud, former guest Martin Casado made something so disruptive that Cisco was threatened enough to pay $600m for it, and VMware outbid for $1.3B: That concept was software-defined networking , which virtualized the routing network by separating the control plane from the data plane. That revolution is now coming for GPUs - where previously running your own supercompute cluster required $50-100m upfront to get commitments and do the entire stack from hardware to firmware to kernels, SF Compute is now enabling you to not only buy or sell GPU hours now and in the future, but also to programmatically control everything from your network to memory. We last spoke with Evan about commoditizing compute . At AI Engineer New York, we went deeper: what does it take to physically deliver a GPU contract, and what has to be true before a market in compute can become liquid? From selling a room to running the hotel Evan describes SF Compute’s expansion with a hotel analogy. A customer wants a room, then asks for cleaning, room service, and security. Eventually you discover that delivering the room means operating the hotel. SF Compute began by trying to sublease a cluster; the company has since built much of the operating capacity of a cloud to deliver the compute traded on its market. That work is physical settlement: the buyer gets usable compute, rather than simply a cash payment against an index. It brings the physical constraints of a cluster into the market itself. Can a workload be interrupted? How quickly can it recover from storage? Which GPU generation, networking and software configuration does it need? Those details affect both the contract and the price. Making compute tradeable Rather than waiting for every GPU cluster to become interchangeable, SF Compute matches orders with di

More from Latent Space: The AI Engineer Podcast

All episodes →
Oct 27 · 1h 47m

Katelyn Lesse and Angela Jiang join Latent Space to explain the engineering behind the Claude Platform: launching Opus 5.5, separating the model’s “brain” from the agent’s “hands,” scaling APIs, and building reliable managed agents. A…

Episode page →
Oct 26 · 1h 17m

AI agents are creating more software—and that changes what a backend needs to do. Supabase co-founders Paul Copplestone and Ant Wilson join swyx to discuss running long-lived workloads alongside the database, making schemas easier for agents to underst...

Episode page →
Oct 26 · 17 min

Watch the full show on YouTube: https://www.youtube.com/watch?v=vhPCo-8K78U

Episode page →
Oct 22 · 1h 26m

Warm welcome to Basil Chatha, our newest cohost from the Forward Deployed side of the AI Engineering world! We’ll be ramping up a new show with him and couldn’t pass up an interview with Modal’s CEO Eric on the occasion of their monster Series D! Two y...

Episode page →
Oct 22 · 27 min

Anekha Sokhal, CEO of Moshi, joins swyx to discuss building a recommendation engine for commodity traders, turning market data into useful signals, and designing AI that fits users’ workflows. Watch: YouTube · Moshi · Anekha 0:00 AI Engineer New York a...

Episode page →
Oct 21 · 44 min

Alex Lieberman and CJ Hess join swyx at AI Engineer New York to discuss Tenex’s approach to AI-native engineering, paying for outcomes, MetaHarness, enterprise AI adoption and rebuilding SaaS. Show notes: Tenex: https://www.tenex.co/ Building an AI-native SDLC:…

Episode page →