The Next Token Ep 05 - "I'm the Arbiter of Tokens and GPUs"
@michellechen joins @dillon_mulroy and @threepointone to explain AI inference at scale, open weights, how the industry lights money on fire, etc. (@RhysSullivan returns next episode!)
if you want to understand what building at real scale is like, this is a must read
1.1.1.1, @Cloudflare's DNS resolver, stores over stores over 250 billion (!!!) cache entries at any given time, so every minor change has a massive ripple effect
we made 5 changes, and saved >
