Latest about xAI
Elon Musk and the team behind xAI purportedly setup a total of 100,000 H200 Nvidia GPUs in just 19 days. That's a feat that should have taken four years to complete.
Oracle revealed during its quarterly earnings call that it has secured permits to build a trio of small modular nuclear reactors that could deliver power for a 1-gigawatt AI data center.
Now that X's Colossus supercomputer with 100,000 H100 GPUs is online, Elon Musk hints at its further expansion with 50,000 more H200 GPUs.
In a 16,384 H100 GPU cluster, something breaks down every few hours or so. In most cases, H100 GPUs are to blame, according to Meta.
Elon Musk deployed 14 mobile generators at the xAI Memphis Supercluster to generate 35 MWe to power 32,000 H100 GPUs.
Elon Musk says that he'll have 90,000 Nvidia H100s, 40,000 AI4 chips, and the equivalent of 8,000 H100 GPUs in Dojo D1 processors by the end of 2024.
Memphis Supercluster training started at ~4:20am local time.
The massive data centers use liquid cooling for top performance.
