Nvidia is cooling its newest AI servers with water hotter than a hot tub, and it's saving millions

[Sequence19]

Nvidia's newest Rubin generation AI hardware runs its liquid coolant at 45 degrees Celsius, roughly 113 degrees Fahrenheit, actually hotter than the 38 to 40 degrees a typical hot tub runs at. That sounds backwards for a cooling system, but the logic is that hot enough coolant lets outdoor dry coolers shed heat passively into the outside air, without needing power hungry mechanical chillers at all

The old approach, chilling air and pushing it across every component with loud fans, has historically eaten up as much as 40 percent of a data center's total electricity bill. Industry estimates suggest raising chiller temperatures by just one degree cuts cooling energy costs by around 4 percent, which scales to roughly $4 million in annual savings for a 50 megawatt facility. Water savings are just as dramatic, conventional cooling tower systems can consume around 2.6 million gallons per megawatt annually, a number Nvidia's fully liquid cooled architecture pushes down to nearly zero

The Rubin generation ditches fans, cold aisles and mechanical chillers entirely in favor of a closed loop system, with coolant entering at 45 degrees and exiting around 55 degrees after absorbing heat from the chip. That heat gets rejected outdoors for most of the year without mechanical assistance, though the actual efficiency depends heavily on local geography and climate. It also means quieter data centers, since fans, generators and chillers have historically made hearing protection necessary inside these facilities, and more compact ones too, a system that used to take up six rack units now fits into two

None of this retrofits existing data centers built around the old cold air approach, but it points toward a genuinely different design philosophy for whatever gets built next, one that treats a cooler room as an unnecessary cost rather than an automatic safety margin

NVIDIA data center hardware is being cooled with waterwww.engadget.com

[Jackson79]

The old assumption that cold automatically equals safe finally getting overturned once someone actually ran the numbers is such a satisfying bit of engineering myth busting

[MickFoley00]

4 million dollars a year in savings from just raising the chiller temperature by one degree really puts into perspective how much money the industry has been burning on the old cooling philosophy