Feb. 28, 2025 — SoftBank Corp., ZutaCore and Hon Hai Know-how Group (Foxconn) right this moment introduced that they applied ZutaCore’s two-phase direct liquid cooling know-how*1 in an AI server utilizing NVIDIA accelerated computing.
The businesses stated that is the primary implementation*2 of ZutaCore’s two-phase DLC*1 utilizing NVIDIA H200 GPUs. As well as, SoftBank designed and developed a rack-integrated answer that integrates every element of the server, together with cooling gear with two-phase DLC know-how, on a rack scale, and carried out an operational demonstration and efficiency analysis at its information heart in February 2025.
The demonstration outcomes indicated the answer handed NVIDIA’s temperature check (NVQual), thereby confirming the compatibility, stability and reliability of this rack-integrated answer. The answer additionally achieved pPUE (partial Energy Utilization Effectiveness) of 1.03 (precise measured worth) per rack for cooling effectivity*3.
With the unfold and elevated adoption of AI, demand for AI servers and different computing sources is predicted to broaden considerably, additional growing energy consumption at information facilities. On the identical time, lowering energy consumption from the attitude of lowering carbon dioxide (CO2) emissions has grow to be a urgent concern worldwide, requiring information facilities to grow to be extra environment friendly, eat much less energy, and introduce progressive warmth elimination options. Since Might 2024, SoftBank has been collaborating with ZutaCore, a world chief within the growth and enterprise deployment of two-phase DLC know-how, to develop options optimized for low energy consumption at AI information facilities.
NVIDIA H200
SoftBank, ZutaCore and Foxconn will proceed their efforts to realize increased effectivity and decrease energy consumption in AI information facilities utilizing NVIDIA accelerated computing, and collaborate on the event of rack-integrated options optimized with two-phase DLC know-how for sensible use and deployment within the international market.
Options of the rack-integrated answer embrace:
- Plug & Play answer
By integrating server elements similar to cooling gear outfitted with 2-phase DLC know-how, which conventionally needed to be optimized individually, on a rack scale, it’s doable to offer a “Plug & Play”*4 answer that can be utilized instantly by merely connecting the gear. This makes it straightforward and easy to put in in AI information facilities.
- 2-phase DLC cooling system
ZutaCore’s two-phase DLC know-how, which cools the chipsets (CPUs, GPUs, reminiscence, and many others.) which can be the warmth sources within the server by bringing them into contact with a chilly plate, circulates a particular insulating warmth switch (dielectric) fluid with a low boiling level within the chilly plate and makes use of warmth absorption through the section change from liquid to gasoline attributable to the warmth supply. Environment friendly cooling is achieved by way of repeated evaporation and condensation. As well as, the water temperature may be maintained at the next temperature than in typical water-cooled services, which improves the warmth transport capability of the water used for cooling and reduces the circulation price of water to realize the required cooling impact. This makes it doable to cut back the strain of the pump that delivers the water for cooling, contributing to decrease energy consumption. Moreover, the usage of insulating warmth switch fluid prevents severe harm to the server within the occasion of a spill of particular fluid.
- AI server with compatibility, stability and reliability
Foxconn developed an AI server primarily based on NVIDIA H200 GPUs, optimized with ZutaCore’s two-phase DLC know-how. This AI server was capable of exceed goal efficiency figures in NVIDIA’s certification check (NVQual), which determines the compatibility, stability, and reliability of server techniques.
- Scalable rack for high-density placement of AI servers
SoftBank developed a rack designed to maximise cooling effectivity and enhance operational effectivity with its two-phase DLC know-how. Along with being designed to be versatile and scalable for high-density placement of the most recent AI servers, the rack has airflow for improved cooling effectivity, and energy provide. As well as, energy provide and wiring are concentrated within the rear of the rack for operational security and robot-friendly operation. The rack can also be appropriate with 21-inch servers and standard 19-inch servers compliant with the ORV3 commonplace, which is a specification set by the Open Compute Challenge (OCP), a non-profit group that promotes open-source {hardware} specs and designs. The specs are designed to be deployed in accordance with international requirements.
“As we work to develop one of many largest AI infrastructures in Japan and homegrown large-scale language fashions (LLMs), enhancing the vitality effectivity of information facilities is crucial to speed up AI growth and understand a sustainable society” stated Hironobu Tamba, Vice President and Head of the Information Platform Technique Division at SoftBank Corp. “The operational demonstration of this rack-integrated answer with optimized two-phase DLC know-how has confirmed secure operation and improved vitality effectivity of high-density GPU servers with liquid cooling. Sooner or later, we are going to work on the sensible software of this answer to be used in AI information facilities and AI factories to construct a sustainable AI infrastructure and maximize computational effectivity.”
“ZutaCore is honored to companion with international trade leaders SoftBank and Foxconn to introduce the world’s first 2-phase DLC rack integration answer utilizing NVIDIA accelerated computing for AI servers,” stated Erez Freibach, Co-founder and CEO at ZutaCore. “This groundbreaking collaboration highlights the transformative potential of our waterless DLC cooling know-how to ship unmatched effectivity whereas addressing the rising want for sustainable vitality options. Collectively, we’re not simply assembly right this moment’s challenges however setting a brand new commonplace for energy-efficient innovation in next-generation AI information facilities and factories, driving progress whereas safeguarding the planet.”
*1 A know-how that cools the chilly plate on the semiconductor chip (processor) contained in the server by circulating an insulating refrigerant with out water in a two-phase system (liquid and gasoline).
*2 As of January 2025, in keeping with ZutaCore analysis.
*3 Based on ZutaCore analysis. PUE is a measure of cooling effectivity in information facilities. pPUE is a measure of the effectivity of a selected space or facility, similar to a server room or module. The nearer the quantity is to 1.0, the extra vitality environment friendly it’s.
*4 This technique that routinely acknowledges peripherals and makes the required settings when peripherals are related to the primary unit of a tool.
