CS Paper Radar

Generative Design of Liquid-Cooling Channels for Thermal Management of 2.5D and 3D Integrated Advanced Packaging

Michael Acquah, Zheng Liu

eess.SY ·submitted 2026-08-24 04:18 UTC · v2

Abstract

High-power multi-chip packages require increasingly effective cooling as intensive heat is generated within a limited package area. This work presents a physics-guided generative design framework for liquid-cooling channel topology optimization in a 2.7 kW multi-chip package containing two high-power graphics processing units (GPUs) and one central processing unit (CPU). A conditional diffusion model generates symmetric channel layouts using maximum GPU temperature, GPU temperature spread, and pressure drop as performance targets. Generated designs undergo connectivity and dead-end-branch screening and are evaluated using a calibrated reduced-order thermal-fluids model. Based on 5,000 generated layouts, the multi-objective analysis identified the optimal design for thermal properties, with estimated maximum GPU temperature of 70.30 degree Celsius, GPU temperature spread of 24.90 degree Celsius, and pressure drop of 89.72 kPa. Compared to a conventional reference topology, the optimal design reduced the maximum GPU temperature, temperature spread, and pressure drop by 33.6%, 52.5%, and 72.8%, respectively. High-fidelity three-dimensional conjugate heat-transfer simulation in OpenFOAM estimated a maximum GPU temperature of 66.70 degree Celsius and a pressure drop of 92.1 kPa, showing only differences of 8.6% in temperature rise and 2.6% in pressure drop. The results demonstrate that physics-guided generative design based on the reduced-order model can efficiently discover unconventional cooling channel architectures while reducing reliance on repeating computationally expensive simulation.

Comment
29 pages, 5 figures

Closest papers

Nearest neighbours by meaning across the whole index.

Beyond HBM-on-GPU: Thermal Design Envelope for 3D Volumetric DRAM-on-GPU Integration

cs.ET ·2026-09-21 ·Yukai Chen, Melina Lofrano, Khakim Akhunov, Jonas Svedas, Arjun Singh +10 more
published similarity 0.64
Abstract · Presented at the 52nd IEEE European Solid-State Electronics Research Conference (ESSERC 2026), Palma de Mallorca, Spain, September 7-10, 202…

The scaling of GPUs for AI and HPC workloads is increasingly constrained by the capacity, bandwidth, and thermal limits of both 2.5D HBM-GPU and direct-stacked 3D HBM-on-GPU integration. This work establishes the thermal design envelope for 3D volumetric DRAM-on-GPU integration, in which vertically oriented DRAM dies and interleaved cooling cavities reshape heat flow and memory interfacing above the GPU. Using a package-level thermal model anchored to a consistent HBM-on-GPU baseline and driven by a realistic reticle-scale non-uniform GPU power map, we quantify the key parameters governing thermal feasibility. Stack height is the dominant limiter of peak temperature, while cooling-cavity conductivity shifts the feasible region, and mold insertion and stack orientation further modulate thermal behavior. A distributed memory-controller and network-on-chip tier introduces only a moderate thermal penalty. Although die-level parallelism increases bandwidth, the reduction in simulated training time saturates once execution becomes compute-bound. These results define a bounded co-design space across bandwidth, capacity, and thermal constraints for 3D volumetric DRAM-on-GPU integration.

0.38

Modeling Liquid-Cooled Data Centers in EnergyPlus

eess.SY cs.CEcs.DCcs.LG ·2026-10-23 ·Yun-Dam Ko, Dipashreya A. Sur, Cade Napier, Carlos D. Díaz-Marín, Rishee K. Jain
code/data similarity 0.62
Abstract · 14 pages, 7 figures, 6 tables. Code: https://github.com/Urban-Informatics-Lab/energyplus-liquid-cooling

As AI workloads accelerate data center transition toward high-density racks with direct-to-chip (DTC) liquid cooling, existing simulation tools remain limited in evaluating whole-building and multi-year efficiency. To bridge this gap, we develop a native EnergyPlus object, ElectricEquipment:ITE:LiquidCooled, that models DTC liquid cooling for chilled-water and warm-water architectures as plant-loop components. It couples facility-water loops, rack-side secondary loops, coolant distribution units, and chip-junction temperatures within a single solver. Validation against an independent Modelica implementation across 21 operating conditions, including two full-year runs compared at one-minute resolution, yields loop-temperature RMSE at or below 0.021 K, well within the 0.1 K acceptance threshold. Our case study demonstrates that warm-water liquid cooling reduces annual PUE from 1.43 to 1.25, eliminates on-site water use, and cuts total facility energy by 37.9% relative to an air-cooled baseline. By embedding liquid-cooling logic into EnergyPlus, our work provides whole-building, long-term energy modeling for high-density AI infrastructure within an open-source framework.

0.31

COOL: A Cooling-Aware Point Transformer Framework for Thermal Prediction in Advanced 3D/3.5D IC Packaging

cs.CE ·2026-08-16 ·Yao Lu, Zhicheng Guo, Qijun Zhang, Shang Liu, Wenji Fang +2 more
publishedbenchmark similarity 0.59
Abstract · 7 pages, accepted at DAC 2026

Advanced 3D and 3.5D IC packaging significantly improves integration density but elevates thermal management challenges due to cross-layer heat coupling and complex cooling structures. Traditional solvers deliver high fidelity but are too slow for iterative design flows, while existing learning-based methods either fail to capture inter-die thermal coupling or treat cooling structures as static components, limiting their applicability in real packaging co-design scenarios. In this work, we introduce COOL, a cooling-aware point transformer framework that represents heterogeneous assemblies (dies, interposers, TIMs, heat spreaders) as annotated 3D point clouds embedding geometric, material and power attributes. COOL explicitly encodes geometric boundaries and cooling structures, and introduces a physics-informed boundary condition (PI-BC) loss to enforce thermal consistency at material interfaces and cooling boundaries. Extensive experiments demonstrate that COOL achieves a remarkable 2.4\% NMAE on our constructed benchmark of multi-package thermal designs, substantially outperforming existing learning-based approaches while providing over 15.7x speedup compared to commercial FEM solvers.

0.28

IC-ThermBench: An Open, Progressive Benchmark for Generalizable 2.5D/3D-IC Thermal Learning

cs.CE ·2026-08-25 ·David Hang, Wenkai Yang, Kuiye Ding, Haiyang Xin, Jacky Wei
benchmarkcode/data similarity 0.55
Abstract · Project site: https://github.com/Day333/ThermalBench

Standardized benchmarks are fundamental to reliable progress in AI for EDA, including learning-based thermal modeling. However, existing thermal prediction studies often rely on different datasets, simulators, data splits, preprocessing pipelines, and metrics, while most datasets and implementations remain unavailable, making fair and reproducible comparison difficult. We introduce IC-ThermBench, an open and progressive benchmark that combines established 3D-IC steady-state, transient, and industrial package tasks with a new 50,000-sample 2.5D chiplet extension designed to evaluate progressively broader represented physical variation and cross-package OOD transfer. Five Generalization Scopes cover 3D-IC fixed-design prediction, Within-Family Generalization under layout, material, and boundary-condition variation, and Cross-Package OOD transfer to unseen package systems. We evaluate eight representative baselines under common data, splits, labels, and metrics. Performance degrades gradually from S2 to S4 as represented physical support broadens, but Cross-Package OOD produces a much sharper degradation: the best RMSE and MAE increase from 1.216 and 0.938~K at S4 to 15.99 and 15.00~K at S5, respectively. With only 10 labeled samples per OOD case, target-domain adaptation reduces the best MAE to 2.60~K. IC-ThermBench further provides a unified generation, training, inference, and evaluation pipeline, enabling reproducible and fair comparison of existing and new thermal predictor.

0.32

A Composable AI-Accelerated Iterative Solver for 3D-IC Thermal Modeling

cs.LG ·2026-10-01 ·Yixing Li, Jiahang Zhou, Zhiyu Zeng, Xin Ai
similarity 0.54
Abstract

Accurate thermal analysis of heterogeneous 2.5D/3D-IC packages is essential yet computationally prohibitive. A single full-package FEM simulation can take hours, while AI-based surrogates treat the entire stack as a monolithic prediction target and must be retrained whenever the die count or topology changes. To address this limitation, this work proposes Domain-Decomposed AI-Accelerated Iterative Solver for Thermal Analysis (DAIST), a composable thermal solver that decomposes the global package simulation into block-level subdomain problems, replaces subdomain solvers with neural operators, and couples them through iterative exchanges of interfacial temperature and heat flux. This local-to-global architecture eliminates the topology lock-in of monolithic models: block-level neural operators can be directly reused in unseen package assemblies without retraining. The iterative coupling strategy further provides a controllable accuracy-runtime tradeoff, where the iteration budget can be adjusted to trade accuracy for runtime. Evaluated on a multi-chiplet system and an advanced packaging system, DAIST achieves up to $178\times$ speedup over traditional FEM solvers with mean temperature errors of 0.068% and 0.323%, respectively, while demonstrating cross-topology reuse of block-level models across structurally distinct package assemblies.

0.06

AI Surge Accelerates the Transition to Liquid Cooling: Rethinking Energy and Water Use in Data Center Cooling

cs.CY ·2026-11-18 ·Yingbo Zhang, Eric Masanet, Shengwei Wang
similarity 0.52
Abstract

The power density of AI workloads is rapidly driving shifts to liquid cooling. This study rethinks and assesses the global impact on energy and water demand of this cooling transformation. Results suggest that liquid cooling can reduce cooling energy use by 25-56% relative to air cooling, offering substantial energy savings for GW-scale AI data centers. Best-practice PUE values could be as low as 1.07-1.08 for today's systems and 1.03-1.04 for emerging designs, and WUE values range from 0.38 to 2.63 L/kWh, depending on temperature conditions. We identify global free-cooling rack inlet temperature thresholds of 33 $^\circ$C for evaporative systems and 49 $^\circ$C for dry systems, demonstrating the practicality of 100% free cooling in many locations. The model finds that minimum PUEs do not necessarily coincide with minimum total energy use, because warmer coolant raises server power. Results quantify the large sustainability potential of liquid cooling and provide actionable targets for data center design and policies.

0.27

HeatCache: Thermal-aware Energy-efficient LLM Inference Scheduling for Chassis-level Liquid Cooling in Sustainable Edge Server Rooms

cs.DC cs.PFeess.SY ·2026-09-11 ·Rui Lu, Huanghuang Liang, Kaiqi Guan, Dan Wang
similarity 0.52
Abstract

LLM inference is increasingly deployed at institution-scale edges to meet service requirements. However, multi-GPU inference consumes a large amount of electricity and produces substantial heat. To improve sustainability, operators and regulations often demand raising the ambient setpoint to reduce cooling electricity. This can increase thermal throttling and hardware aging, leading to Service-Level Objective violations. In this paper, we present HeatCache, a thermal-aware, energy-efficient LLM inference scheduler for commercial chassis-level AIO liquid-cooled GPUs at sustainable ambient temperatures. HeatCache treats AIO loops as a temporary heat buffer, measured by heat budget and schedules requests to minimize energy subject to thermal safety and SLO constraints, based on an electrical-informed heat-demand estimation from HeatiTS. We implement HeatCache atop vLLM and show that it reduces computing energy by up to 18.0%, decreases thermal-throttle exposure by 81.7%, and maintains SLO violation rates below 0.9% even up to $48~^{\circ}\mathrm{C}$.

0.11

Toward Multi-kW Power Delivery Methodologies for Advanced 3D Heterogeneous Integration

cs.AR ·2026-09-21 ·Peiyi Yue, Hangyu Zhang, Ratul Das, Ramesh Harjani, Sachin S. Sapatnekar
top venue similarity 0.52
Abstract

The demands of modern applications require the construction of ever more complex integrated systems, with AI applications in particular serving as a significant driver for increased system size, potentially going beyond the trilliontransistor mark. The path to building these systems requires the use of advanced packaging, with heterogeneous integrated 2D and 3D chiplets placed atop a substrate. Such computationally powerful systems require significant power for computation: reliable and robust power delivery is a major challenge in light of high power densities and pin count bottlenecks. This paper overviews approaches to building design methodologies that overcome this problem, through the design of multistage distributed power delivery systems, optimized for performance and reliability, and built to coexist within stringent performance, thermal, and reliability constraints.

0.41