CS Paper Radar

Emerging Vertical Power Delivery in AI Data Centers: Challenges and Solutions

Charles Isaac Zahner, Amirhossein Habibi, Mehdi Ferdowsi

eess.SY ·submitted 2026-11-16 23:11 UTC · v1

Abstract

The rapid growth of artificial intelligence (AI) workloads is increasing power demand in AI data centers, and processor current is projected to reach 2000 A and beyond. This trend is exposing the limitations of lateral power delivery (LPD) to processors and has motivated growing interest in vertical power delivery (VPD). This paper reviews the power delivery network (PDN) of AI data centers and the upcoming transition from LPD to VPD. First, the 800 VDC power delivery architecture, the impedance behavior of the PDN, and the limitations of LPD are discussed. Then, VPD implementation approaches, reported converter designs, and packaging technologies are examined, together with integrated voltage regulators (IVRs) and embedded passive components. In addition, power integrity simulations are presented to compare regulator and plane positions, from which a set of PDN design guidelines is derived. The results show that moving a voltage regulator module (VRM) from 50 mm away to directly below the die reduces the loop inductance by nearly half. In a complete PDN, this relocation lowers the low-frequency anti-resonant peak, whereas the mid- and high-frequency impedance depends on the decoupling stages and the position of the power and ground planes. This paper also shows that achieving practical VPD remains closely tied to challenges such as regulator height, passive-component embedding, and thermal management.

Comment
29 pages, 24 figures. This work has been submitted to the IEEE for possible publication. Copyright may be transferred without notice, after which this version may no longer be accessible

Closest papers

Nearest neighbours by meaning across the whole index.

From Grid to Chip: Power Architecture, Stability, and Flexibility of AI Data Centers

cs.ET cs.AReess.SY ·2026-09-10 ·Yubo Song, Rui Kong, Takuro Umihara, Pooya Davari, Frede Blaabjerg +1 more
hot direction similarity 0.70
Abstract · The manuscript has been submitted for review to IEEE Open Journal of Power Electronics

The rapid growth of artificial intelligence (AI) computing is transforming data centers into large, dynamic electrical loads. Their deployment is primarily constrained by energy availability and grid-connection capacity, which is further aggravated by the ability of power-delivery architectures, control systems, and computing workloads to operate reliably during fast grid disturbances. This article presents a technological perspective on AI data centers as grid-interactive computing systems. First, it reviews grid-integration bottlenecks, evolving connection policies, grid-code requirements, which has fostered new technological trends via spatio-temporal flexibility available through workload orchestration, cooling systems, on-site resources, and energy storage. Second, it maps the evolution of power-delivery architectures from medium-voltage grid interfaces to chip-level, discussing higher-voltage DC distribution, solid-state transformers, wide-bandgap devices, advanced chip-level power delivery, and liquid cooling. Third, it establishes a three-level stability framework spanning rack-level DC-bus dynamics, facility-level converter interactions, and system-level grid-coupled behavior. The framework connects dominant instability mechanisms, including constant power load effects, impedance interactions, forced oscillations, and operating-mode transitions, with suitable modeling, assessment, and mitigation approaches. Synthesizing these topics, this article highlights grid-to-chip co-design as a central requirement for scalable AI infrastructure, linking computing workloads, power-delivery systems, energy buffers, and grid operation.

0.27

Scalable Reference Electrical Architectures for Modern Data Centers

eess.SY ·2026-11-11 ·Kiran Kumar Challa, Yan, Zhou, Kumarsinh Jhala
benchmarkhot direction similarity 0.62
Abstract · 5 pages, 3 figures, conference article

The rapid growth of cloud computing, artificial intelligence (AI), and high-performance computing is driving the deployment of data centers with electrical demands ranging from tens of megawatts to multi-gigawatt campuses, creating significant challenges for utility interconnection and power system planning. This paper presents scalable, vendor-neutral reference electrical architectures for colocation, hyperscale, and AI data centers. The proposed framework integrates modular Power PODs, hierarchical HV/MV/LV distribution, standby generation, uninterruptible power supplies (UPS), battery energy storage systems (BESS), and scalable utility interfaces into a unified planning methodology. Three representative Power POD configurations are developed to support systematic capacity expansion while maintaining consistent electrical topology and equipment sizing. The proposed architectures facilitate utility interconnection studies, equipment demand forecasting, transmission planning, and grid infrastructure assessment, providing an open and reproducible benchmark for evaluating the impacts of large-scale data center deployment on future power systems.

0.24

Reinforcement Learning-Based Optimization of Workload-Aware Power Delivery Networks

cs.AR cs.LG ·2026-10-05 ·Oran Hayes, Maria Pantazi-Kypraiou, Athanasios Tziouvaras, George Stamoulis, Anuj Pathania +2 more
publishedbenchmark similarity 0.59
Abstract · Accepted at ICECS 2026

Power Delivery Networks (PDNs) are critical components of modern VLSI chips, providing stable voltage levels while satisfying electromigration (EM) and IR-drop constraints. Conventional PDN design methodologies typically rely on worst-case assumptions, often resulting in over-provisioned networks and inefficient use of resources. This paper presents a reinforcement learning-based framework for the optimization of workload-aware PDNs. The proposed methodology first generates workload-aware PDNs using architectural power traces obtained from system-level simulations. These power traces are mapped to spatial power density distributions, enabling adaptive allocation of PDN resources according to local current demand. A reinforcement learning agent then performs wire-width optimization to minimize PDN area while maintaining EM and voltage integrity constraints. Electrical and reliability metrics are obtained using SPICE-based circuit analysis and EM lifetime estimation. Experimental evaluation is performed on a dataset of workload-aware PDNs generated from 4-, 8-, and 16-core multiprocessor floorplans using PARSEC and SPLASH-2 benchmark workloads. Furthermore, the proposed Deep Q-Network (DQN)-based optimizer reduces the average normalized PDN area by 47\% while satisfying all EM and IR-drop constraints. Compared to simulated annealing, the proposed approach achieves comparable optimization quality while providing approximately 26$\times$ faster optimization.

0.31

Toward Multi-kW Power Delivery Methodologies for Advanced 3D Heterogeneous Integration

cs.AR ·2026-09-21 ·Peiyi Yue, Hangyu Zhang, Ratul Das, Ramesh Harjani, Sachin S. Sapatnekar
top venue similarity 0.58
Abstract

The demands of modern applications require the construction of ever more complex integrated systems, with AI applications in particular serving as a significant driver for increased system size, potentially going beyond the trilliontransistor mark. The path to building these systems requires the use of advanced packaging, with heterogeneous integrated 2D and 3D chiplets placed atop a substrate. Such computationally powerful systems require significant power for computation: reliable and robust power delivery is a major challenge in light of high power densities and pin count bottlenecks. This paper overviews approaches to building design methodologies that overcome this problem, through the design of multistage distributed power delivery systems, optimized for performance and reliability, and built to coexist within stringent performance, thermal, and reliability constraints.

0.41

AI Data Centers Meet Electrical Grids: A Review of Power Challenges and Coordinated Solutions

eess.SY ·2026-10-06 ·Mariam Mughees, Yuzhuo Li, Yize Chen, Yunwei Ryan Li
survey similarity 0.58
Abstract

Artificial intelligence (AI) workloads are creating large, power-electronic loads whose effects on power systems depend on location, temporal variability, controllability, and interactions with other loads and resources. Annual electricity consumption alone cannot capture these effects. This review examines how AI data centers affect power systems stability, renewable-energy integration, and low-carbon planning by tracing the power-delivery chain from accelerators and workloads through rack converters, uninterruptible power supplies (UPS), storage, and microgrids to the transmission point of interconnection. Reported oscillatory events and multi-gigawatt load transfers highlight how facility responses can amplify disturbances, while programmable workloads and controllable power converters offer opportunities for demand flexibility. Challenges and mitigation strategies are organized across device, rack, facility, and power systems levels, spanning millisecond-to-year timescales. A bandwidth-matching framework relates disturbances to the response capabilities of mitigation resources. The review distinguishes computational energy efficiency from power systems and sustainability outcomes: lower energy consumption per token does not necessarily reduce peak demand, electrical disturbances, or carbon emissions. It examines how coordinated workload scheduling, grid-interactive UPS systems, storage, high-voltage DC distribution, and flexible interconnection can support reliability, efficiency, and decarbonization. Key research needs include dynamic load models, high-bandwidth telemetry, carbon-and grid-aware scheduling, and mechanisms for valuing flexible computational demand.

0.08

Unlocking AI Data Center Interconnection Capacity Through Coordinated Grid and Data Center Flexibility

eess.SY ·2026-10-04 ·Rida Fatima, Xingpeng Li
similarity 0.58
Abstract

The rapid growth of AI data centers is creating concentrated electricity demands that can exceed available distribution network headroom and delay interconnection. This paper investigates whether capacity can be used effectively by coordinating flexibility on both sides of the interconnection. A day-ahead mixed integer second order cone programming framework maximizes feasible AI data center IT capacity using utility side conservation voltage reduction and network topology reconfiguration, together with data center workload shifting and reserve constrained uninterruptible power supply storage. Background feeder demand uses voltage dependent ZIP models, while the data center is modeled as constant power demand using Training, Inference, and Mixed workload profiles. A two-stage solution first maximizes interconnection capacity and then minimizes feeder losses for the retained capacity, with numerical relaxation screening. Studies on a 116-bus model derived from the IEEE 123-node feeder show that, at the constrained bus-60 connection point, grid side flexibility, driven almost entirely by network reconfiguration, increases feasible IT capacity by approximately 42.5-45.0%, while data center flexibility alone provides approximately 2.1-5.4% gains. Coordinated operation increases feasible IT capacity from approximately 10.5-10.6 MW under BASE operation to 15.3-16.0 MW, corresponding to gains of approximately 45.9-50.8%; the 16.0 MW Inference result is limited by the adopted UPS reserve requirement. Benefits are strongly location dependent and influenced by workload flexibility, deferral duration, PUE, UPS energy and reserve requirements, and feeder loading. Under a combined adverse operating condition, FULL capacity decreases by only 3.4% relative to the nominal Mixed case while retaining substantial additional capacity over BASE.

0.29

How AI Load Swings Reduce Datacenter Power Conversion Efficiency

cs.AR eess.SY ·2026-10-23 ·Heetarth Joshi, Ali Alenezi, Fang Chen Lin, Prasad Enjeti, Xiaoyang Wang +1 more
similarity 0.57
Abstract

AI training and inference workloads make GPU power swing repeatedly between compute and communication phases. As a result, the cascaded converters in a datacenter rack keep moving between operating points with different efficiencies. This paper uses an energy based, cycle averaged method to quantify that effect along a 240 V AC to 400 V DC to 51 V DC rack power path, using measured efficiency curves of commercially available GaN based PFC and LLC converters. For a 1 Hz, 50% duty-cycle load swinging between 5 kW and 510 W, conversion efficiency falls to 95.97%, compared with 96.82% at the equivalent constant average load, a loss of 0.88%. When 51/48V to 1V point of load conversion to the chip rail is included, it is shown that the loss grows to 1.66% (89.45% vs. 90.96%). These results show that efficiency rated at average load overstates real world performance, and that the penalty grows with each load dependent conversion stage between the grid and the GPU.

0.24

Hosting Capacity Assessment of Data Centers with Voltage Ride-Through Capability in Power Systems

eess.SY ·2026-09-02 ·Pengyu Ren, Wei Sun, Fei Teng
similarity 0.56
Abstract

Large data centers are emerging as concentrated, power-electronic grid loads whose abrupt disconnection or transfer to on-site backup supply during voltage disturbances can remove large demand from the power system, and may create a system-level stability problem. Their interconnection feasibility therefore depends not only on steady-state thermal and voltage limits, but also on whether internal power-conditioning systems can maintain IT service while limiting customer-initiated load reduction. This paper presents a voltage ride-through (VRT)-aware data center and grid co-planning framework that couples transmission-level fault simulation with an internal data center ride-through model. Python-based dynamic simulations generate point-of-interconnection (POI) voltage trajectories under selected network faults, and the resulting waveforms drive an internal model incorporating IT and cooling-load dynamics, DC-link, Uninterruptible Power Supply (UPS) response, and converter apparent power limits. The IEEE 118-bus case study shows that internal VRT capability can become a binding interconnection constraint: steady-state planning alone can overestimate feasible data center capacity, whereas increased UPS converter headroom progressively restores hosting capacity. Under the reduced-order response models studied, the grid-forming mode provides greater ride-through margin than the current-limited grid-following mode under the same network fault conditions. The results further show that VRT constraints can materially change both the total hosting capacity of data centers and its spatial allocation across candidate interconnection buses.

0.16