CS Paper Radar

Large-Scale Data Center Integration in Power Systems: Uncertainty and Multi-Scale Variation

Le Xie, Dongjoo Kim, Qian Zhang, Grant Ruan, Paul L. Joskow

eess.SY ·submitted 2026-10-09 19:37 UTC · v1
published

Abstract

Hyperscale artificial intelligence (AI) data centers are emerging as a structurally new class of electricity demand. Unlike conventional loads, they materialize as spatially concentrated, transmission-level point loads with rapid deployment timelines and converter-dominated dynamics. Their integration is governed by two defining properties: forecast uncertainty in load realization and multi-scale temporal variation spanning sub-seconds to planning horizons. We develop a unified framework that links reliability and affordability to these dimensions through a four-quadrant structure: (reliability, affordability) $\times$ (uncertainty, variation), which integrates probabilistic resource adequacy, generation and transmission expansion, operational security, and market design. Measured traces from a public generative-AI workload dataset show strongly tonal GPU power spectra rather than smooth broadband behavior: harmonic combs at the training-step cadence, and a distinct sub-second periodicity in inference. Across these traces the dominant variance band shifts with workload type (seconds for training and offline inference; tens of seconds and longer for online inference). We report this as a characterization of the measured workloads rather than a universal signature, and take it to indicate that such loads warrant a spectral description rather than a peak-demand one. These signatures directly affect reserve requirements, ramping products, voltage stability, ride-through performance, and harmonic interactions in converter-rich grids. Taken together, the analytical framework and empirical results establish a system-level basis for assessing the reliability and cost implications of large AI data center integration across planning and operational horizons.

Comment
Accepted for publication in Proceedings of the IEEE. Copyright 2026 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses

Closest papers

Nearest neighbours by meaning across the whole index.

Grid-Oriented Probabilistic Load Forecasting for AI Data Centers

eess.SY cs.LG ·2026-11-06 ·Qingyi Yao, Ding Lin, Tianqiao Zhao, Meng Yue, Jianhui Wang
benchmark similarity 0.70
Abstract

Probabilistic load forecasts for AI data centers need to represent both uncertainty under changing workloads and temporal dependence to support grid operations. This paper develops an open, grid-oriented benchmark using measured GPU power from a 448-GPU AI cluster. Forecasts are evaluated through four stages: probabilistic prediction, online uncertainty calibration, temporal scenario generation, and horizon-wide reserve sizing. Following a change in cluster utilization, a quantile LightGBM forecast achieves only 63.4% coverage for a nominal 90% interval, while online regime-conditioned calibration increases coverage to 87.3%. Even with well-calibrated marginal forecasts, independent sampling produces unrealistic ramp distributions and excessive reserve procurement. Reconstructing temporal dependence from historical forecast errors reduces the discrepancy in ramp statistics and lowers realized reserve cost by 7.4-10.6% across three forecasting tasks. These findings show that marginal forecast quality alone is insufficient for operational decisions and motivate joint evaluation of calibration, temporal structure, and decision outcomes.

0.22

Grid Demand Flexibility Assessment of AI Data Centers via Batch Workload Temporal Shifting

eess.SY ·2026-09-29 ·Suntao Su, Liang Du, Shengyi Wang
similarity 0.69
Abstract · 5 pages, 5 figures, conference

The rapid growth of artificial intelligence (AI) data centers has introduced new challenges to power system operation. As their power demand becomes larger and more variable, quantitatively characterizing their demand flexibility is increasingly important for effective power system coordination. However, heterogeneous workload characteristics and resource requirements make this flexibility difficult to characterize directly. This paper proposes a framework for assessing the grid-compatible demand flexibility of AI data centers via batch workload temporal shifting. An averaging-based resource usage processing method is developed to map fine-resolution CPU, GPU and memory usage into unified time intervals compatible with power system operation. A workload temporal scheduling model is then formulated to shift batch workloads while preserving execution continuity, delay constraints, and server resource capacities, and is coupled with a utilization-dependent server power model to translate workload scheduling decisions into server power demand. Two complementary flexibility metrics are evaluated: short-term peak demand shaving and the maximum duration of sustained power reduction. Numerical results based on real GPU cluster traces demonstrate that workload temporal shifting can provide quantifiable and grid-compatible demand flexibility for AI data centers with limited disruption to computing workloads.

0.13

AI Inference-Aware Optimal Power Flow: Converting Token Requirements into Grid Flexibility

eess.SY ·2026-11-14 ·Qianyi Ma, Dawei Qiu, Xiao Liu
similarity 0.68
Abstract

The rapid growth, temporal variability, and geographic concentration of electricity demand from artificial intelligence (AI) inference can aggravate transmission congestion near data centers (DCs). The spatial and temporal flexibility of inference workloads offers an opportunity to alleviate this congestion: requests can be routed across DCs or deferred within users' quality-of-service (QoS) requirements. However, inference routing primarily considers graphics processing unit (GPU) availability, leaving this flexibility underused in grid operation. Using GPU measurements, this paper models inference latency and DC power consumption to quantify the flexibility available under users' time-to-first-token (TTFT) and inter-token latency (ITL) requirements. These models are then incorporated into an AI inference-aware optimal power flow (OPF) that coordinates inference routing and power system operation among DC operators, the transmission system operator, and inference users. By linking user requests, token generation at DCs, and electricity delivery through the transmission network, the formulation schedules inference workloads subject to both users' QoS requirements and transmission constraints. Simulations on the PJM system show that, compared with computing-based routing and with electricity price-based routing, coordinating inference routing with network operation enables growing DC electricity demand deliverable to be met at lower cost.

0.25

From Shared Demand Patterns to Local Uncertainty: Probabilistic Load Forecasting by Mixing Compact Adaptations

cs.LG cs.AI ·2026-10-06 ·Haoran Li, Zhe Cheng, Yang Weng
similarity 0.67
Abstract

Probabilistic load forecasting has been widely studied for power-system operation and planning, but customer- and transformer-level forecasting introduces a distinct scalability challenge. At these levels, load uncertainty is strongly affected by customer behavior, weather, and mixed load composition, making it difficult for a single shared model to capture heterogeneous patterns. Using separate probabilistic models can improve local accuracy, but becomes costly to train, store, update, and validate at scale. To address this challenge, we develop a scalable customer-aware forecasting framework that learns common demand behavior through a shared model while adapting only a compact subset of parameters. Rather than using an independent model for each load or assigning each load to a specialized model, the proposed design learns a small bank of low-dimensional adaptation components and allows each load to combine them according to its forecasting characteristics. This preserves shared knowledge across customers while providing sufficient flexibility for heterogeneous and mixed load compositions. Experiments on 590 load profiles from the SMART-DS dataset show consistent improvements in deterministic accuracy and probabilistic quality over statistical, neural-network, Transformer-based, and pretrained time-series baselines, while retaining low storage and inference costs.

0.12

Characterizing Job Power Elasticity for Power-Flexible AI Training

cs.AI ·2026-09-10 ·Philip Colangelo, Charles Dawson, Shayan Sengupta, Ayse Coskun, Varun Sivaram
similarity 0.66
Abstract

Large language model (LLM) training is among the fastest-growing sources of electricity demand in modern data centers, and power availability is a primary bottleneck to continued AI infrastructure growth. Making the power consumption of these workloads flexible could unlock additional power for AI growth, limit increases in electricity prices, and improve the utilization of existing grid infrastructure. However, to realize this flexibility, we must first understand how the performance of training workloads changes when GPU power is reduced. This paper presents the first systematic characterization of \emph{job power elasticity} (the sensitivity of throughput to power reductions) in LLM training. To quantify elasticity, we introduce the \emph{Power Flexibility Index (PFI)}, a normalized metric that quantifies the performance cost of power reductions and provides a control primitive for SLA-aware power flexibility. We collect data from 131 LLM training runs on H200 (plus 24 H200 validation runs and 34 matched H100 runs), including both dense and mixture-of-experts models, pretraining and fine-tuning tasks, and up to 32 GPUs. We find that LLM training jobs exhibit substantial but variable power elasticity, and we identify telemetry signals that predict PFI at runtime. Finally, we demonstrate that PFI-aware power allocation maximizes total tokens/second throughput under power constraints. Under a 30\% power reduction, PFI-aware power allocation recovers ~1.5k tokens/s per job, 63\% of the performance gap between an equal-weight allocation and an oracle with perfect information. Our results establish power elasticity as a measurable property of training jobs and provide a foundation for power-aware, grid-responsive AI infrastructure.

0.23

Mitigating the Grid Impact of Gigawatt-Scale AI Data Centers via High-Fidelity Model Flexibility

eess.SY math.OC ·2026-11-18 ·Eihab E. E. Ahmed, Saeed Manshadi
hot direction similarity 0.66
Abstract

Gigawatt-scale artificial intelligence data centers (AIDCs) are being connected at a single point of interconnection (POI) faster than transmission can be reinforced, yet studies of their flexibility rely on DC power flow and simplified load envelopes that omit voltage, cooling dynamics, and workload deadlines. This paper addresses this gap by embedding a high-fidelity AIDC model, with separate inference and training pools, hall thermal mass, PV, a battery energy storage system (BESS) with reactive capability, and a STATCOM, in a five-minute multi-period AC optimal power flow. Simulations on the RTS-GMLC test system show that active-power flexibility mitigates local price spikes and relieves congestion, whereas reactive support from the BESS inverter or a STATCOM is needed to keep the POI voltage away from sagging around its 0.95~pu limit. Sensitivity analyses show that cost-driven charging of large batteries can induce new morning congestion and that storage largely substitutes for wider workload deferral.

0.30

Speed-to-Power Dominates Energy Costs for AI Data Centers: Technoeconomic Analysis of Powering AI in the Continental United States

cs.AI eess.SY ·2026-11-12 ·Alex C. Newkirk, Daniel L. Gerber, Erica R. H. Fuchs, Alex Hubbard, M. Granger Morgan +3 more
code/datahot direction similarity 0.66
Abstract · 80 pages incl. SI

The rapid growth of artificial intelligence is driving demand for new data centers at large scale and on short deployment timelines. To power them, firms connect to the commercial grid or contract generation directly, but interconnection and gas-turbine delays now incentivize on-site generation. We compare grid-connected and off-grid data center energy infrastructure (AC- and DC-coupled solar-plus-storage, islanded natural gas, and grid interconnection) across the continental U.S. Using an open-source technoeconomic framework built on empirically calibrated AI training loads, climate-driven cooling, stage-by-stage power conversion, and physics-based battery degradation, we model designs providing equivalent energy services. Our central contribution is a speed-adjusted cost of energy that values the compute unlocked by faster construction, making options with different deployment timelines directly comparable on one physically consistent basis. We find DC coupling reduces lifetime energy costs by 18% ($0.09/ kWh) on average versus AC counterparts by eliminating inverters and improving efficiency. Though rarely cheapest on unadjusted energy cost, DC-coupled microgrids' faster deployment makes them the lowest-cost modeled option in 85% of U.S. locations once foregone compute is valued, or 55% under accelerated natural gas timelines. For AI infrastructure, deployment speed rather than unit energy cost determines the economically preferred path to power.

0.38

AI Data Centers Meet Electrical Grids: A Review of Power Challenges and Coordinated Solutions

eess.SY ·2026-10-06 ·Mariam Mughees, Yuzhuo Li, Yize Chen, Yunwei Ryan Li
survey similarity 0.65
Abstract

Artificial intelligence (AI) workloads are creating large, power-electronic loads whose effects on power systems depend on location, temporal variability, controllability, and interactions with other loads and resources. Annual electricity consumption alone cannot capture these effects. This review examines how AI data centers affect power systems stability, renewable-energy integration, and low-carbon planning by tracing the power-delivery chain from accelerators and workloads through rack converters, uninterruptible power supplies (UPS), storage, and microgrids to the transmission point of interconnection. Reported oscillatory events and multi-gigawatt load transfers highlight how facility responses can amplify disturbances, while programmable workloads and controllable power converters offer opportunities for demand flexibility. Challenges and mitigation strategies are organized across device, rack, facility, and power systems levels, spanning millisecond-to-year timescales. A bandwidth-matching framework relates disturbances to the response capabilities of mitigation resources. The review distinguishes computational energy efficiency from power systems and sustainability outcomes: lower energy consumption per token does not necessarily reduce peak demand, electrical disturbances, or carbon emissions. It examines how coordinated workload scheduling, grid-interactive UPS systems, storage, high-voltage DC distribution, and flexible interconnection can support reliability, efficiency, and decarbonization. Key research needs include dynamic load models, high-bandwidth telemetry, carbon-and grid-aware scheduling, and mechanisms for valuing flexible computational demand.

0.08