CS Paper Radar

Grid Demand Flexibility Assessment of AI Data Centers via Batch Workload Temporal Shifting

Suntao Su, Liang Du, Shengyi Wang

eess.SY ·submitted 2026-09-29 17:02 UTC · v1

Abstract

The rapid growth of artificial intelligence (AI) data centers has introduced new challenges to power system operation. As their power demand becomes larger and more variable, quantitatively characterizing their demand flexibility is increasingly important for effective power system coordination. However, heterogeneous workload characteristics and resource requirements make this flexibility difficult to characterize directly. This paper proposes a framework for assessing the grid-compatible demand flexibility of AI data centers via batch workload temporal shifting. An averaging-based resource usage processing method is developed to map fine-resolution CPU, GPU and memory usage into unified time intervals compatible with power system operation. A workload temporal scheduling model is then formulated to shift batch workloads while preserving execution continuity, delay constraints, and server resource capacities, and is coupled with a utilization-dependent server power model to translate workload scheduling decisions into server power demand. Two complementary flexibility metrics are evaluated: short-term peak demand shaving and the maximum duration of sustained power reduction. Numerical results based on real GPU cluster traces demonstrate that workload temporal shifting can provide quantifiable and grid-compatible demand flexibility for AI data centers with limited disruption to computing workloads.

Comment
5 pages, 5 figures, conference

Closest papers

Nearest neighbours by meaning across the whole index.

AI Inference-Aware Optimal Power Flow: Converting Token Requirements into Grid Flexibility

eess.SY ·2026-11-14 ·Qianyi Ma, Dawei Qiu, Xiao Liu
similarity 0.75
Abstract

The rapid growth, temporal variability, and geographic concentration of electricity demand from artificial intelligence (AI) inference can aggravate transmission congestion near data centers (DCs). The spatial and temporal flexibility of inference workloads offers an opportunity to alleviate this congestion: requests can be routed across DCs or deferred within users' quality-of-service (QoS) requirements. However, inference routing primarily considers graphics processing unit (GPU) availability, leaving this flexibility underused in grid operation. Using GPU measurements, this paper models inference latency and DC power consumption to quantify the flexibility available under users' time-to-first-token (TTFT) and inter-token latency (ITL) requirements. These models are then incorporated into an AI inference-aware optimal power flow (OPF) that coordinates inference routing and power system operation among DC operators, the transmission system operator, and inference users. By linking user requests, token generation at DCs, and electricity delivery through the transmission network, the formulation schedules inference workloads subject to both users' QoS requirements and transmission constraints. Simulations on the PJM system show that, compared with computing-based routing and with electricity price-based routing, coordinating inference routing with network operation enables growing DC electricity demand deliverable to be met at lower cost.

0.25

Spatial LLM Workload Shifting Needs Foresight: Model Commitment for AI Data Center Operation under Power Grid Constraints

eess.SY ·2026-09-09 ·Bojun Du, Hongyang Jia, Tonghui Li, Qingchun Hou, Ze Wang +2 more
similarity 0.73
Abstract · 3 pages, 2 figures

AI data centers may face power supply shortages during certain periods, requiring operators to shift large language model (LLM) inference workloads spatially to maintain service rates. However, existing workload-shifting methods typically assume that any data center with sufficient computing resources can immediately serve shifted requests, which may lead to infeasible transfers and unserved demand. This letter proposes model commitment (MC), a mixed-integer linear programming framework that jointly schedules model deployment and cross-site request routing under power constraints and electricity-price signals. First, MC formulates the intertemporal coupling introduced by model replica loading. Second, it translates prefill and decode latency requirements into the amount of demand that each replica can serve. Case studies based on real-world data show that MC enables AI data center operators to achieve a 100% service rate under time-varying grid conditions and reduce total operating cost by 29.0%.

0.24

Mitigating the Grid Impact of Gigawatt-Scale AI Data Centers via High-Fidelity Model Flexibility

eess.SY math.OC ·2026-11-18 ·Eihab E. E. Ahmed, Saeed Manshadi
hot direction similarity 0.73
Abstract

Gigawatt-scale artificial intelligence data centers (AIDCs) are being connected at a single point of interconnection (POI) faster than transmission can be reinforced, yet studies of their flexibility rely on DC power flow and simplified load envelopes that omit voltage, cooling dynamics, and workload deadlines. This paper addresses this gap by embedding a high-fidelity AIDC model, with separate inference and training pools, hall thermal mass, PV, a battery energy storage system (BESS) with reactive capability, and a STATCOM, in a five-minute multi-period AC optimal power flow. Simulations on the RTS-GMLC test system show that active-power flexibility mitigates local price spikes and relieves congestion, whereas reactive support from the BESS inverter or a STATCOM is needed to keep the POI voltage away from sagging around its 0.95~pu limit. Sensitivity analyses show that cost-driven charging of large batteries can induce new morning congestion and that storage largely substitutes for wider workload deferral.

0.30

LLM-Powered Predictive Decision-Making for Sustainable Data Center Operations

cs.LG ·2026-08-19 ·Hanzhao Wang, Jingxuan Wu, Yumeng Li, Yu Pan, Guanting Chen
similarity 0.72
Abstract

The growing demand for AI-driven workloads, particularly from Large Language Models (LLMs), has raised concerns about the significant energy and resource consumption in data centers. This work introduces a novel LLM-based predictive scheduling system designed to enhance operational efficiency while reducing the environmental impact of data centers. Our system utilizes an LLM to predict key metrics such as execution time and energy consumption from source code, and it has the potential to extend to other sustainability-focused metrics like water usage for cooling and carbon emissions, provided the data center can track such data. The predictive model is followed by a real-time scheduling algorithm that allocates GPU resources, aiming to improve sustainability by optimizing both energy consumption and queuing delays. With fast inference times, the ability to generalize across diverse task types, and minimal data requirements for training, our approach offers a practical solution for data center scheduling. This framework demonstrates strong potential for advancing sustainability objectives in AI-driven infrastructure. Through our collaboration with a data center, we achieved a 32% reduction in energy consumption and a 30% decrease in waiting time.

0.08

Job-Level Workload Allocation for Data Centers Under Flexible Interconnections

eess.SY ·2026-11-14 ·Tanmay Mishra, Arash Omidi, Mads R. Almassalkhi
hot direction similarity 0.72
Abstract · Submitted to IEEE PES General Meeting 2027

Flexible interconnections allow data centers to connect to the grid sooner without upgrading the grid infrastructure, if they accept limits on their grid power during periods of grid stress. When a limit is reached, the data center must slow some of its computing jobs. This choice sets the cost of flexibility, because the work done by a job is worth far more than the energy it uses. This paper models how jobs respond when their power is reduced, and proposes a real-time method that shares the available power among jobs according to their value. It also gives grid planners a simple measure of how much power a data center can reduce, and for how long. A one-year case study of a 100-MW data center shows that the proposed method lowers the cost of meeting grid limits, and that on-site generation and storage lower it further.

0.31

Beyond Scalar Flexibility: From Eligible AI Workloads to Dependable Load Relief

eess.SY cs.DC ·2026-09-04 ·Meiyi Li
similarity 0.71
Abstract · 20 pages, 18 figures, 5 tables. Code and derived data: https://doi.org/10.5281/zenodo.22308423

Grid studies often represent data-center flexibility as a fixed percentage of load, although no public production trace has shown how much eligible load persists across event durations or co-moves across clusters. We reconstruct 4,439 hourly power observations from a 185-day trace of 155,410 GPUs and derive a workload-semantic flexibility envelope. The fleet's time-averaged Monte Carlo median facility demand is 55.8 MW, while immediate eligible curtailment averages 3.55 MW after retaining allocated-GPU idle power: 12.1% of workload power and 6.35% of median facility power. Under full realization of that eligibility, 95%-available relief falls from 2.51 MW for one hour to 2.32 MW for four hours and 1.95 MW for 24 hours; a common realizable fraction q scales every value exactly by q. A mean-calibrated scalar overstates these quantities by 17%, 25%, and 47%, while a scalar tail-calibrated at four hours understates the one-hour product by 6% and overstates the 24-hour product by 17%; the share that reproduces the surface varies by a factor of 1.6 across durations and reliability levels. Aggregating 13 clusters raises four-hour firmness from 0.38 to 0.66, but cross-cluster covariance limits the gain. The production scheduler exposes almost no additional delay-based capacity: newly deferrable arrivals average 0.008 MW and have zero 95%-available capacity. These results replace an assumed flexibility percentage with duration, reliability, portfolio, and realizability terms that can be written into interconnection and demand-response contracts.

0.20

Minimizing Grid Interconnection Capacity Requirements for AI Data Centers: A Developer-Side Planning Framework with Onsite Resources and Workload Flexibility

eess.SY ·2026-08-29 ·Hassan Zahid Butt, Rida Fatima, Xingpeng Li
similarity 0.71
Abstract

Securing grid interconnection capacity has become a bottleneck for AI data center projects and can take longer than constructing the facilities themselves. This mismatch can delay deployment for years, making early interconnection planning essential. This paper develops ICP-AI, an interconnection capacity planning framework from a data center developer's perspective. The framework minimizes grid import capacity under a prescribed onsite investment budget while jointly sizing photovoltaic (PV) and battery energy storage system (BESS) resources and scheduling deadline constrained workload flexibility. A secondary refinement fixes the minimum grid capacity and selects the minimum-investment PV-BESS portfolio among solutions that achieve that capacity. The framework is evaluated using monthly composite stress profiles across varying temporal assumptions, load shapes, flexible load fractions, and deferral windows. Results show that interconnection capacity reduction depends strongly on the planning environment: at a $100M budget, it is about 6% for the high load factor baseline, exceeds 10% under monthly average solar availability, and reaches 13.3% for a more diurnal load. At a $10M budget, 5% flexible load with a 1 h workload deferral window reduces BESS capacity from 15.30 to 4.87 MWh while increasing capacity reduction from 4.43% to 4.84%. To test sensitivity to temporal compression, the model is also solved over the full 8,760 h chronology, which preserves the main capacity and flexibility trends. Overall, ICP-AI quantifies the interconnection capacity and infrastructure substitution value of workload flexibility, providing an investment-interconnection frontier to support capital allocation and early project planning in constrained grid environments.

0.12

Creating Power Flexibility in Datacenters via Query Routing

cs.AI ·2026-11-03 ·Shivam Patel, Bingqing Chen, Jared Fernandez, Guannan Qu, Gauri Joshi
similarity 0.71
Abstract

The growing energy requirements of large language model inference highlight the need for datacenters to support safe grid operation by providing power demand flexibility, while maintaining service for interactive workloads. This work investigates query routing as a mechanism to enable such capability by dynamically allocating queries across different language model instances without deferring requests. We develop a general analytical framework that connects query arrival rates and sequence length distributions to token iteration time, request residence time, serving capacity, and power consumption of model instances. Leveraging this framework, we characterize the feasible query routing allocations and the corresponding power demand flexibilities, enabling the selection of routing strategies to achieve desired power consumption behavior. We validate our framework across four GPU platforms on language models ranging from 1B to 70B parameters, obtaining 2.8% mean absolute percentage error in estimating achievable power flexibility. We evaluate our approach on a real trace-driven simulation of a 10,000 H100 GPUs datacenter, exhibiting flexibility up to 16% of total power consumption, with 90% of the desired power reduction achieved within approximately 10 seconds. These results establish query routing as an effective mechanism for datacenter power demand flexibility and demonstrate the broader applicability of our proposed framework to datacenter level planning and orchestration.

0.12