CS Paper Radar

Spatial LLM Workload Shifting Needs Foresight: Model Commitment for AI Data Center Operation under Power Grid Constraints

Bojun Du, Hongyang Jia, Tonghui Li, Qingchun Hou, Ze Wang, Ershun Du, Ning Zhang

eess.SY ·submitted 2026-09-09 06:37 UTC · v1

Abstract

AI data centers may face power supply shortages during certain periods, requiring operators to shift large language model (LLM) inference workloads spatially to maintain service rates. However, existing workload-shifting methods typically assume that any data center with sufficient computing resources can immediately serve shifted requests, which may lead to infeasible transfers and unserved demand. This letter proposes model commitment (MC), a mixed-integer linear programming framework that jointly schedules model deployment and cross-site request routing under power constraints and electricity-price signals. First, MC formulates the intertemporal coupling introduced by model replica loading. Second, it translates prefill and decode latency requirements into the amount of demand that each replica can serve. Case studies based on real-world data show that MC enables AI data center operators to achieve a 100% service rate under time-varying grid conditions and reduce total operating cost by 29.0%.

Comment
3 pages, 2 figures

Closest papers

Nearest neighbours by meaning across the whole index.

Grid Demand Flexibility Assessment of AI Data Centers via Batch Workload Temporal Shifting

eess.SY ·2026-09-29 ·Suntao Su, Liang Du, Shengyi Wang
similarity 0.73
Abstract · 5 pages, 5 figures, conference

The rapid growth of artificial intelligence (AI) data centers has introduced new challenges to power system operation. As their power demand becomes larger and more variable, quantitatively characterizing their demand flexibility is increasingly important for effective power system coordination. However, heterogeneous workload characteristics and resource requirements make this flexibility difficult to characterize directly. This paper proposes a framework for assessing the grid-compatible demand flexibility of AI data centers via batch workload temporal shifting. An averaging-based resource usage processing method is developed to map fine-resolution CPU, GPU and memory usage into unified time intervals compatible with power system operation. A workload temporal scheduling model is then formulated to shift batch workloads while preserving execution continuity, delay constraints, and server resource capacities, and is coupled with a utilization-dependent server power model to translate workload scheduling decisions into server power demand. Two complementary flexibility metrics are evaluated: short-term peak demand shaving and the maximum duration of sustained power reduction. Numerical results based on real GPU cluster traces demonstrate that workload temporal shifting can provide quantifiable and grid-compatible demand flexibility for AI data centers with limited disruption to computing workloads.

0.13

Quantifying the hosting capacity value of workload flexibility for AI data centers: A two-stage electricity-computation co-optimization framework

eess.SY ·2026-11-18 ·Jiakai Wu, Wei Sun, Pengyu Ren, Yifan Wang
hot direction similarity 0.72
Abstract

Grid connection constraints increasingly limit the expansion of AI data centers, yet the additional hosting capacity enabled by computational workload flexibility remains insufficiently quantified. This paper develops a two-stage electricity--computation co-optimization framework to quantify the individual and coordinated hosting capacity values of spatial and temporal workload flexibility. Data center capacities are determined endogenously, with computational task arrivals scaling with admitted capacity. Spatial routing of eligible interactive requests and temporal deferral of batch workloads are linked to server operation and facility power demand, subject to workload completion requirements and transmission constraints. The first stage maximizes aggregate hosting capacity; the second fixes the resulting site capacities and optimizes annual workload scheduling and generation dispatch to minimize generation and carbon costs. An 8760-hour case study with three data centers on a modified IEEE 118-bus system shows that temporal and spatial flexibility individually increase hosting capacity by 21.26\% and 5.37\%, respectively. Their coordinated use raises hosting capacity from 4635.1~MW to 6231.5~MW, a 34.44\% increase without network reinforcement. The coordinated gain exceeds the sum of the individual gains by 361.9~MW, demonstrating complementarity between spatial migration and temporal deferral. By redistributing computational demand across locations and operating hours, these mechanisms enable fuller utilization of existing transmission capacity. The findings establish workload flexibility as a quantifiable planning resource for accommodating additional data center capacity within existing transmission networks.

0.28

Job-Level Workload Allocation for Data Centers Under Flexible Interconnections

eess.SY ·2026-11-14 ·Tanmay Mishra, Arash Omidi, Mads R. Almassalkhi
hot direction similarity 0.70
Abstract · Submitted to IEEE PES General Meeting 2027

Flexible interconnections allow data centers to connect to the grid sooner without upgrading the grid infrastructure, if they accept limits on their grid power during periods of grid stress. When a limit is reached, the data center must slow some of its computing jobs. This choice sets the cost of flexibility, because the work done by a job is worth far more than the energy it uses. This paper models how jobs respond when their power is reduced, and proposes a real-time method that shares the available power among jobs according to their value. It also gives grid planners a simple measure of how much power a data center can reduce, and for how long. A one-year case study of a 100-MW data center shows that the proposed method lowers the cost of meeting grid limits, and that on-site generation and storage lower it further.

0.31

Locational Marginal Pricing of Compute: Co-optimizing Compute and Energy for Transparent Data Center Flexibility

eess.SY cs.AI ·2026-11-15 ·Vladimir Pyltsov, Teng Zeng
similarity 0.69
Abstract

Demand from data centers and AI compute is growing rapidly and is increasing stress on the power grid. This load could be flexible through user adjustments and provide relief during energy scarcity events, yet today its flexibility is provided through utility call-ups or system-operator load shedding, and is invisible to the users whose workloads are being curtailed. In this work, we propose to quantify and couple the prices of compute and energy in a single optimization problem. The resulting compute price reflects the marginal cost of the binding constraints and decomposes into components indicating which grid, power, hardware, or service requirement causes a price surge. The economic interpretation updates the price with real-time conditions and gives users a signal for potential flexibility provision. The co-optimization ultimately connects compute and energy markets while providing a signal for relief of stress on both the grid and the compute resources.

0.32

AI Inference-Aware Optimal Power Flow: Converting Token Requirements into Grid Flexibility

eess.SY ·2026-11-14 ·Qianyi Ma, Dawei Qiu, Xiao Liu
similarity 0.69
Abstract

The rapid growth, temporal variability, and geographic concentration of electricity demand from artificial intelligence (AI) inference can aggravate transmission congestion near data centers (DCs). The spatial and temporal flexibility of inference workloads offers an opportunity to alleviate this congestion: requests can be routed across DCs or deferred within users' quality-of-service (QoS) requirements. However, inference routing primarily considers graphics processing unit (GPU) availability, leaving this flexibility underused in grid operation. Using GPU measurements, this paper models inference latency and DC power consumption to quantify the flexibility available under users' time-to-first-token (TTFT) and inter-token latency (ITL) requirements. These models are then incorporated into an AI inference-aware optimal power flow (OPF) that coordinates inference routing and power system operation among DC operators, the transmission system operator, and inference users. By linking user requests, token generation at DCs, and electricity delivery through the transmission network, the formulation schedules inference workloads subject to both users' QoS requirements and transmission constraints. Simulations on the PJM system show that, compared with computing-based routing and with electricity price-based routing, coordinating inference routing with network operation enables growing DC electricity demand deliverable to be met at lower cost.

0.25

Unlocking AI Data Center Interconnection Capacity Through Coordinated Grid and Data Center Flexibility

eess.SY ·2026-10-04 ·Rida Fatima, Xingpeng Li
similarity 0.69
Abstract

The rapid growth of AI data centers is creating concentrated electricity demands that can exceed available distribution network headroom and delay interconnection. This paper investigates whether capacity can be used effectively by coordinating flexibility on both sides of the interconnection. A day-ahead mixed integer second order cone programming framework maximizes feasible AI data center IT capacity using utility side conservation voltage reduction and network topology reconfiguration, together with data center workload shifting and reserve constrained uninterruptible power supply storage. Background feeder demand uses voltage dependent ZIP models, while the data center is modeled as constant power demand using Training, Inference, and Mixed workload profiles. A two-stage solution first maximizes interconnection capacity and then minimizes feeder losses for the retained capacity, with numerical relaxation screening. Studies on a 116-bus model derived from the IEEE 123-node feeder show that, at the constrained bus-60 connection point, grid side flexibility, driven almost entirely by network reconfiguration, increases feasible IT capacity by approximately 42.5-45.0%, while data center flexibility alone provides approximately 2.1-5.4% gains. Coordinated operation increases feasible IT capacity from approximately 10.5-10.6 MW under BASE operation to 15.3-16.0 MW, corresponding to gains of approximately 45.9-50.8%; the 16.0 MW Inference result is limited by the adopted UPS reserve requirement. Benefits are strongly location dependent and influenced by workload flexibility, deferral duration, PUE, UPS energy and reserve requirements, and feeder loading. Under a combined adverse operating condition, FULL capacity decreases by only 3.4% relative to the nominal Mixed case while retaining substantial additional capacity over BASE.

0.08

Mitigating the Grid Impact of Gigawatt-Scale AI Data Centers via High-Fidelity Model Flexibility

eess.SY math.OC ·2026-11-18 ·Eihab E. E. Ahmed, Saeed Manshadi
hot direction similarity 0.69
Abstract

Gigawatt-scale artificial intelligence data centers (AIDCs) are being connected at a single point of interconnection (POI) faster than transmission can be reinforced, yet studies of their flexibility rely on DC power flow and simplified load envelopes that omit voltage, cooling dynamics, and workload deadlines. This paper addresses this gap by embedding a high-fidelity AIDC model, with separate inference and training pools, hall thermal mass, PV, a battery energy storage system (BESS) with reactive capability, and a STATCOM, in a five-minute multi-period AC optimal power flow. Simulations on the RTS-GMLC test system show that active-power flexibility mitigates local price spikes and relieves congestion, whereas reactive support from the BESS inverter or a STATCOM is needed to keep the POI voltage away from sagging around its 0.95~pu limit. Sensitivity analyses show that cost-driven charging of large batteries can induce new morning congestion and that storage largely substitutes for wider workload deferral.

0.30

Minimizing Grid Interconnection Capacity Requirements for AI Data Centers: A Developer-Side Planning Framework with Onsite Resources and Workload Flexibility

eess.SY ·2026-08-29 ·Hassan Zahid Butt, Rida Fatima, Xingpeng Li
similarity 0.68
Abstract

Securing grid interconnection capacity has become a bottleneck for AI data center projects and can take longer than constructing the facilities themselves. This mismatch can delay deployment for years, making early interconnection planning essential. This paper develops ICP-AI, an interconnection capacity planning framework from a data center developer's perspective. The framework minimizes grid import capacity under a prescribed onsite investment budget while jointly sizing photovoltaic (PV) and battery energy storage system (BESS) resources and scheduling deadline constrained workload flexibility. A secondary refinement fixes the minimum grid capacity and selects the minimum-investment PV-BESS portfolio among solutions that achieve that capacity. The framework is evaluated using monthly composite stress profiles across varying temporal assumptions, load shapes, flexible load fractions, and deferral windows. Results show that interconnection capacity reduction depends strongly on the planning environment: at a $100M budget, it is about 6% for the high load factor baseline, exceeds 10% under monthly average solar availability, and reaches 13.3% for a more diurnal load. At a $10M budget, 5% flexible load with a 1 h workload deferral window reduces BESS capacity from 15.30 to 4.87 MWh while increasing capacity reduction from 4.43% to 4.84%. To test sensitivity to temporal compression, the model is also solved over the full 8,760 h chronology, which preserves the main capacity and flexibility trends. Overall, ICP-AI quantifies the interconnection capacity and infrastructure substitution value of workload flexibility, providing an investment-interconnection frontier to support capital allocation and early project planning in constrained grid environments.

0.12