CS Paper Radar

Reshaping Checkpoint-Induced Power Variations Through Inference Workload Scheduling

Yu Ma, Ziheng Sheng, Anna Andriiko, Chau-Wai Wong, Jong Ha Woo, Zishuo Yang, Aaditya Pandey, Wenyuan Tang, Ning Lu

eess.SY ·submitted 2026-11-09 16:03 UTC · v1
hot direction

Abstract

Synchronous checkpoints in large language model training cause rapid power variations that challenge frequency regulation in islanded data-center microgrids. This paper proposes a checkpoint-aware two-layer framework that schedules flexible inference workloads to compensate for checkpoint-induced disturbances. Using measured GPU power profiles and anticipated checkpoint power deficits, the upper layer coordinates heterogeneous task selection and launch times, while the lower layer adjusts the batch sizes of newly launched tasks online to correct power-tracking errors. Early launching (EL) and staged retirement (SR) further smooth power transitions at checkpoint onset and recovery, respectively. PSCAD/EMTDC simulations with reference checkpoint drops of 1-3 MW demonstrate reductions of 41.6-61.6% in maximum absolute frequency deviation and 68.5-89.6% in mean absolute frequency deviation relative to no scheduling. Battery energy storage system (BESS) peak charging power and charging energy decrease by 65.1-100% and 89.7-100%, respectively. These benefits exceed those of greedy scheduling when GPU resources are relatively abundant.

Closest papers

Nearest neighbours by meaning across the whole index.

Execution-Feasible Dispatch of LLM Pre-training Loads for Renewable-Dominant AI Data Centers

cs.DC ·2026-10-09 ·Xi Tong, Ershun Du, Haiyang Jiang, Long Chen, Qin Wang
similarity 0.73
Abstract · 12 Figures, 6 Tables

AI data centers (AIDCs) are emerging as large power-system loads, making their operational flexibility increasingly valuable. Existing studies often treat AIDC demand as continuously adjustable or generically delay-tolerant, which overstating the flexibility of large language model (LLM) pretraining. This paper proposes an execution-feasible dispatch framework for LLM pre-training in renewable-dominant AIDCs. LLM descriptors are first converted into checkpoint-domain daily workloads, then mapped to feasible 3D-parallel GPU modes with explicit throughput, GPU-capacity, memory, and IT-power limits. The resulting checkpoint- and mode-constrained load states are embedded into a day-ahead power dispatch model. Case studies on a 2048 GPUs AIDC with two LLaMA pretraining tasks show that checkpoint-aware 3D dispatch reduces operating cost by 20.02% and renewable curtailment from 1.077 to 0.014 MWh relative to fixed continuous training. Related results also show that checkpoint records alone do not create load flexibility,practical grid-interactive flexibility arises from checkpoint waiting combined with execution-feasible 3D-mode compensation.

0.20

Data Center Load Accommodation under QoS and Checkpoint-Induced Frequency Security Constraints

eess.SY ·2026-10-16 ·Ruolan Cui, Ziang Liu, Chenxi Hu, Francis Yunhe Hou
benchmark similarity 0.70
Abstract · 10 pages

The rapid growth of artificial intelligence workloads is accelerating the expansion and grid interconnection of data centers (DCs). Existing data center load accommodation (DCLA) assessments primarily focus on grid and resource adequacy and often imply that greater workload flexibility always increases accommodable capacity. However, workload flexibility has a dual effect. Workload deferral and temporal shifting can alleviate network congestion, whereas synchronized checkpointing of training workloads can cause large and rapid load reductions, threatening frequency stability. Therefore, DCLA cannot be determined solely by grid adequacy. This paper develops an optimal DCLA method that jointly accounts for workload quality of service (QoS), checkpoint-induced frequency security (FS), and grid adequacy. First, a QoS-aware model characterizes workload-dependent flexibility while ensuring service feasibility. Second, checkpoint-induced FS constraints are developed for periodic and event-triggered power variations, with key frequency-security limits reformulated in algebraic form. Third, a two-stage lexicographic model is developed to maximize DCLA and minimizes the required energy storage (ES) deployment, and then optimizes system operation under the given DC and ES siting and sizing decisions. Case studies show that the proposed method avoids a 40.3% overestimation of DCLA compared with the grid-adequacy benchmark. QoS is the primary limiting factor, while checkpoint-induced frequency-security constraints become more restrictive as training workloads increase. These findings highlight that reliable DCLA should account for both its grid-support value and the associated QoS and FS risks.

0.16

Capacity Credit of Data-Centre Flexibility: The Role of Workload Scheduling and Usable Battery Energy

eess.SY ·2026-11-17 ·Pengyu Ren, Wei Sun, Jiakai Wu, Yifan Wang
similarity 0.63
Abstract

Data centres that offer the same reduction in grid demand can make different contributions to supply adequacy. We estimate the effective load-carrying capability of workload scheduling and on-site batteries by matching expected unserved energy across paired simulations. Longer task deadlines increase capacity credit by giving operators more choice over when to defer and recover work. A fixed evening commitment shifts more work than deadline-based scheduling but delivers a smaller reduction in expected unserved energy. Protected backup reserves leave uninterruptible power supplies with limited capacity credit, while longer discharge durations raise the credit of dedicated batteries at the same response rating. These findings suggest assessing recovery deadlines and dispatchable energy alongside offered demand reductions.

0.20

Grid Demand Flexibility Assessment of AI Data Centers via Batch Workload Temporal Shifting

eess.SY ·2026-09-29 ·Suntao Su, Liang Du, Shengyi Wang
similarity 0.61
Abstract · 5 pages, 5 figures, conference

The rapid growth of artificial intelligence (AI) data centers has introduced new challenges to power system operation. As their power demand becomes larger and more variable, quantitatively characterizing their demand flexibility is increasingly important for effective power system coordination. However, heterogeneous workload characteristics and resource requirements make this flexibility difficult to characterize directly. This paper proposes a framework for assessing the grid-compatible demand flexibility of AI data centers via batch workload temporal shifting. An averaging-based resource usage processing method is developed to map fine-resolution CPU, GPU and memory usage into unified time intervals compatible with power system operation. A workload temporal scheduling model is then formulated to shift batch workloads while preserving execution continuity, delay constraints, and server resource capacities, and is coupled with a utilization-dependent server power model to translate workload scheduling decisions into server power demand. Two complementary flexibility metrics are evaluated: short-term peak demand shaving and the maximum duration of sustained power reduction. Numerical results based on real GPU cluster traces demonstrate that workload temporal shifting can provide quantifiable and grid-compatible demand flexibility for AI data centers with limited disruption to computing workloads.

0.13

Privacy-Preserving Coordinated Operation of Power Grids and AI Data Centers: A Checkpoint-Aware Three-Phase Scheme

eess.SY ·2026-09-22 ·Ziang Liu, Ruizhang Yang, Xin Cui, Francis Yunhe Hou
similarity 0.61
Abstract · 10 pages

The rapid growth of large language model training and serving is driving AI data centers (AIDCs) toward gigawatt scale. Unlike conventional commercial loads, AIDCs possess significant operational flexibility through dynamic voltage and frequency scaling (DVFS) of training and inference workloads, while periodic model checkpointing can induce abrupt power drops and rebounds that erode operating reserves and increase transmission congestion risks. Coordinating AIDC operation with grid scheduling under these unique operational characteristics is challenging because grid and AIDC operators are generally unwilling to share proprietary data and decision-making authority. This paper proposes a hierarchical privacy-preserving coordinated operation scheme between the power grid and AIDCs to address this gap. The proposed scheme contains three phases. In Phase I, the grid operator computes a certified inner approximation of the AIDCs security region for subsequent coordination. In Phase II, the AIDC operator coordinates training and inference AIDCs to optimize workload allocation within the certified security region and generate power schedules and checkpoint alerts. In Phase III, the grid operator solves a checkpoint-aware two-stage robust optimal power flow (OPF) considering renewable generation and checkpoint uncertainties. By exchanging only compact interface information, the framework preserves the privacy of both grid and AIDCs, avoids frequent iterative communication, and enables secure coordination with guaranteed feasibility. Numerical studies on a modified IEEE 14-bus system and a modified NYISO system demonstrate the effectiveness, robustness, and security of the proposed framework.

0.19

Bao: Automatic Region Placement and Memory Allocation for Intermittent Computing

cs.PL ·2026-10-02 ·Byeongjee Kang, Jan Hoffmann, Limin Jia, Brandon Lucia, Feras A. Saad
top venuetheory similarity 0.61
Abstract · Accepted to ASPLOS '27. 28 pages, 12 figures, 10 tables

Intermittent computing enables batteryless embedded devices to operate in harsh environment, but frequent power failures interrupt program execution and require careful management of state across power cycles. The core challenge is to guarantee both memory consistency and forward progress while minimizing the energy overhead of checkpointing. Recent compile-time approaches identify regions that fit in the energy buffer. At runtime, the device waits and recharges between the regions. However, they still rely on greedy or path-local heuristics that commit to local decisions and can miss globally lower-overhead boundary placements. To address this limitation, we present Bao, a system that jointly finds optimal energy-aware region formation and memory allocation decisions with formal correctness guarantees, by formulating it as a mixed-integer linear program. We prove that any feasible solution guarantees energy safety and implement our approach in LLVM. Our evaluation on 13 benchmarks across 3 capacitor sizes shows that Bao outperforms existing baselines, achieving 10% faster execution and 52% fewer region boundary hits on average compared to the best baseline.

0.38

Profile Screening and Frequency-Secure Operating Limit Derivation for Data Center Microgrids

eess.SY ·2026-11-17 ·Zishuo Yang, Yu Ma, Jong Ha Woo, Aaditya Pandey, Wenyuan Tang +2 more
similarity 0.61
Abstract

Rapid power variations from artificial intelligence (AI) workloads pose frequency-security challenges for islanded data-center microgrids. This paper proposes a generator step- response-based framework to rapidly screen candidate load pro- files and derive frequency-secure operating limits for IT workload scheduling. Identified generator responses are superimposed to assess the cumulative frequency effects of successive load changes without repeated dynamic simulations. The framework identifies potentially unsafe intervals and determines allowable load magni- tudes, ramp rates, and minimum event spacing, while accounting for prediction uncertainty and governor limits. Validation on a 2.5 MVA islanded microgrid with eight generator configurations and 14 synthetic AI workload profiles shows that 94.75% of 40,208 assessment windows receive decisive screening labels, with no frequency-violating windows classified as secure.

0.37

Grid-Mode-Aware AI Data Center Power Smoothing via Bayesian-Optimized Hybrid Energy Storage System

eess.SY ·2026-11-02 ·Sina Mohammadi, Quang Manh Hoang, Marcus Chen I Wada, Van-Hai Bui, Wencong Su
similarity 0.60
Abstract · 6 pages, 5 figures, Submitted, 2027 IEEE Texas Power and Energy Conference (TPEC)

AI data centers exhibit highly stochastic, volatile power demands from intensive workloads and synchronized GPU training cycles, which can excite grid natural frequencies and threaten system stability. This paper proposes a real-time, forecasting-independent control framework utilizing a Hybrid Energy Storage System (HESS) that coordinates a Battery Energy Storage System (BESS) and a supercapacitor (SC). Employing a parameterized frequency-decoupling and active modal-damping policy, the framework mitigates critical oscillatory load components while smoothing overall power fluctuations. To bypass the heavy computational burden of online receding-horizon optimization, this work introduces an offline Bayesian Optimization (BO) approach to optimally tune real-time control parameters, minimizing a multi-objective cost function that balances grid compliance penalties and storage degradation. Numerical simulations demonstrate that the proposed method ensures grid stability and strong target envelope adherence. Specifically, it reshapes extreme 75-160 MW raw demand fluctuations to largely fit within a tight 10 MW target band, with only brief transient excursions, while attenuating the critical 20 MW oscillatory component below 1 MW to suppress resonant excitation.

0.20