CS Paper Radar

Archive coverage constrains abstaining retrieval for transient stability screening more than conditional accuracy

Gregor Cerar, Denis Sodin, Matjaž Škrlec, Urban Rudež, Mihael Mohorčič, Miha Smolnikar

eess.SY ·submitted 2026-10-22 09:38 UTC · v1
code/data

Abstract

Power-grid transient stability is assessed by simulating credible faults, but repeating simulations as operating conditions change is costly, motivating faster critical clearing time estimators. Within the AI-ASSIST project, we developed a retrieval-based estimator around three adopted requirements: estimates retain their supporting states, retrieval abstains without compatible support, and support statistics are tested against observed error. Abstention turns estimator uncertainty into a demand on the archive. Exact switching-configuration equality is used. The dense synthetic BUS39 archive covers 99.9996% of 1,044,797 records; the operational ELES archive covers 73.47% of 322,823 records. At query time, 59.37% of ELES states have an earlier same-topology candidate. Under causal availability, retrieval covers 56.34% of records; on records covered under both protocols, mean absolute error increases by 10.0%. No tested support diagnostic ranks first on both grids. Most tested supervised regressors have lower error than retrieval on BUS39, all higher on the matched retrieval-covered ELES population. On ELES, gradient boosting becomes more accurate than retrieval when temporally adjacent states are excluded, so the accuracy trade depends on the archive. Under the adopted compatibility key, archive availability constrains deployment more than conditional accuracy on ELES. Compatible coverage and chronological availability are auditable before an estimator is fitted.

Comment
34 pages, 4 figures, 9 tables, including Supplementary Information. Submitted to Scientific Reports. Code and BUS39 data: https://github.com/sensorlab/AI-ASSIST

Closest papers

Nearest neighbours by meaning across the whole index.

EviCast: Forecasting Retrieval Gains Through Shared Response Calibration

cs.CL cs.LG ·2026-11-02 ·Yibo Wang, Jisheng Dang, Bimei Wang, Jiongpei Hou, Jingwen Zhao +7 more
code/data similarity 0.59
Abstract · 13 pages, 6 figures, 8 tables

Retrieval-augmented generation (RAG) extends large language models with external evidence, yet relevant evidence does not ensure that a generator can use it. Indiscriminate retrieval can degrade task performance while adding retrieval and long-context inference costs. Existing methods neither determine before large-scale execution whether a generator, task distribution, and retriever configuration is worth deploying nor diagnose multiple candidate retrievers under a shared budget. We introduce EviCast, a framework that forecasts retrieval value through interventional evidence-state decomposition. EviCast measures a generator's response to controlled evidence states once and combines this shared profile with the offline evidence-state distribution of each candidate retriever, yielding the end-to-end net utility and its 95% lower confidence bound without executing every RAG configuration. A state-refinement analysis characterizes when its binary and topology-aware instantiations are exact and when shared calibration is statistically more efficient than per-retriever calibration. In frozen evaluations, EviCast correctly decides all 14 HotpotQA retrieval configurations with a forecast error of 2.75 F1 points while reducing diagnostic generation calls by 80%, and it attains the lowest forecast error among seven predictors in the low-budget regime. Its topology-aware instantiation, EviCast-T, captures the complementarity between terminal and bridge evidence, correctly deciding all 16 configurations on MuSiQue and HotpotQA and 23 of 24 after prospective transfer to a third dataset. These results show that retrieval deployment depends on both evidence availability and the generator's ability to convert evidence structure into stable net utility. Code is available at https://github.com/YiboWang2002/EviCast.

0.26

EvEMTBench: An Open Benchmark for Machine Learning in Power System Protection

eess.SY cs.LG ·2026-09-23 ·Julian Oelhaf, Georg Kordowich, Christian Bergler, Andreas Maier, Johann Jäger +1 more
benchmarkcode/data similarity 0.56
Abstract · 15 pages, 3 figures. Supplementary information included. Code: https://github.com/EvEMTBench/evemtbench-benchmark

Studies of machine-learning-based power system protection are difficult to compare because task definitions, measurement access, data partitions, metrics, and generalization conditions often differ. EvEMTBench addresses this gap with an open, executable, and versioned benchmark that fixes these evaluation choices while leaving model design open. Across four grids spanning 20-345 kV, it defines 12 protection and event-analysis functions instantiated as 24 scored tasks and supports structured evaluation across observability conditions, predefined distribution shifts, and zero-shot and fine-tuned cross-grid transfer. Committed partitions, leakage controls, and reproducible reporting provide a common basis for comparing future methods. A reference evaluation spanning trivial, conventional, feature-based, and deep-learning baselines shows that wider observability is not uniformly beneficial, shifted conditions can reveal failures not apparent in-distribution, and cross-grid transfer is substantially stronger for fault detection than for fault localization. Protection-relevant diagnostics identify failure modes not apparent from primary metrics alone. EvEMTBench therefore makes generalization in machine-learning-based protection an explicit and reproducible evaluation problem.

0.22

Agreement Is Not Assurance: Evidence-Independent Safety Gates for Agentic AI in DER-Rich Distribution Grids

eess.SY ·2026-11-11 ·Qianxue Xia
similarity 0.55
Abstract · 10 pages, 3 figures, 4 tables

Physics-based safety gates for large language model (LLM) agents can approve unsafe actions when the agent and gate rely on the same corrupted measurements or network records. We formulate this shared-evidence failure for voltage-constrained distributed energy resource (DER) export decisions and analyze how nearly critical DER telemetry can bias state estimation while evading residual-based bad-data detection. We propose evidence-independent verification (EIV), which combines advanced metering infrastructure (AMI) voltage readings, measurement selection based on predicted voltage rise, and bounded physical probes. An IEEE 123-bus hidden-truth testbed evaluates 1,654 near-limit requests under telemetry attacks and record errors. For telemetry attacks targeting the nominal gate, an AC-twin gate with bad-data detection approved 95% of unsafe requests, compared with 3.1% for EIV; EIV rejected 22% of safe clean requests. At matched false-rejection settings, direct AMI checks outperformed incorporating the same readings into state estimation. Gate-targeted attacks exposed a vulnerability in telemetry-based response prediction. Command-based prediction removed that route, but targeted attacks on fresh validation cases still produced a 20% unsafe-approval rate under the tested attack pool. LLM agents frequently sought independent evidence voluntarily, but injected instructions and phase-label errors caused unsafe decisions. When offered the EIV checker as a tool, they used it in 93-100% of episodes; mandatory use did not reduce observed violations, which primarily reflected checker errors. These results distinguish enforcement of verification from reliability of the verifier itself.

0.34

A Benchmark Graph Dataset for Transient Stability Assessment of the IEEE 9-Bus System: 20,000 Scenarios with Full Generator Trajectories

eess.SY ·2026-08-18 ·Hussein Suprême, Martin de Montigny, Arnaud Zinflou
publishedbenchmark similarity 0.55
Abstract · Descriptor Open dataset IEEE9

Transient stability assessment determines whether a power system retains synchronism after a large disturbance. Machine-learning surrogates can accelerate it, but progress is limited by the lack of open datasets that combine dynamic ground truth, network graph structure, and machine parameters. We release a benchmark of 20,000 three-phase-to-ground fault scenarios on the IEEE 9-bus system. Each scenario couples an AC power-flow operating point with a detailed electromagnetic-transient simulation of the post-fault response. Every record provides the network as an attributed graph (nine buses, eighteen directed branches, ten node and twelve edge features), the full rotor-angle and speed trajectories of the three generators, the static machine constants, the fault description, and a center-of-inertia binary stability label. Wide load and generation scalings across eighteen fault locations yield a near-balanced distribution (48.96\% stable, 51.04\% unstable). Generation is deterministic and fully reproducible through fixed seeds and public code. The dataset is distributed on IEEE DataPort under a persistent DOI and supports stability classification, trajectory prediction, margin and critical-clearing-time estimation, and the comparison of topology-aware, physics-based, and hybrid learning methods.

0.43

Data Center Load Reductions: Attribution, Measurement Limits, and Estimation

eess.SY ·2026-10-28 ·Abdallah Alalem Albustami, Ahmad F. Taha, Mohammad Alwahdanee, Zuhaib Shakeel Muhammad
similarity 0.54
Abstract

Hundreds of gigawatts of data center loads are seeking interconnection in the United States given the massive growth of artificial intelligence and cloud computing. In recent years, several incidents of data centers reducing their loads by hundreds to thousands of megawatts have been documented, raising grid reliability concerns. U.S. regulators have since ordered reliability standards for the integration of computational loads, and the North American Electric Reliability Corporation (NERC) now calls on transmission owners to install disturbance recorders at these facilities to support root cause analysis. Such recorders usually observe only electrical quantities at the point of interconnection (POI). A sudden load reduction can be caused by a change in workload or a switch to backup supply. This work shows when POI measurements can distinguish the two mechanisms. It is established that they can produce identical POI voltage and current in a quasi-static constant power model, and during the transient their separation depends on the reduction relative to measurement noise, the clearing time, the dynamics through which workload reaches the POI, and the recorder bandwidth. When POI data are insufficient, an estimator that uses workload data is proposed to determine how much of the facility stayed connected. The results of this work identify the measurements and grid information utilities need to determine why data center load dropped.

0.31

Reshaping Checkpoint-Induced Power Variations Through Inference Workload Scheduling

eess.SY ·2026-11-09 ·Yu Ma, Ziheng Sheng, Anna Andriiko, Chau-Wai Wong, Jong Ha Woo +4 more
hot direction similarity 0.54
Abstract

Synchronous checkpoints in large language model training cause rapid power variations that challenge frequency regulation in islanded data-center microgrids. This paper proposes a checkpoint-aware two-layer framework that schedules flexible inference workloads to compensate for checkpoint-induced disturbances. Using measured GPU power profiles and anticipated checkpoint power deficits, the upper layer coordinates heterogeneous task selection and launch times, while the lower layer adjusts the batch sizes of newly launched tasks online to correct power-tracking errors. Early launching (EL) and staged retirement (SR) further smooth power transitions at checkpoint onset and recovery, respectively. PSCAD/EMTDC simulations with reference checkpoint drops of 1-3 MW demonstrate reductions of 41.6-61.6% in maximum absolute frequency deviation and 68.5-89.6% in mean absolute frequency deviation relative to no scheduling. Battery energy storage system (BESS) peak charging power and charging energy decrease by 65.1-100% and 89.7-100%, respectively. These benefits exceed those of greedy scheduling when GPU resources are relatively abundant.

0.29

Large Language Model Assisted Operational Monitoring for Battery Energy Storage System Integrated Power Distribution Networks

cs.AI cs.CLeess.SY ·2026-08-15 ·Azmeer Akhtar, Md Fazley Rafy, Anurag K. Srivastava
similarity 0.53
Abstract

Battery energy storage systems (BESS) are increasingly used in distribution networks for voltage regulation and demand response, which increases the volume and complexity of operational telemetry available to grid operators. This paper presents an AI-enabled monitoring framework that connects a large language model (LLM) interface with a structured telemetry database for BESS-integrated distribution system analysis. Operator questions are submitted in natural language and translated into validated SQL queries using predefined database schema information and approved KPI views. Retrieved measurements, including bus voltages, state of charge, active power, and reactive power, are evaluated against engineering constraints for voltage limits, BESS operation, and demand response tracking. The framework is validated using hardware-in-the-loop co-simulation data from a BESS-equipped distribution feeder operating under reactive power-based voltage control and price-driven demand response. Case studies show that the framework generates valid database queries, identifies repeated voltage violations, detects reactive power overshoot, and evaluates active-power tracking performance. The results show that LLM-assisted monitoring can connect structured grid telemetry with automated engineering assessment for BESS operation analysis.

0.04

TuneBench: Benchmarking AI Agents for Power System Dynamic Model Calibration

eess.SY ·2026-11-03 ·Andrea Pomarico, Salvatore Tessitore, Giorgio Giannuzzi, Alberto Berizzi
benchmarkcode/data similarity 0.53
Abstract

Large Language Model (LLM)-based agents can automate complex engineering workflows by interacting with tools, interpreting feedback, and making iterative decisions. This paper introduces TuneBench, a benchmark for evaluating Agentic AI in power system dynamic model calibration, where controller parameters are adjusted to reproduce target dynamic responses. The benchmark reflects a common Transmission System Operator (TSO) practice, in which equivalent models used for Dynamic Security Assessment (DSA) are calibrated against measurements from grid-code compliance tests when proprietary models are unavailable. Two cases of increasing complexity are considered: the governor and Automatic Voltage Regulator (AVR) of a synchronous generator and the control system of a Battery Energy Storage System (BESS), both tuned against active-power and voltage step tests within a budget of 15 simulations. LLM-based agents are compared with random search and Genetic Algorithm (GA) baselines over 10 independent runs. Only the most advanced models, Opus 5.5 and GPT-6, accurately reproduce all target trajectories, with median R2 above 0.995 in every test and tracking errors up to two orders of magnitude lower than the baselines. The agent logs show that these agents autonomously extract dynamic performance indices, such as settling time and damping, and relate them to specific control parameters, decomposing the tuning problem into physically interpretable sub-problems. The benchmark is publicly available at https://github.com/Power-Agent/PowerAgentBench/tree/main/benchmarks/dynamic/level3.

0.42