CS Paper Radar

Machine Learning-Based State Estimation for an Actual Transmission System Using Field PMU Data

Shiva Moshtagh, Nihar Thakkar, Anamitra Pal, Evangelos Farantatos

eess.SY ·submitted 2026-09-22 01:58 UTC · v1
published

Abstract

Time-synchronized state estimation (SE) plays a critical role in ensuring real-time situational awareness in modern power systems. However, achieving full system observability using phasor measurement units (PMUs) is often impractical due to cost and deployment constraints. Moreover, SE operation at PMU timescales imposes stringent requirements on latency, robustness, and reliability that are difficult to satisfy using conventional iterative hybrid SE techniques under incomplete observability by PMUs. This paper evaluates the feasibility of deploying deep neural networks for PMU-timescale, time-synchronized SE in real-world PMU-unobservable transmission systems using actual data from a US power utility. Key contributions include a systematic assessment of estimation accuracy, scalability, and computational performance under realistic operating conditions.

Comment
Accepted for presentation at the 60th Hawaii International Conference on System Sciences (HICSS-60), 2027

Closest papers

Nearest neighbours by meaning across the whole index.

Learning-Based Power Flow Estimation with Sparse PMU Deployment in Power Systems

eess.SY ·2026-10-09 ·Van-Hai Bui, Quang Manh Hoang, Akhtar Hussain, Wencong Su
similarity 0.72
Abstract · 14

Accurate monitoring of power flow is fundamental to the secure and reliable operation of modern power systems. Existing data-driven power flow estimation methods typically assume that synchronized measurements are available at every bus, requiring extensive deployment of phasor measurement units (PMUs). Such dense sensing infrastructures substantially increase installation, communication, and maintenance costs. This paper proposes a learning-based framework that minimizes the number of installed PMUs while maintaining high-accuracy systemwide power flow estimation. Instead of relying on measurements from all buses, the proposed method identifies an informative subset of buses whose synchronized measurements are sufficient to accurately reconstruct branch power flow across the network. To this end, a neural network is developed to learn the nonlinear relationship between PMU measurements and system-wide power flows, and multiple PMU deployment scenarios are evaluated to quantify the trade-off between measurement availability and estimation accuracy. The results enable utilities to identify cost-effective PMU placement strategies that balance deployment cost and prediction performance. Case studies on the IEEE 30-bus test system demonstrate that the proposed framework significantly reduces the number of required PMUs while maintaining accurate power flow estimation.

0.18

Adaptive State Estimation Under Topological Uncertainty in Unobservable Primary Distribution Systems Using Strategically Placed Sensors

eess.SY ·2026-09-23 ·Farah Elsherif, Behrouz Azimian, Anamitra Pal
published similarity 0.69
Abstract · 6 pages, 6 figures, 4 tables. Accepted for presentation at the 2026 North American Power Symposium (NAPS)

The rapid integration of distributed energy resources is fundamentally altering power flow patterns in primary distribution networks and intensifying operational uncertainty. These problems are further compounded by lack of real-time situational awareness and frequent topology changes. To address these problems, this paper proposes an integrated deep learning framework for simultaneous topology identification (TI) and distribution system state estimation (DSSE) in real-time unobservable primary distribution networks instrumented by a minimal set of synchronized measurement devices (SMDs). A correlation-driven SMD placement algorithm is introduced first that jointly satisfies TI accuracy and DSSE performance requirements by exploiting temporal and spatial correlations in nodal voltage measurements. A dual deep neural network (DNN)-based DSSE model is developed next to estimate three-phase voltage magnitudes and angles across diverse operating conditions. To extend the framework beyond the base topology, fine-tuning-based transfer learning is employed to adapt the DSSE model to reconfigured topologies using limited retraining data. The framework is validated under both Gaussian and non-Gaussian measurement noise and benchmarked against a conventional estimation approach and a single DNN model.

0.35

Bayesian Distribution System State Estimation with Flow Matching

cs.LG cs.AIeess.SP ·2026-10-29 ·Nan Lin, Peter Palensky, Pedro Vergara Barrios
similarity 0.66
Abstract · 10 pages

Medium-voltage feeders have few real-time measurements, so distribution system state estimation (DSSE) rests on pseudo-measurements of the secondary substations, a prior in Bayesian terms. Weighted least squares keeps the power flow exact but reduces this prior to a mean and variance, while supervised deep learning estimators also learn the power flow and are tied to one measurement set. We propose PoSE (posterior sampling for state estimation), which keeps the Bayesian structure of DSSE and learns only what the distribution system operator does not know, namely the distribution of substation injections, modelled by a neural network trained with flow matching on historical data. The power flow equations, grid topology and measurements enter only at sampling, through a noise-aware Kalman-type correction. The neural network therefore never approximates the power flow, but every posterior sample is a physically consistent operating point, and one trained prior serves any measurement set, noise level and topology. On the IEEE 33-bus feeder, PoSE lowers the probabilistic injection error (CRPS) by 6.7-7.5% against a full-covariance Gaussian prior in all 12 tested settings. It provides reliable uncertainty: the 90% intervals contain the true injection almost exactly as often as exact posterior samples would, whereas those of supervised estimators contain it in only 37-78% of cases. On the 240-bus unbalanced three-phase Iowa feeder, it gives the lowest injection, voltage and branch-current errors of all estimators. A fast variant matches this accuracy at 0.2-0.6s per snapshot and, without retraining, beats Gaussian priors and retrained supervised estimators on seven reconfigured topologies.

0.17

Dynamic State Estimation from Sparse PMUs via Physics-Informed Graph Neural Operators

cs.LG eess.SY ·2026-11-07 ·Huy Hoang Le, Haoguang Wang, Christian Moya, Marcos Netto, Guang Lin
benchmark similarity 0.62
Abstract · 10 pages, 10 figures, 4 tables

This paper proposes a physics-informed graph neural operator for power system dynamic state estimation. From a sparse, intermittent measurement window at a few generator buses, the operator estimates the rotor-angle and speed trajectories of all machines, unmeasured ones included, in one forward pass. A graph-attention encoder processes the measurements, and the swing equations are imposed as a hard constraint or as a soft one with a learned correction that absorbs model errors. It is trained on simulated measurements, without state labels. With several phasor measurement units, masked training hides one from the input but keeps it in the loss. On four transmission systems, simulations show that the operator is the most accurate estimator that neither optimizes per scenario nor uses state labels, except on the smallest system at large model errors, where tuned Kalman smoothers are better. Networks trained on simulated states are more accurate on the two smallest systems but not on the 118-bus system, where the operator is faster and more accurate than hard-constrained moving-horizon estimation. Under model errors, it matches or outperforms an optimization-based benchmark at a fraction of its cost. The results hold for a detailed machine model with exact parameters seen only through voltage phasors.

0.31

An Empirical Benchmark of Deep Time-Series Models for Smart Meter Energy Forecasting

cs.LG ·2026-08-19 ·Behnaz Kavoosighafi, Maria Eidenskog, Wiktoria Glad, Katerina Vrotsou
publishedbenchmarkcode/data similarity 0.62
Abstract

Accurate forecasting of energy consumption is important for the efficient operation of power systems, with direct implications for operational costs, energy management, and system maintenance. Due to the availability of extensive high-resolution consumption data from smart meters, data-driven methods have been used for short-term and long-term forecasting. However, their comparative performance on real-world smart meter data is still not well studied. In this paper, we present an empirical benchmark of nine modern deep learning models for time-series forecasting, including linear, MLP-based, convolutional, and Transformer architectures. We evaluate these models on two publicly available smart meter datasets. Our analysis focuses on three factors that strongly affect forecasting performance: the length of historical input, the prediction horizon, and the choice of model architecture. We show that extending the historical context improves accuracy, but only up to a saturation point, after which additional input provides limited benefit. In contrast, accuracy decreases as the prediction horizon increases. We also investigate the trade-off between prediction accuracy and computational complexity, and assess the statistical significance and practical magnitude of performance differences across models. Our results show that deep learning models consistently outperform classical baselines, while lightweight architectures achieve relatively similar performance at significantly lower computational cost. Additionally, architectural differences only become meaningful at longer forecasting horizons and on more heterogeneous datasets. Finally, a subgroup analysis across geodemographic and household categories shows that model choice has limited impact for most population segments.

0.58

A simulation based dataset of faults and events for machine learning in power systems

eess.SY ·2026-08-20 ·Georg Kordowich, Jonathan Loebel, Julian Oelhaf, Andreas Maier, Siming Bayer +2 more
similarity 0.62
Abstract

The integration of inverter-based renewable energy sources into electric grids challenges conventional power system protection. Machine learning-based solutions can address these challenges by utilizing available data in modern smart grids. However, the lack of open datasets prevents reproducibility and fair comparisons between different approaches and their results, which hinders further progress. Therefore, this paper presents EvEMTBench, a synthetic dataset of faults and events generated using electromagnetic transient simulations. The physical plausibility of the power system simulation is ensured by validating the simulation parameters against established literature and providing comprehensive documentation of the simulation procedure. The dataset is designed for training, fine-tuning, and benchmarking machine learning models by providing synchronized point-on-wave voltage and current measurements at 9600 Hz across a diverse set of topologies and voltage levels. The inclusion of a wide range of fault and operating events allows the utilization of EvEMTBench for different tasks like incipient fault detection, fault localization, or event detection.

0.50

Beyond Accuracy: Physics-Informed Evaluation of ANN-based Power Flow Solvers under System Shift

eess.SY ·2026-11-10 ·Dong Liu, Jochen Stiasny, Jochen Cremer, Pedro P. Vergara
similarity 0.61
Abstract

Recent advances in artificial deep learning-based power flow (PF) solvers have primarily focused on improving estimation accuracy, while their physical feasibility and operational reliability under realistic system variations remain insufficiently evaluated. This paper proposes a physics-informed evaluation framework for deep learning-based PF solvers under topology and load distribution shifts. Beyond conventional voltage-domain errors, the framework incorporates KCL gaps, branch-flow gaps, KVL residuals, continuous feasibility scores, and strict, practical, and relaxed PF feasibility rates. Four case studies are designed to investigate topology shifts, mixed topology training, load distribution shifts, and combined topology distribution shifts. Eight ANN architectures, including graph input models, load-only baselines, and physics-informed neural networks, are evaluated under consistent settings. The results demonstrate that low estimation errors do not necessarily correspond to physically feasible or operationally reliable PF solutions, particularly under combined system shifts. The proposed framework establishes an initial foundation and analysis for the development and verification of trustworthy deep learning-based PF solvers, providing support for their reliable deployment in future AI-enabled power system analysis.

0.09

EvEMTBench: An Open Benchmark for Machine Learning in Power System Protection

eess.SY cs.LG ·2026-09-23 ·Julian Oelhaf, Georg Kordowich, Christian Bergler, Andreas Maier, Johann Jäger +1 more
benchmarkcode/data similarity 0.61
Abstract · 15 pages, 3 figures. Supplementary information included. Code: https://github.com/EvEMTBench/evemtbench-benchmark

Studies of machine-learning-based power system protection are difficult to compare because task definitions, measurement access, data partitions, metrics, and generalization conditions often differ. EvEMTBench addresses this gap with an open, executable, and versioned benchmark that fixes these evaluation choices while leaving model design open. Across four grids spanning 20-345 kV, it defines 12 protection and event-analysis functions instantiated as 24 scored tasks and supports structured evaluation across observability conditions, predefined distribution shifts, and zero-shot and fine-tuned cross-grid transfer. Committed partitions, leakage controls, and reproducible reporting provide a common basis for comparing future methods. A reference evaluation spanning trivial, conventional, feature-based, and deep-learning baselines shows that wider observability is not uniformly beneficial, shifted conditions can reveal failures not apparent in-distribution, and cross-grid transfer is substantially stronger for fault detection than for fault localization. Protection-relevant diagnostics identify failure modes not apparent from primary metrics alone. EvEMTBench therefore makes generalization in machine-learning-based protection an explicit and reproducible evaluation problem.

0.22