CS Paper Radar

One-Cycle Fault Classification and Faulted-Line Identification on the PROTECT-90 Dataset: An Initial Application Benchmark

Emad Abukhousa, Abdulaziz Qwbaiban, Saman Zonouz, A. P. Sakis Meliopoulos

eess.SY cs.LG ·submitted 2026-10-02 23:54 UTC · v1
benchmarkcode/data

Abstract

Open electromagnetic-transient datasets are beginning to make reproducible learning-based protection studies possible, but the practical use of these datasets still requires application-level benchmarks that define timing, sensing, and validation assumptions. This paper presents an initial application benchmark on the recently released PROTECT-90 dataset for two protection-oriented tasks: fault-type classification and discrete faulted-line identification. A compact one-dimensional convolutional neural network (CNN) is evaluated using post-inception windows of 0.25, 0.5, 1, and 2 cycles under strict episode-wise splitting. A non-convolutional multilayer perceptron (MLP) is also trained as an architecture-control baseline. The results show that both tasks are nearly saturated under full observability, with one-cycle test accuracies of 99.84% for fault type and 100.00% for line identification. The main performance variation appears under reduced observability: current-only inputs preserve line identification accuracy at 100.00%, whereas voltage-only inputs reduce line identification accuracy to 53.09% with the CNN and 50.57% with the MLP. This indicates that the limiting factor is measurement information rather than neural architecture. Additional stratified checks show stable performance across topology states and fault-resistance bins, while CPU inference contributes only 0.528 ms to the one-cycle total decision time of 20.53 ms.

Closest papers

Nearest neighbours by meaning across the whole index.

Deep Learning-Based Detection of Electrical Faults and Power Quality Disturbances in Aerospace Power Systems

eess.SP cs.LGeess.SY ·2026-09-09 ·Ian C. Guzmán, Radu Babiceanu, Berker Peköz
top venuecode/data similarity 0.72
Abstract · Accepted for publication in IEEE Transactions on Aerospace and Electronic Systems. Pending journal reference/external DOI

More Electric Aircraft require fast and reliable monitoring of high-frequency electrical networks, yet most power quality disturbance and fault diagnosis methods are developed for conventional 50 or 60 Hz grids. This work presents a hardware-aware deep learning framework for multiclass detection of electrical faults and power quality disturbances in a 400 Hz aerospace power system. A high-fidelity simulation model inspired by the Boeing 787 electrical architecture generates voltage and current waveforms for 21 normal, disturbance, switching, open-circuit, and short-circuit conditions. Two datasets, each containing 73,500 samples, are formed from one-dimensional time-series signals and short-time Fourier transform time-frequency representations. Signal-processing augmentation, domain randomization, and class-specific generative adversarial networks increase waveform diversity, and the time-series dataset is released through IEEE DataPort. We compare 1D and 2D convolutional neural networks, long short-term memory networks, CNN-LSTM hybrids, ResNet, MobileNet, and VGG models under common training conditions. A compact ResNet provides the best accuracy-complexity tradeoff, achieving 96.94 percent software test accuracy with 175,685 parameters. After 8-bit quantization and deployment on a Xilinx Zynq UltraScale Plus MPSoC ZCU102, the model achieves 95.87 percent accuracy and a measured mean neural-network accelerator latency of 6.90 ms per input record. The results establish simulation-based, accelerator-level feasibility for embedded edge AI in aircraft electrical health monitoring and motivate future end-to-end data acquisition and experimental validation.

0.52

Protection-Oriented Assessment of Machine Learning-Based Fault Detection in Power Systems

cs.LG eess.SP ·2026-11-13 ·Julian Oelhaf, Georg Kordowich, Changhun Kim, Christian Bergler, Andreas Maier +2 more
publishedhot direction similarity 0.69
Abstract · 9 pages, 3 figures, 5 tables. Accepted for oral presentation at the 21st International Conference on Developments in Power System Protection…

Machine learning (ML)-based fault detectors are increasingly proposed for power system protection, yet aggregate metrics can obscure the consequences of false and missed trips. We present a protection-oriented assessment of three ML detectors and a sequence-current reference on PROTECT-90, comprising 9,022 simulated fault episodes on a 90 kV double-circuit line. The assessment combines five window conditions, causal window-end labelling, episode-grouped cross-validation, and operating-point selection under a fixed security budget. It reports security, dependability, detection timing, decision margins, and episode-level nuisance assertions. Gradient-boosted trees, a convolutional neural network, and logistic regression achieve AUC-ROC values above 0.999, yet at a security budget of $10^{-3}$ their developed-fault missed-trip rates range from 0.007% to 1.99%. Post-clearing false-trip rates of approximately 0.12-0.16% per window coexist with nuisance assertions in 11.3-19.1% of episodes. Among the analysed physical descriptors, missed trips are most consistently associated with higher fault resistance within the sampled range. An analytical current proxy suggests a fault-current gradient only partly reproduced by waveform-derived current (rank correlation 0.62). No single topology state or faulted phase consistently dominates within the sampled domain. Because PROTECT-90 contains fault episodes only, security is assessed on pre-fault and post-clearing windows rather than independent non-fault disturbances.

0.34

A Systematic Evaluation of Machine Learning Methods for Fault Detection and Line Identification in Electrical Power Grids

cs.LG eess.SP ·2026-09-15 ·Julian Oelhaf, Georg Kordowich, Paula Andrea Pérez-Toro, Tomás Arias-Vergara, Andreas Maier +2 more
publishedhighly cited similarity 0.66
Abstract · Accepted at ICASSP 2025. 5 pages, 4 figures. Published version: DOI 10.1109/ICASSP49660.2025.10890544

The integration of renewable energy sources into the electrical grid introduces complex challenges in fault detection and coordination of grid recovery mechanisms. Traditional relay protection systems, which operate based on static rules and predefined thresholds, are inadequate for addressing these challenges, particularly in detecting and isolating faults such as short circuits. Consequently, the conventional methodologies applied to electrical network protection frequently fail to achieve optimal performance in fault detection, especially in terms of adherence to safety standards and the selective limitation of damage. Recent research indicates that machine learning (ML)-based approaches can effectively tackle these issues; however, variations in grid configurations and analysis windows have impeded consistent comparative assessments. In this study, we assess the efficacy of various ML models in detecting electrical faults and pinpointing defective transmission lines within a 10 ms measurement interval - a critical time-frame for real-time operational viability, for the first time. The most effective model attained an F1 score of 0.991 +/- 0.018 and demonstrated a processing time of 0.342ms +/- 0.509ms.

0.52

A Standardized Framework for Machine Learning in Power System Protection

cs.LG cs.AIeess.SP ·2026-08-20 ·Julian Oelhaf, Georg Kordowich, Paula Andrea Pérez-Toro, Christian Bergler, Johann Jäger +2 more
publishedbenchmarkcode/data similarity 0.64
Abstract · 32 pages, 4 figures, 26 tables. Code: https://github.com/julianoelhaf/protection-eval-framework. Dataset: PROTECT-90, doi:10.5281/zenodo.211…

Studies of machine-learning-based power-system protection increasingly report near-perfect scores, yet the meaning of those scores depends strongly on the evaluation setting. Protection task, physical scope, measurements, timing, targets, preprocessing, and validation often vary jointly and remain incompletely specified. This paper proposes a standardization-oriented framework that treats evaluation design as part of the scientific contribution. It defines seven required study dimensions: protection objective, physical scope, observability, timing and decision windows, targets and sample validity, validation protocol, and evaluation outputs. The framework is instantiated in a bounded case study on the public PROTECT-90 electromagnetic-transient benchmark, comprising 9022 simulated episodes from a 90 kV double-line topology, for onset-conditioned fault classification and localization. Under centralized sensing, simulation-metadata-aligned 20 ms windows, and episode-grouped validation, a multi-layer perceptron (MLP) achieved a five-fold mean macro-averaged F1 score of 0.991 +/- 0.001 for classification and a localization mean absolute error of 10.20 +/- 0.25% of line length (mean +/- std across episode-grouped folds). Extending the decision horizon to 50 ms preserved this task-dependent performance asymmetry, while reduced observability approximately doubled the MLP localization error but had little effect on classification. A synchronized two-ended conventional locator outperformed the learning locators under its richer clean information set, and measurement degradation showed that clean predictive performance did not determine robustness. The framework turns evaluation assumptions into explicit, reproducible evidence and provides a basis for more comparable, auditable evaluation and future certification-oriented assessment of machine-learning protection functions.

0.77

EvEMTBench: An Open Benchmark for Machine Learning in Power System Protection

eess.SY cs.LG ·2026-09-23 ·Julian Oelhaf, Georg Kordowich, Christian Bergler, Andreas Maier, Johann Jäger +1 more
benchmarkcode/data similarity 0.63
Abstract · 15 pages, 3 figures. Supplementary information included. Code: https://github.com/EvEMTBench/evemtbench-benchmark

Studies of machine-learning-based power system protection are difficult to compare because task definitions, measurement access, data partitions, metrics, and generalization conditions often differ. EvEMTBench addresses this gap with an open, executable, and versioned benchmark that fixes these evaluation choices while leaving model design open. Across four grids spanning 20-345 kV, it defines 12 protection and event-analysis functions instantiated as 24 scored tasks and supports structured evaluation across observability conditions, predefined distribution shifts, and zero-shot and fine-tuned cross-grid transfer. Committed partitions, leakage controls, and reproducible reporting provide a common basis for comparing future methods. A reference evaluation spanning trivial, conventional, feature-based, and deep-learning baselines shows that wider observability is not uniformly beneficial, shifted conditions can reveal failures not apparent in-distribution, and cross-grid transfer is substantially stronger for fault detection than for fault localization. Protection-relevant diagnostics identify failure modes not apparent from primary metrics alone. EvEMTBench therefore makes generalization in machine-learning-based protection an explicit and reproducible evaluation problem.

0.22

The Price of a Cycle: A Phasor -vs- Sampled-Value Comparison for Streaming Fault Classification on the IEEE 9-Bus System

eess.SY ·2026-10-03 ·Emad Abukhousa, Khaled Muhmmed Nor Muhmmed, Abdulaziz Qwbaiban, Saman Zonouz, A. P. Sakis Meliopoulos
benchmark similarity 0.61
Abstract

Transmission-line fault classification is a time-critical protection function, and recent machine-learning methods classify fault type directly from voltage and current measurements. The input to such a classifier can be supplied as sampled-value windows of raw measurements, which preserve sub-cycle structure, or as phasor-domain sequence components, which are physically interpretable but require a causal one-cycle observation window before a phasor estimate is available. This paper measures the cost of that observation window, the price of a cycle, through a controlled comparison of the two representations for streaming fault-family classification on the standard synchronous WSCC/IEEE 9-bus system. The comparison holds the simulated system, the measured channels, the eleven-class event-family taxonomy, the training procedure, and the streaming decision layer constant, and uses six configurations: 40- and 80-sample sampled-value inputs and one-cycle phasor inputs, each evaluated with a multilayer perceptron (MLP) and a one-dimensional convolutional neural network (CNN). All six configurations classify every event successfully, yet the sampled-value representation reaches the correct class earlier in every model pair. The 40-sample sampled-value MLP attains the strongest result, with 99.34% fault-window accuracy, 99.79% normal accuracy, a 0.21% false-fault rate, a 0.65% false-normal rate, and a 2.81 ms mean first-correct delay, and it Pareto-dominates the other five configurations. A matched-window comparison at eighty samples confirms that the timing advantage follows from the representation rather than from the window length. On this clean synchronous benchmark, the one-cycle phasor representation does not return an accuracy or stability benefit sufficient to offset its delay.

0.31

A Time-Frequency Dual-Domain Multi-Scale Convolutional Neural Network for Bearing Fault Diagnosis under Strong Noise

cs.LG ·2026-08-10 ·Yanxi Ding, Tingyue Jia
similarity 0.61
Abstract

To address the degradation of bearing fault diagnosis accuracy under strong noise, this paper proposes a time-frequency dual-domain multi-scale convolutional neural network. The time-domain branch employs three parallel convolutional kernels to capture multi-scale impulse features, while the frequency-domain branch applies the Fast Fourier Transform to extract noise-robust spectral structure information. Features from both branches are fused for fault classification, yielding a compact model of 110,122 parameters. Experiments on the CWRU bearing dataset across seven signal-to-noise ratio levels demonstrate that the proposed method achieves 99.75% accuracy under clean conditions and maintains 92.50% at -4 dB SNR, representing a 7.25 percentage-point improvement over the single-domain baseline with monotonically increasing gains under stronger noise. Ablation experiments validate the independent performance contributions of the time-domain multi-scale branch and the frequency-domain branch. Comparative experiments against WDCNN, DRSN-CW, MCNN, and 1D-LeNet confirm the superiority of the proposed method under strong noise conditions.

0.04

Characterizing Cross-Relay Generalization Failure in Machine Learning-Based Power System Protection

cs.LG ·2026-10-20 ·Nithin Pradeep Nadayil Kizhakkethil, Julian Oelhaf, Christian Bergler, Andreas Maier, Siming Bayer
published similarity 0.60
Abstract · 6 pages, 3 figures. Accepted for presentation at the IEEE Power & Energy Student Summit (PESS 2026), Karlsruhe, Germany

Machine learning-based fault detectors are often evaluated at the relay locations used for training, although local voltage and current measurements vary across power networks. This work investigates cross-relay generalization for binary detection of faults anywhere in the network using local measurements, rather than line-selective tripping. Using 50 ms windows from a simulated 110 kV transmission network, we evaluate a multilayer perceptron across all 64 source target combinations of eight relays and five random seeds. A shared simulation-level split and source-only threshold selection provide a controlled held-out evaluation without target-specific calibration. Despite nearly unchanged mean F1-scores (0.730 within-relay versus 0.734 cross-relay), the mean false-positive rate (FPR) increases from 0.088 to 0.341, while the mean false-negative rate decreases from 0.399 to 0.318. The change is strongly directional: models trained at Bus 2 relays yield a mean FPR of 0.670 at Bus 1 and Bus 3 relays, compared with 0.096 for cross-relay transfers within the same bus group. Linear probing indicates that learned representations retain coarse bus-group information, while exploratory class-conditional latent distribution analysis shows no consistent monotonic association with transfer errors. These findings demonstrate that aggregate metrics can conceal location-structured changes in false-alarm behavior, highlighting the importance of evaluating error types separately when assessing cross-relay generalization.

0.23