CS Paper Radar

Motor compound fault diagnosis using an attention-based cross-talk architecture

Wonjun Yi, Wonho Jung, Junho Kim, Rismaya Kumar Mishra, Yong-Hwa Park

cs.AI cs.LG ·submitted 2026-10-19 06:49 UTC · v1

Abstract

As physical AI increasingly relies on sensing to understand physical systems, reliable condition monitoring of industrial machinery has become more important. Motors are ubiquitous in industrial systems, and increasing system complexity raises the likelihood of simultaneous faults. Accordingly, compound fault diagnosis that identifies multiple fault components and their severities is increasingly required. Because different fault components jointly affect the same vibration signal, their severity classification can be formulated as related tasks, making multi-task learning (MTL) suitable for exploiting shared information. However, conventional shared-trunk architectures force tasks to share a common representation, potentially causing negative transfer because fault components are characterized by different time-frequency regions. To address this issue, this study proposes a Residual Neural Dimension Reductor with Time-Frequency Channel Attention (RNDR-TFCA), an attention-enhanced cross-talk architecture for multi-output compound fault diagnosis. RNDR-TFCA preserves task-specific feature extractors while selectively exchanging information across tasks. Time-frequency attention emphasizes informative intra-task regions, while channel attention enhances useful inter-task information after nonlinear feature fusion. Experiments on a rotor-bearing system with inner-race fault, outer-race fault, misalignment, and unbalance showed that RNDR-TFCA achieved a macro F1 score of 0.898, outperforming single-task, multi-class, shared-trunk, and cross-talk baselines. Ablation experiments confirmed the benefit of jointly applying both attention mechanisms. RNDR-TFCA required 713 K parameters and 170.42 MMACs, only slightly higher than RNDR. Channel-expanded baselines still underperformed RNDR-TFCA, indicating that the gain was not simply attributable to increased model capacity.

Comment
Submitted to ICSV33

Closest papers

Nearest neighbours by meaning across the whole index.

A Time-Frequency-Condition Multimodal Fusion Foundation Model for Universal Rotating-Machinery Fault Diagnosis under Multi-Element Heterogeneous Scenarios

cs.CL cs.AI ·2026-11-11 ·Xinyu Zou, Jian Ma, Liang Ma, Chen Lu, Tao Peng +1 more
similarity 0.72
Abstract

Intelligent fault diagnosis models are typically developed for a single machine under a specific set of operating conditions, such that each new machine or condition requires retraining from scratch. This one-machine-one-model paradigm scales poorly. Although transfer learning and domain generalization can reduce the labeling burden, they primarily seek domain-invariant commonality, potentially discarding machine-specific characteristics that are critical for diagnosis. This paper proposes TFC-MMFD, a time-frequency-condition multimodal fusion foundation model for rotating-machinery fault diagnosis under multi-element heterogeneous scenarios. Statistical indicators, time-frequency images, vibration sequences, and textual machine and condition descriptions are tokenized into a unified language-like space, allowing inputs of different physical origin to be represented as a single sequence. A LLaMA backbone, together with cross-modal bidirectional attention and a Q-Former, then distills this sequence into fault-mode queries. Diagnosis is performed by matching these queries against natural-language fault-mode anchors rather than fixed class indices, while regression-adversarial condition disentanglement and condition-conditioned masked pre-training improve robustness to changing conditions. Across four progressive tasks on ten public bearing datasets spanning diverse bearing types, speeds, and loads, TFC-MMFD attains 99.40% accuracy and 99.16% macro-F1, maintains over 80% accuracy on most interpolated unseen conditions without adaptation, and improves from 20.26% to 95.63% accuracy on an unseen machine with only five labeled samples per class. It outperforms the strongest of eight domain-generalization baselines by 10.57 percentage points and compares favorably with a recent bearing foundation model while using less than half of its fine-tuning data.

0.15

A Time-Frequency Dual-Domain Multi-Scale Convolutional Neural Network for Bearing Fault Diagnosis under Strong Noise

cs.LG ·2026-08-10 ·Yanxi Ding, Tingyue Jia
similarity 0.64
Abstract

To address the degradation of bearing fault diagnosis accuracy under strong noise, this paper proposes a time-frequency dual-domain multi-scale convolutional neural network. The time-domain branch employs three parallel convolutional kernels to capture multi-scale impulse features, while the frequency-domain branch applies the Fast Fourier Transform to extract noise-robust spectral structure information. Features from both branches are fused for fault classification, yielding a compact model of 110,122 parameters. Experiments on the CWRU bearing dataset across seven signal-to-noise ratio levels demonstrate that the proposed method achieves 99.75% accuracy under clean conditions and maintains 92.50% at -4 dB SNR, representing a 7.25 percentage-point improvement over the single-domain baseline with monotonically increasing gains under stronger noise. Ablation experiments validate the independent performance contributions of the time-domain multi-scale branch and the frequency-domain branch. Comparative experiments against WDCNN, DRSN-CW, MCNN, and 1D-LeNet confirm the superiority of the proposed method under strong noise conditions.

0.04

A Harmonic-Regression ARMA model for rotating machinery dynamics identification and fault detection under varying conditions

eess.SP ·2026-09-23 ·Dimitrios M. Bourdalos, John S. Sakellariou, Spilios D. Fassois
published similarity 0.61
Abstract · Accepted for publication in the Proceedings of the International Conference on Noise and Vibration Engineering (ISMA 2026), Leuven, Belgium,…

Fault detection in rotating machinery under varying operating conditions remains a challenging problem. Existing approaches are mainly based either on non-parametric vibration signal representations, parametric deep learning models, or on parametric ARMA-type models. While deep learning approaches often lack transparency and require large training datasets, ARMA-type models rely on the assumption of a purely rational spectrum, which can be restrictive for rotating machinery vibration signals exhibiting mixed spectral characteristics. To address these limitations, a novel Harmonic Regression ARMA (HR-ARMA) model is presented for rotating machinery dynamics identification, which combines an explicit harmonic regression part for representing the dominant deterministic cyclical components with an ARMA part for the remaining broadband stochastic dynamics. Based on this model and within a Multiple Model framework, fault detection is achieved under varying operating conditions. The HR-ARMA modelling performance is validated through simulation and experimental studies on a single-stage gearbox, demonstrating accurate representation of both cyclical and broadband dynamics, improved parsimony and significantly higher fault detection performance compared with conventional ARMA models, achieving at least 98% True Positive Rate at 5% False Positive Rate in the experimental study.

0.39

Physical-Variable-Informed Deep Learning for Robust Diagnosis in Industrial Fluid Transport Systems

cs.LG cs.AI ·2026-10-20 ·Yu Sha, Junqi Tao, Dixin Zhou, Horst Stoecker, Domagoj Vnucec +2 more
similarity 0.59
Abstract · 29 pages, 5 figures

Industrial fluid transport systems are monitored through heterogeneous sensing streams, but robust fault diagnosis remains difficult because response signals vary with operating conditions and differ from physical variables in sampling rate, observation duration and data granularity. To address these challenges, we propose a physical-variable-informed deep learning framework (PhyNet) for robust fault diagnosis under real-world sampling heterogeneity. PhyNet treats physical variables as global operating constraints and response signals as local diagnostic evidence. Its physical-to-response cross-attention mechanism connects sequence-level physical-variable tokens with a learnable global response token, enabling interaction without strict temporal alignment. Across four benchmarks, including three real-world cavitation datasets and one public two-phase-flow dataset, PhyNet achieves the best performance across all evaluated metrics. Class-wise analyses, together with attention and masking analyses, show improved discrimination of ambiguous states and indicate that physical variables meaningfully constrain local response interpretation. These findings demonstrate a deployment-oriented approach to robust diagnosis in heterogeneous industrial environments.

0.33

A Machine Learning Framework for Fault Detection, Isolation, and Severity Prediction of Autonomous VTOL Aircraft

cs.LG ·2026-09-12 ·Ripon C. Sarker, Pedram H. Dabaghian, Raman Goyal, Atanu Halder
published similarity 0.58
Abstract

Fault detection in autonomous VTOL aircraft is critical because even minor component degradations can rapidly destabilize multirotor vehicles operating in complex, safety-critical environments, motivating robust fault detection and estimation strategies capable of identifying early signs of rotor damage; however, real-flight fault detection remains challenging due to sensor noise, environmental disturbances, and the nonlinear aerodynamics of multirotor platforms. This study proposes a comprehensive machine-learning framework for rotor fault detection, isolation, and severity prediction using real flight data. A convolutional neural network (CNN) architecture is developed to learn spatio-temporal patterns from multivariate flight dynamics, enabling direct inference of both the faulted rotor and its damage level. The framework is first validated using simulated data generated by a data-generative model, and experimental validation is then performed on a hexacopter by introducing controlled blade-tip breakage. The trained model achieves rotor-wise fault classification accuracies above 99% and severity estimation accuracy of 96% within a 1% tolerance in experimental data, demonstrating strong generalization and supporting real-time health monitoring for autonomous VTOL systems.

0.36

Factorized axis convolutional gated recurrent unit with dynamic adaptive pooling for remaining useful life prediction of rolling bearings

cs.AI ·2026-09-25 ·Hanbyeol Park, Jungho Choo, Hyerim Bae
similarity 0.57
Abstract

Convolutional neural networks (CNN) are widely used to predict the remaining useful life (RUL) of rolling bearings from time-frequency representations (TFRs) of vibration signals. However, during degradation, characteristic structures in TFRs align predominantly along the frequency or time axis, making it challenging for conventional CNN isotropic kernels to capture directional structure. Furthermore, global average pooling (GAP) averages across axes, potentially obscuring the locations and concentrations of salient activations. This study introduces a factorized-axis convolutional gated recurrent unit (GRU) that employs multiscale anisotropic convolution and dual-axis convolution block attention module to enhance directional features and highlight salient time-frequency regions. Dynamic adaptive pooling (DAP) adaptively aggregates the time-frequency-axis information from the extracted feature maps, whereas a GRU captures temporal dynamics in the latent representations and Monte Carlo dropout enables predictive uncertainty estimation. Experiments on two public bearing datasets demonstrate that the proposed model outperforms existing RUL prediction methods across operating conditions. Ablation experiments demonstrate that the factorized axis-wise design achieves lower mean errors than convolutional isotropic kernels. DAP yields clear improvements on one dataset while matching GAP on the other, highlighting the importance of anisotropic feature extraction and adaptive feature aggregation for TFR-based RUL prediction.

0.21

When Labels Are Scarce: An Oscillatory State Space Model for Vibration Diagnosis

cs.LG eess.SP ·2026-09-23 ·Mainak Mallick, Seung-Kyum Choi
benchmark similarity 0.57
Abstract

Machine fault diagnosis from vibration requires learning from scarce labelled fault recordings while meeting the computational constraints of edge devices for local inference. We introduce DualRes, a compact oscillatory state-space model that combines two complementary spectral views of vibration, capturing rapid changes and fine frequency structure. Time-aligned views are processed by selective oscillatory memory, which learns how long to retain temporal patterns. The encoder contains 39,528 parameters. We evaluate supervised learning across six bearing datasets and a gearbox benchmark, with an additional gearbox pilot. Recording-level splits and explicit accounting of labelled duration distinguish data efficiency from repeated exposure to correlated samples. On the main gearbox benchmark, DualRes achieves state-of-the-art performance among the nine evaluated methods at six of seven label budgets. With about six labelled seconds per class, it improves macro-F1 by 16.1 percentage points over the next strongest comparator. On the same benchmark, DualRes achieves a 1.44-fold recording-level speedup and a 24.8-fold reduction in checkpoint storage relative to a selective state-space baseline under matched hardware and runtime conditions. Bearing results reveal task-dependent trade-offs. These findings support oscillatory memory as a compact approach to vibration diagnosis under limited labelled exposure.

0.30

Explainable Temporal Attention-based Defect Detection For Fillet Joints in Real-Time Gas Metal Arc Welding Based on Multi-modal Data

cs.AI cs.LG ·2026-09-07 ·Mobina Mobaraki, Mahyar Asadi, Klaske Van Heusden, Guy A. Dumont
similarity 0.57
Abstract

Deep learning is an efficient technique to monitor the real time welding process, reducing post-welding repairs and production delays. This paper leverages the monitoring capability by proposing a multi modal temporal attention based deep learning defect detection model for internal defects that are challenging to detect, including porosity, lack of penetration and fusion, undercut, and cold lap during Gas Metal Arc Welding in fillet joints. The model is trained on collected welding images and sound data from an industrial collaborative welding robot. The results show that the attention module can improve the F1 Score to 0.99. We use explainable Artificial Intelligence to interpret the proposed models behavior and dataset distribution, determining potential important areas in image and sound spectrograms and preferred modality to detect each defect. This improves trust and reliability in Artificial Intelligence driven welding inspection.

0.21