CS Paper Radar

Sparse-LDV Neural Reconstruction with Vibro-Acoustic Evidence Fusion for Early Bolt Preload Loss

Berkay Kullukcu, Dina Hannebauer

eess.SP ·submitted 2026-09-04 17:20 UTC · v1

Abstract

Laser Doppler vibrometry (LDV) is costly, while early bolt-preload loss may produce weak and resonance-dependent changes. We combine sparse-LDV reconstruction referenced to a dense commissioning baseline with force-normalized microphone evidence. At m = 24 measurement nodes, each single-bolt 5-Nm state is reconstructed by a neural-network fold that excludes that state from training. A late-fusion rule calibrated on the healthy baseline combines the 90th percentile of local-FRAC deficits at unmeasured nodes with microphone H1 changes normalized by impact-level repeatability. Sparse LDV alone flags 24/28 mild condition-resonance pairs (50% preload loss) and acoustic evidence flags 25/28, fusion flags all 28/28. All four LDV misses occur at RG3 (resonance group) and are recovered acoustically. Fusion remains 28/28 for repeatability-normalized acoustic thresholds from 3 to 10. The result supports complementary vibro-acoustic evidence for early preload-loss screening while avoiding pointwise fusion of separately acquired campaigns.

Closest papers

Nearest neighbours by meaning across the whole index.

DF-PALM: Dynamic Fusion Prompt Learning for Audio--Language Models

cs.SD cs.LGeess.AS ·2026-10-18 ·Yulin Sun, Shenghua Li, Yong Dou, Xinwang Liu, Cheng Yang +1 more
benchmarkcode/data similarity 0.53
Abstract · 13 pages, 5 figures, 14 tables

Few-shot audio classification requires audio--language models to distinguish variable acoustic events from limited labeled data. PALM's main formulation adapts encoded class representations without changing pretrained encoders, but its class representations remain input-independent and classification uses audio features without class-conditioned refinement. We introduce DF-PALM, a dynamic feature-space prompting framework that combines audio-conditioned class representations with asymmetric cross-attention for audio refinement. Class representations are conditioned after text encoding, held fixed across fusion layers for each input, and reused for final scoring. Both pretrained encoders remain frozen, avoiding audio-conditioned text-encoder passes. With PENGI as the frozen backbone, the main 16-shot evaluation covered 11 benchmarks and six baselines. DF-PALM achieved 80.69% mean accuracy and 80.32% macro-averaged F1, exceeding PALM by 4.11 and 4.30 percentage points, respectively. Paired benchmark-level tests supported both gains after Holm correction. Across four shot settings, DF-PALM achieved the highest mean accuracy and macro-averaged F1 among the four evaluated prompt-learning methods. The gains extended to LAION-CLAP and OpenFLAM, with significant improvements over PALM in both metrics. At 50 candidate classes, operator-counted inference floating-point operations increased by 0.39% relative to PALM. These results support instance-conditioned feature-space adaptation as an effective approach to few-shot audio classification. Our code is publicly available at GitHub https://github.com/sunyulin0421/DF-PALM.

0.34

SG-Mamba: Sparse Graph-Guided Mamba for Audio-Visual Speech Enhancement

eess.AS cs.CLcs.SD ·2026-09-16 ·Guo-Ruei Tseng, Hung-Shin Lee, Hsin-Min Wang, Berlin Chen
published similarity 0.52
Abstract · Accepted to IEEE SLT 2026

Lightweight audio-visual speech enhancement (AVSE) models face a critical trade-off between computational efficiency and cross-modal alignment accuracy. While simple concatenation lacks relational expressiveness, dense cross-attention incurs computational overhead and is prone to unreliable cross-modal correspondence under strong acoustic interference. We propose Sparse Graph-Guided Mamba (SG-Mamba), a lightweight AVSE framework that integrates a sparse heterogeneous graph with a linear-complexity Mamba backbone. The graph explicitly models modality-specific relations through content-adaptive attention and cross-frame audio-visual connections, while Mamba captures long-range temporal context. We further introduce an audio skip connection to preserve spectral detail without sacrificing noise suppression. Evaluated on LRS3, SG-Mamba achieves competitive or superior performance against strong lightweight baselines and reaches 13.091 dB SI-SDR under noise-only condition. It also remains robust in cluttered multi-speaker conditions with a competitive cost of 3.45 G MACs (or 6.90 G FLOPs). Results on VoxCeleb2 further suggest that explicit structural priors improve robustness, generalizability, and computational efficiency in lightweight AVSE.

0.37

Heteroscedastic Neural Surrogate Modeling for Robust and Rapid Bayesian Inference in Fusion Plasma Diagnostics

cs.LG stat.CO ·2026-08-19 ·Liyun Zhang, Naoya Mamada, Kentaro Sakai, Takeo Hoshi, Toru Aonishi
similarity 0.52
Abstract · 8 pages, 3 figures

Bayesian inference via Markov Chain Monte Carlo (MCMC) provides effective parameter estimation, but its real-time application in complex physical systems is hindered by heavy computational bottlenecks and extreme sensitivity to statistical noise. We address this by proposing a neural-network-based probabilistic surrogate framework for rapid and robust MCMC inference. Using fusion plasma Thomson scattering diagnostics as a challenging, noise-dominated testbed, our approach employs a dual-head architecture to simultaneously estimate the expected physical emission spectrum and the channel-wise intrinsic measurement noise variance. By optimizing a Gaussian Negative Log-Likelihood (GNLL) objective, the learned aleatoric uncertainty dynamically buffers the sampler against pathological shot noise. Evaluations demonstrate that this surrogate framework achieves > 1500x acceleration over exact physical forward models, while simultaneously reducing inference error (RMSE) by >20% compared to standard homoscedastic neural baselines, offering a highly promising paradigm for real-time physical analysis.

0.32

PG-SELD: Physics-Guided Sound Event Localization and Detection

eess.AS ·2026-09-30 ·Elad Cohen, Elad Dror Cohen, Arnon Netzer, Hai Victor Habi
benchmark similarity 0.51
Abstract

Sound event localization and detection (SELD) aims to jointly recognize sound events and estimate their directions of arrival from multichannel audio. Although recent deep learning approaches have achieved strong performance, their ability to generalize across acoustic environments remains limited, as room reverberation introduces environment-specific characteristics into the learned representations. In this work, we address this challenge by leveraging a physical free-field model as a room-independent reference. Specifically, we propose PG-SELD, a training framework that combines free-field with physics-guided knowledge distillation. Our approach aligns intermediate representations extracted from reverberant signals with those produced by a free-field teacher for matched acoustic scenes. This guidance encourages the model to preserve event- and localization-relevant information while reducing sensitivity to room-specific characteristics. Experimental results on the STARSS23 benchmark show that PG-SELD consistently improves the generalization performance of multiple baseline SELD architectures.

0.26

Hardware-Friendly Plug-and-Play MVDR Beamforming for Microphone Arrays: Algorithm, Prototype, and System-Level Feasibility

eess.AS ·2026-11-14 ·Chengbo Chang, Ziye Yang, Jie Chen
similarity 0.51
Abstract

Beamforming has been widely recognized for its spatial filtering capability in speech signal processing, enabling effective interference rejection and signal enhancement. The performance of adaptive beamforming methods, e.g., the conventional minimum variance distortionless response (MVDR) beamforming, often deteriorate significantly in complex and dynamic acoustic environments. Part of the reason is that such conventional beamforming ignores the intrinsic characteristics of speech. To address this issue, this paper proposes Plug-and-Play Minimum Variance Distortionless Response (PnP-MVDR) algorithm, which integrates data-driven speech prior information into the MVDR framework to enhance robustness against non-stationary noise while maintaining its interpretability. The PnP-MVDR framework supports joint interaction of signal processing and deep learning methods and is designed to be compatible with modern DSP-NPU architectures, making it hardware-friendly for potential edge deployment. Beyond the algorithmic innovation, we have developed a complete microphone beamforming system to validate practical feasibility. Experimental results demonstrate that the proposed framework consistently outperforms traditional and deep learning-based baselines, establishing PnP-MVDR as an effective and deployable solution for edge audio scenarios.

0.10

pCoRev: Physics-Informed Contrastive Learning for Unsupervised Reverberation Artifact Suppression in Ultrafast Plane-Wave Imaging

eess.SP ·2026-10-28 ·Hyunwoo Cho, Yeeun Kwon, Yangmo Yoo, Jinbum Kang
similarity 0.50
Abstract

Reverberation artifact suppression in ultrafast plane-wave (PW) imaging remains challenging because artifact-free reference data are generally unavailable and multipath echoes often resemble tissue signals. Coherent plane-wave compounding (CPWC) attenuates reverberation only partially and sacrifices the frame rate that motivates PW imaging. We propose pCoRev, an unsupervised physics-informed contrastive learning framework that leverages the distinct angular coherence characteristics of tissue echoes and reverberation artifacts. A single-angle I/Q frame is the network input, and the remaining angles of the same CPWC acquisition provide angle-consistent positive pairs, residual-derived negative pairs, and coherence-guided self-supervision, so no paired artifact-free data are required. On a fabricated reverberation phantom with 31 validation acquisitions, pCoRev achieved the best contrast ratio (CR), contrast-to-noise ratio (CNR), and generalized CNR (gCNR) of 38.76 +/- 5.40 dB, 11.75 +/- 1.81 dB, and 0.932 +/- 0.051 against delay-and-sum (DAS), delay-multiply-and-sum, a supervised 3D convolutional neural network, and unsupervised deep coherence learning. Because the network is trained on single-angle inputs, it also operates on a single PW transmission: with one angle, pCoRev reached a CR of 32.10 +/- 7.79 dB and a CNR of 10.39 +/- 3.02 dB, exceeding 75-angle compounded DAS (20.45 +/- 3.84 dB and 8.38 +/- 2.00 dB) with 75-fold fewer transmissions. On four clinical acquisitions from other scanners, pCoRev improved CR over DAS by 9 to 21 dB without fine-tuning. These results indicate that physics-informed unsupervised contrastive learning suppresses reverberation effectively while preserving the frame-rate advantage of ultrafast PW imaging.

0.28

From Spectrograms to Shallow Speech SSL: Audio-Frontend Design for Generator-Disjoint and Low-Latency Audio--Visual Deepfake Detection

cs.SD cs.AIeess.AS ·2026-10-16 ·Qiwu Wen, Jahangir Alam, Eric Charton
similarity 0.50
Abstract

Video-mediated conversational systems rely on synchronized speech and facial video, making audio--visual input integrity important for reliable perception. We study audio-frontend design in a fixed MRDF (Modality-Regularization-based DeepFake)-based pipeline with AV-HuBERT visual processing and an MSCT (multi-scale cross-modal transformer) fusion encoder. We compare spectrogram-style log-filterbank features with frozen wav2vec~2.0 and WavLM representations, dual-SSL fusion, executed depth, and shallow-layer aggregation. Across three training runs, full wav2vec~2.0 improves mean macro AUROC from $84.19\%$ to $87.19\%$ on generator-disjoint MMDF. Six-layer execution further improves detection, and learned non-uniform aggregation adds $2.53$ percentage points, reaching $90.61\%$. Shallow execution reduces measured inference latency relative to full-depth wav2vec~2.0 across the tested input durations; first-second evaluation reaches $86.85\%$ macro AUROC. In a single-run comparison, dual-SSL concatenation outperforms either single stream, while one-way cross-attention yields lower detection performance and higher latency than concatenation. Layer-weight analysis shows greater emphasis on early speech layers, while removing the selector's visual input has little effect on detection performance.

0.11

Audio Preprocessing Effects on Stuttering Detection: A Class-Specific Analysis

eess.AS cs.SD ·2026-09-26 ·Anisha Pattanayak, Hanie Kang, Huang-Cheng Chou, Sudarsana Reddy Kadiri
hot direction similarity 0.50
Abstract

Audio preprocessing can affect how well a system detects stuttering. We study a simulated chain of denoising,loudness normalisation, Opus coding, and voice activity detection on SEP-28k. We use frozen WavLM Base+ features and report pointwise confidence intervals from episode-level bootstrap resampling. At a fixed threshold of 0.5, the chain reduces block F1 from 0.638 to 0.465, with smaller decreases for the other four classes. ROC-AUC decreases for all five classes. Blocks show the largest F1 and ROC-AUC losses, while sound repetitions show the largest average precision loss. Tuning the threshold on processed validation audio raises block F1 to 0.630. Retraining on processed audio with threshold tuning gives 0.628. Threshold adjustment therefore accounts for most of the observed block F1 recovery. It does not change ROC-AUC, which retraining raises only from 0.620 to 0.633, compared with 0.724 on clean audio.

0.35