CS Paper Radar

AnomSep: Bridging Optimization-Based Separation and Deep Neural Refinement for Anomaly Detection with Listenable Explanations

Koki Shoda, Jun Younes Louhi Kasahara, Qi An, Atsushi Yamashita

cs.SD cs.LG ·submitted 2026-11-06 10:34 UTC · v1

Abstract

We propose AnomSep, which combines optimiza-tion-based separation with deep neural refinement to achieve accurate anomaly detection with listenable explanations. Anomaly detection requires no predefined anomalous categories, and understanding the basis for each detection helps security personnel assess the validity of each detection. End-to-end anomaly detectors can achieve high detection accuracy but output only scalar scores, and existing anomalous sound separation methods provide listenable explanations with limited detection accuracy. AnomSep first obtains preliminary normal-sound and anomalous-sound estimates through optimization-based separation using a dictionary learned from normal sounds in the target environment. Deep neural refinement then improves the preliminary estimates in a pretrained audio latent space. The separated anomalous sound serves as the listenable explanation, and its energy determines the anomaly score. Experiments on synthetic mixtures and real mixtures show improved separation quality over baseline separators. AnomSep achieves detection performance competitive with the end-to-end baseline and provides listenable explanations directly linked to each detection decision.

Comment
11 pages, 3 figures

Closest papers

Nearest neighbours by meaning across the whole index.

Adaptive Compression and Targeted Perturbation: A Unified Framework for Generalized Audio Deepfake Detection

cs.SD cs.AI ·2026-10-12 ·Jianqiao Cui, Haoxian Zhu, Hanbiao Meng, Yanghao Zhang
top venue similarity 0.66
Abstract · 10 pages,1 figure, Accepted by NeurIPS 2026

Existing audio deepfake detection (ADD) methods frequently exhibit limited generalization, as fixed bottleneck architectures fail to adapt to the heterogeneous information densities inherent in diverse spoofing artifacts. Moreover, standard augmentation often leads to a pathological robustness-accuracy trade-off. In this paper, we propose a unified ADD framework to address these challenges. Our approach integrates: (1) an Adaptive Audio Feature Integration (AAFI) module that dynamically selects optimal latent dimensions via a compression pool and a stochastic exploration mechanism, ensuring flexible representations across multiple types of dynamic attacks; and (2) a Mel-Band Adversarial Perturbation (Mel-BAP) strategy that applies targeted regularization in the mel-spectrogram domain to encourage the model to learn invariant decision boundaries. Extensive evaluations on benchmarks including ADD 2022, FakeOrReal, and In-the-Wild demonstrate that our model based on Whisper-small achieves a state-of-the-art average Equal Error Rate (EER) of 1.51%. Compared to existing SOTA models such as the 3-billion-parameter Resemble-Detect-3B-Omni, our framework reduces the parameter count by up to 91.6% while achieving a 60.7% improvement in average EER. In a separate cross-lingual evaluation, the Whisper-base configuration achieves EERs of 3.91-5.65% on five unseen languages. The framework also maintains strong resilience to real-world acoustic distortions. This work provides a scalable and efficient "plug-in" solution for enhancing trust and security in the audio Web ecosystem.

0.23

Anomalous Sound Detection Using Separation Features and Paired-Mixture Representation Learning

eess.AS ·2026-11-13 ·Seunghyeon Shin, Seokjin Lee
similarity 0.66
Abstract · 11 pages, 3 figures; 6-page supplementary material included as an ancillary file. Submitted to IEEE Sensors Journal

Acoustic condition monitoring often relies on normal recordings with limited operating-condition information. This study proposes an anomalous sound detection system that learns from normal recordings without external pre-training and uses machine-type information to organize training and normal references. A separator learns target-component estimation from mixtures of normal target and non-target recordings. With the separator frozen, regional attention and multi-stage fusion are trained on paired mixtures sharing a target, using contrastive and target-reference consistency objectives. Paired-mixture embedding differences provide covariance statistics for correction with normal-reference centering, followed by cosine nearest-neighbor scoring. On Task 2 development-test data from the 2022 Detection and Classification of Acoustic Scenes and Events challenge, the two-block, 64-channel system achieves an overall harmonic mean of 64.56% on average across three independent training and evaluation runs, with a sample standard deviation of 0.33 percentage points. This mean exceeds that of direct paired-mixture learning by 2.23 percentage points and is 0.31 percentage points below that of the evaluated distillation system using an externally pre-trained teacher. For the learned embeddings, cosine nearest-neighbor scoring outperforms the evaluated Mahalanobis scorers based on global normal statistics. These results demonstrate the effectiveness of combining separation-based representation learning, interference-based correction, and local normal-reference scoring for anomalous sound detection without detailed operating metadata.

0.14

Detection-Guided Adaptive Purification with Diffusion Models for Robust Audio Deepfake Detection

cs.CR cs.SD ·2026-10-07 ·Muhammed Salih Kayhan, Qiben Yan
top venue similarity 0.64
Abstract · Accepted at the 4th EAI International Conference on Security and Privacy in Cyber-Physical Systems and Smart Vehicles (EAI SmartSP 2026)

Audio deepfake detectors remain vulnerable to adversarial perturbations that suppress the acoustic cues used for detection, allowing manipulated utterances to evade the detector. Although existing defenses can improve robustness, they require retraining the detector or introduce additional distortion. Diffusion-based purification instead leaves the pretrained detector unchanged, but existing methods use the same purification strength for all inputs, creating a trade-off between removing adversarial perturbations and preserving the subtle spoofing cues needed for detection. In this paper, we propose Detection-Guided Adaptive Purification (DGAP), a diffusion-based defense that adjusts purification strength per input. Building on the observation that a light purification perturbs the detector score of an adversarial input far more than that of a benign one, the framework uses the resulting score shift as a reference-free indicator of adversarial manipulation. Inputs with small shifts are passed unchanged, whereas flagged inputs undergo stronger purification before final detection. We evaluate the framework against three adversarial attack settings across three deepfake detectors, and compare it with nine existing defenses. Our results show that DGAP achieves the best defense performance across all detectors while leaving benign inputs nearly unaffected, and remains effective under the defense-aware adaptive attack.

0.35

A Stem-Agnostic Approach to Hybrid AI Music Detection

cs.SD eess.AS ·2026-09-22 ·Richa Namballa, François Rigaud, Romain Hennequin
similarity 0.64
Abstract · 4 pages + references, 5 figures, submitted to the 2027 IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP)

The inclusion of generative audio in the music production process has led to an increase in hybrid music tracks that blend authentic human performances with AI-generated stems, challenging traditional AI music detectors which operate in a binary setting. In this work, we propose a stem-agnostic framework for identifying synthetic audio sources within hybrid musical mixtures. We introduce the inspectrogram, a novel time-frequency representation that maps localized probabilities of synthetic content across the audio spectrum. By combining the inspectrogram with a Wiener filter estimating target stem energy dominance, a single CNN model evaluates whether the specific stem is generated. Trained on rendered hybrid mixtures and evaluated across various stem classes, our model achieves strong performance on high-frequency sources such as vocals, drums, and guitar, but struggles on the low-frequency, narrow-band bass. We conclude that the quality of separation impacts the detection accuracy and identify source separation as a primary bottleneck and a crucial direction for future research.

0.29

Robust Workflow Generation via Adversarial Learning for Audio Deepfake Detection

cs.SD cs.AI ·2026-09-17 ·Xiang Li, Pin-Yu Chen, Wenqi Wei
similarity 0.63
Abstract

The rapid advancement of speech synthesis and voice conversion technologies has made audio deepfakes increasingly realistic, posing serious security risks in practical applications. While existing detection methods achieve strong performance under controlled conditions, they often fail to generalize under real-world perturbations and corruptions. In this paper, we propose ROGUE, a framework that dynamically constructs robust detection workflows by orchestrating multiple detection tools. ROGUE formulates workflow generation as a sequential decision-making problem and introduces a dual-agent paradigm, where a perturbation agent generates audio perturbations and a policy agent learns to select and execute detection tools under perturbed conditions. Through adversarial learning, ROGUE enables perturbation-aware tool selection, adaptive execution strategies, and improved robustness to distribution shifts. Extensive experiments across multiple datasets and real-world corruptions demonstrate that ROGUE consistently outperforms strong baselines in both robustness and generalization. Our results highlight the effectiveness of adversarially optimized workflow generation for building reliable audio deepfake detection systems in real-world deployment settings.

0.14

HARMONY: Hierarchical Anchor Retrieval on Manifold for Oblivious-source Machinery Acoustic Anomaly Detection

cs.SD ·2026-10-22 ·Yuhang Zhang, Yang Li, Qiang Wu, Mingyuan Li
positioncode/data similarity 0.63
Abstract

In standard acoustic anomaly detection (ASD), models are usually trained separately for each machine or domain using explicit metadata. However, in realistic deployments, machine identifiers are incomplete, unreliable, or simply unavailable. Thus, metadata-free machinery ASD asks a single model to monitor mixed machine populations without machine IDs. In this paper, we argue that the main failure mode is not a weak detector family, but representation entanglement. The heterogeneous normal modes overlap in frozen pre-trained feature spaces, making anomaly scoring and approximate retrieval unreliable. We study this problem directly and propose HARMONY (Hierarchical Anchor Retrieval on Manifold for Oblivious-source acoustic aNomalY detection), an anchor-guided geometric repartitioning framework that reorganizes mixed-source features into compact Voronoi regions and reuses this structure for hierarchical retrieval. On DCASE 2020, HARMONY improves mean AUC from 75.40% to 90.00% (14.60 percentage points) over the strongest unified baseline and from 83.90% to 90.00% over a strong foundation-feature baseline. On a single CPU, its hierarchical retrieval achieves a 7.8x speedup over exhaustive search with only a 0.20 percentage-point AUC drop. These results suggest that incorporating explicit geometric partitioning can improve both detection accuracy and retrieval efficiency for ASD. Code is available at https://github.com/Zzyh0208/HARMONY.

0.34

Hear Every Sound Object: Rescuing Overlooked Sources in Auditory Scene Analysis

eess.AS ·2026-10-22 ·Younghoo Kwon, Yongjoon Lee, Jung-Woo Choi
similarity 0.63
Abstract · 5 pages, 4 figures, Submitted to ICASSP 2027

Auditory scene analysis (ASA) models extract information about individual sound sources from a complex auditory mixture. Recent object-based ASA models process the mixture through a sequence of modules and split it into source-wise features (i.e., object features) only at the last layer. However, substantial disparities in performance across sources limit overall performance. Our analysis using centered kernel alignment (CKA) reveals that CKA scores correlate strongly with per-source performance, with their disparities widening from intermediate to deeper layers. These findings motivate the early split and exchange of object features to address source-wise performance disparities before they widen in deeper layers. To this end, we propose PARASITE, a plug-in refinement architecture that splits object features at earlier layers and progressively refines them through sequential layers. Each layer integrates object features separated at different depths using Object-wise Gated Fusion (OGF) and then refines them using Windowed Cross-Object Attention (WCOA). We introduce the DeepASA++ model, which combines PARASITE with an ASA backbone and delivers state-of-the-art results on both ASA2 and STARSS23. DeepASA++ achieves a SELD score of 0.240 on STARSS23 and surpasses prior multi-stage inference architectures, including chain-of-inference.

0.12

PerMix: Anomalous sound detection by predicting the perturbation ratio of mixed samples

eess.AS ·2026-10-22 ·Jihoon Choi, Jung-Woo Choi
benchmarkcode/data similarity 0.62
Abstract · 5 pages, 1 figure, submitted to ICASSP 2027

In anomalous sound detection based on self-supervised learning, the performance of the detection model largely depends on the selection of the pretext task through which the characteristics of normal data are learned. A common pretext task is to mix samples from different classes and classify the mixed sample as its target class with an angular margin loss. However, this supervision becomes mismatched when the target sample is the minority component of the mixture and the margin remains fixed irrespective of the mixing ratio. To address these issues, we propose a pretext task that directly predicts the perturbation ratio of mixed samples by reformulating the logit so that the angular margin is scaled by the perturbation ratio. In addition, we adopt a supervised contrastive loss modified for mixed samples, in which positive pairs are formed according to the dominant class. Experiments show that our approach achieves state-of-the-art results on the DCASE 2020 Task 2 benchmark. Our code is available at https://github.com/kaistss/PerMix.

0.44