CS Paper Radar

Conflict-Aware Meta-Learning for Generalizable Speech Deepfake Detection

Siqing Qin, Kong Aik Lee, Youzhi TU, Eng Siong Chng, Man-Wai Mak

eess.AS ·submitted 2026-11-05 22:13 UTC · v1

Abstract

Speech deepfake detectors built on large self-supervised learning front-ends achieve high in-domain accuracy, yet suffer degradation under domain shift caused by unseen synthesizers, transmission codecs, or unfamiliar acoustic conditions. Meta-learning, particularly model-agnostic meta-learning for domain generalization (MLDG), addresses this issue by simulating domain shifts. However, applying MLDG directly introduces a bi-level optimization challenge that remains unsolved. First, effective domain-shift emulation requires genuine distributional gaps between meta-splits, yet such gaps can frequently produce gradient conflicts, destabilizing the bi-level optimization. Second, the stochastic nature of mini-batch gradients causes the reference direction to fluctuate across iterations, resulting in an optimization trajectory that fails to achieve domain generalization. We propose a conflict-aware meta-learning (CAML) framework, which addresses both challenges through three complementary components. Firstly, base domain gradient surgery (base-DGS) introduces an asymmetric projection that treats the meta-train gradient as a primary anchor. Secondly, EMA-DGS replaces the unstable anchor with its exponential moving average (EMA), providing a stable optimization trajectory anchor that substantially reduces domain-shift-induced conflict detections. Thirdly, layer-wise DGS (LW-DGS) further extends the framework to individual parameter tensors, enabling fine-grained, layer-specific intervention that targets conflict-prone layers while leaving well-aligned parameters intact. Experimental results demonstrate that the proposed CAML framework achieves lower EER than the compared baselines on most cross-dataset evaluations across multiple cross-dataset benchmarks and architectures, achieving a maximum relative improvement of 45.2% in terms of EER.

Comment
submit to TASLP; 13 pages

Closest papers

Nearest neighbours by meaning across the whole index.

DGS-MLDG: Domain Gradient Surgery Guided Meta-Learning for Domain Generalization in Speech Deepfake Detection

eess.AS cs.SD ·2026-09-27 ·Siqing Qin, Kong Aik Lee, Youzhi Tu, Eng Siong Chng, Man-Wai Mak
top venue similarity 0.85
Abstract · Accepted by INTERSPEECH 2026

Speech deepfake detection faces significant challenges due to domain shifts. Domain generalization (DG), particularly meta-learning for domain generalization (MLDG), offers a promising solution by simulating and mitigating domain shifts. However, MLDG is often hindered by conflicting gradients between its meta-train and meta-test objectives, leading to suboptimal performance. To address this problem, we propose domain gradient surgery (DGS), a meta-learning method that resolves conflicts through an asymmetric projection strategy. DGS removes the destructive component from the meta-test gradient, ensuring a conflict-free optimization trajectory versus the meta-train gradient. Furthermore, we introduce layer-wise DGS (LW-DGS), an efficient variant of DGS that dynamically identifies and intervenes only conflict-prone layers. Extensive experiments on challenging benchmarks demonstrate that DGS-MLDG and LW-DGS-MLDG achieve an average relative EER reduction of 5.29% and 4.04%, respectively.

0.68

Source-Directed Trajectory Perturbation at First-Order Cost for Domain Generalization in Speech Deepfake Detection

eess.AS ·2026-10-07 ·Siqing Qin, Kong Aik Lee, Youzhi Tu
similarity 0.83
Abstract

Speech deepfake detectors often lose accuracy when the distribution of the test data differs from that of the training data. Meta-learning for domain generalization (MLDG) shows promise by simulating domain shifts with episodic meta-train and meta-test splits. However, the MLDG meta-objective considers only a single clean adaptation trajectory and does not account for the local loss landscape around its endpoints. To address this limitation, we first propose an explicit worst-case MLDG variant, dubbed WC-MLDG-4P, which perturbs both the meta-train and meta-test states but requires four gradient evaluations per episode. We then introduce WC-MLDG-2P, a source-directed alternative to the explicit robust objective. It shifts the clean MLDG endpoint toward a locally higher source-loss state and evaluates the meta-test gradient there, retaining the two-evaluation cost of the first-order MLDG. A first-order expansion relates the resulting gradient change to meta-test directional curvature along the source gradient without explicitly computing a Hessian. Relative to MLDG, WC-MLDG-2P achieves relative mean-EER reductions of 23.4% with XLSR-AASIST and 7.6% with XLSR-Conformer-TCM, respectively.

0.02

Domain-Adaptive Dual-Gating Mixture of Experts for Generalizable Speech Deepfake Detection

eess.AS cs.SD ·2026-09-27 ·Siqing Qin, Zhe Li, Kong Aik Lee, Man-Wai Mak
top venue similarity 0.70
Abstract · Accepted by INTERSPEECH 2026

Recent advances in speech deepfake detection (SDD) have leveraged the Mixture of Experts (MoE) to enhance generalization capacity. However, existing gating networks often overlook the acoustic and temporal cues of deepfakes. In this work, we propose a novel domain-adaptive dual-gating MoE (DADGMoE) framework for SDD under unseen attack types and acoustic conditions. Our innovative dual-gating mechanism leverages Sinc-layer-based filters to process both low-level acoustic signals (raw waveforms) and high-level speech representations from a large self-supervised learning (SSL) model. It further incorporates domain prototypes to guide expert routing based on implicit deepfake patterns. The lightweight affine experts process the routed inputs. Experiments show that our DADGMoE significantly outperforms the baseline, achieving up to a 40.8% relative EER reduction on challenging out-of-dataset benchmarks. This framework demonstrates superior generalization capabilities and efficient design.

0.59

Acoustic domain shift in spoken language identification from systematic domain generalization evaluation to real-world application

eess.AS cs.LGcs.SD ·2026-09-23 ·Francois Derrida, Raphaël Duroselle, Thomas Courtat, Jean-François Bonastre
dataset similarity 0.69
Abstract

Domain Generalization (DG) aims to develop models that remain robust to conditions unseen during training. While DG has been systematically studied in computer vision through controlled benchmarks and diverse distribution shifts, its evaluation in spoken language recognition remains less structured. Existing speech datasets provide valuable benchmarks for robustness to real-world acoustic conditions, but are primarily designed around specific scenarios and large scale rather than as general-purpose tools for systematically constructing and evaluating domain shifts. In this work, we introduce a smallscale speech dataset and evaluation protocol for controlled studies of acoustic domain shifts. It enables the evaluation of spoken language recognition models under a variety of acousitc domain shifts. We introduce the speech modality into the DomainBed Domain Generalization framework and evaluate three domain generalization algorithms. We show that in-domain performance is not a reliable predictor of cross-domain robustness and verify that explicit domain invariant algorithms such as MMD or DANN algorithms do not outperform ERM. We further validate the generality of these findings on MMS-LID-126, a state-of-the-art spoken language identification system. We release the code.

0.27

Domain-Incremental Learning for Generative Speech Enhancement

eess.AS cs.SD ·2026-09-28 ·Manjunath Mulimani, Annamaria Mesaros, Minje Kim, Jesper Rindom Jensen
similarity 0.69
Abstract · Submitted to the IEEE International Conference of Acoustics, Speech, and Signal Processing (IEEE ICASSP 2027)

We propose a domain-incremental learning framework for generative speech enhancement (SE) that learns from a sequence of datasets or domains recorded under diverse acoustic conditions. Fine-tuning a pretrained model on continuously evolving domains leads to catastrophic forgetting of previously acquired knowledge, while zero-shot generalization often fails to adequately adapt to unseen domains. To address these challenges, we first develop a novel language model-based generative SE model that we then use as a pretrained backbone and incrementally adapt it to acoustically mismatched domains using lightweight domain-specific Low-Rank Adaptation. The proposed framework enables the model to acquire enhancement capabilities for new domains while preserving performance on previously learned domains. Evaluated on four heterogeneous speech datasets, our approach effectively adapts to new domains without forgetting previously learned domains.

0.14

Task-Aware Joint Pruning and Distillation for Efficient Audio Deepfake Detection

cs.SD cs.AI ·2026-10-04 ·Miao He, Peng Cheng, Zhongjie Ba, Qing Wen, Li Lu +2 more
top venue similarity 0.69
Abstract · 6 pages, 4 figures, Proceedings of Interspeech 2026

Advances in speech synthesis have made deepfake speeches increasingly convincing, posing growing threats to security. While self-supervised learning (SSL) based detectors achieve state-of-the-art performance, their computational demands (typically 300M+ parameters) prevent deployment on resource-constrained devices. Existing compression methods, designed mainly for content-centric tasks, struggle to maintain competitive performance when directly adapted to deepfake detection. We propose a Task-Aware Joint Pruning and Distillation framework that combines cross-domain knowledge distillation with movement-guided structured pruning to transfer forgery-discriminative knowledge and preserve critical structures under aggressive compression. Our framework reduces the model to 31.9M parameters with 6.3$\times$ FLOPs reduction, with an average performance drop of only 1.30\% across multiple datasets compared to the uncompressed baseline, demonstrating strong potential for on-device deployment.

0.32

Textual Acoustic Grounding for Generalizable LLM-Based Deepfake Voice Detection

cs.SD eess.AS ·2026-08-31 ·Yassine El Kheir, Xin Wang, Wanqing Ge, Tim Polzehl, Sebastian Moeller +1 more
code/data similarity 0.69
Abstract · 6pages + 1ref, SLT Submission

Deepfake voice detection suffers from poor generalization across unseen domains. While Audio Large Language Models (ALLMs) show promise, the modality gap between continuous audio embeddings which capture the subtle acoustic details necessary for deepfake detection and the semantic space of LLMs remains a critical, underexplored bottleneck. We address this by benchmarking diverse audio encoders integrated with Qwen LLMs (0.5B to 7B parameters). First, we demonstrate that fine-tuning the LLM alone risks out-of-domain overfitting, making a frozen LLM a stronger, resource-efficient baseline. Second, to explicitly bridge the modality gap, we introduce a cross-modal prompting strategy that injects linguistic-knowledge-driven acoustic features (via openSMILE) as structured text tokens. This explicit textual grounding not only enhances the frozen baseline but also makes LLM fine-tuning more effective. Ultimately, our approach demonstrates state-of-the-art resilience on the out-of-domain ITW and MLAAD benchmarks, yielding over \textbf{16.2\%} absolute improvement in Macro-F1 over existing ALLM baselines while maintaining competitive in-domain performance. All models reported in this work are \href{https://huggingface.co/01Yassine/AudioLLM-Deepfake-Detection}{publicly available}.

0.53

What Do Deepfake Audio Detectors Hear? From Self-Supervised Models to Audio LLMs

cs.SD ·2026-10-13 ·Wanying Ge, Xin Wang, Junichi Yamagishi
publishedcode/data similarity 0.68
Abstract · Accepted to SLT 2026

Real-world audio recordings for deepfake detection rarely consist solely of speech; they often are mixtures of speech and background events that themselves may also be synthetic. When processing these mixtures, it remains unclear whether detectors attend to the speech or the background event, and where their spectral evidence lies. We study this on the CompSpoof V2 database, whose mixtures pair independently real-or-fake speech and event components. Our results show that all systems detect fake events more accurately than fake speech. However, this performance gap is largely driven by poor generalization to an unseen fake speech domain, rather than a true difference in difficulty. Furthermore, sub-band probing reveals that the front-end encoder dictates where a countermeasure focuses its frequency evidence. To enable reliable deployment in real-world scenarios, future countermeasures should address out-of-domain generalization failures and carefully select front-end encoders aligned with their target acoustic evidence. Our source code and checkpoints are released at https://github.com/nii-yamagishilab/AntiDeepfake-AudioLLM.

0.25