CS Paper Radar

Acoustic Echo Control Based on Sound Object Identification for Suppressing Howling Caused by Complicated Acoustic Paths

Osamu Hoshuyama

eess.AS cs.SD ·submitted 2026-08-26 06:15 UTC · v1
unusual

Abstract

This paper proposes acoustic echo control based on sound object identification for suppressing acoustic echo and howling in conferencing environments with complicated acoustic paths, where multiple hands-free terminals coexist in the same room. Conventional acoustic echo cancellers target fixed intra-device echo paths; however, unintended paths, for example, those formed via inter-terminal communication, are difficult to control and can lead to howling. Instead of estimating echo paths, the proposed approach identifies sound objects and keeps channels muted by default, allowing pass/playback only when the signal is judged not dentical to recently observed objects. This breaks echo loops caused by repeated reproduction of the same sound object and can be viewed as an extension of classical voice switching toward conditional half-duplex operation. Technical challenges and connections to related techniques are discussed, and a simulation shows howling suppression together with a trade-off against speech quality.

Comment
5 pages, 3 figures. Submitted to IEEE Signal Processing Letters

Closest papers

Nearest neighbours by meaning across the whole index.

Direction-preserving Spatial Audio Signal Enhancement in The Spherical Harmonic Domain

eess.AS ·2026-10-07 ·Huawei Zhang, Jihui Aimee Zhang, Huiyuan June Sun, Prasanga Samarasinghe
published similarity 0.54
Abstract · Accepted by the 55th International Congress & Exposition on Noise Control Engineering (INTER-NOISE 2026)

Spatial audio signal enhancement (SASE) aims to separate a desired soundfield from interference and noise while preserving its spatial cues. However, existing algorithms pay limited attention to preserving the spatial cues of the residual interference, which reduces their effectiveness in practical applications. In this paper, we propose a direction-preserving SASE algorithm based on multi-output beamforming. The proposed algorithm extracts the desired soundfield while preserving the spatial cues of both the desired soundfield and the residual interference soundfield. The simulation study shows that the proposed algorithm achieves performance comparable to the existing SASE algorithm in terms of estimation error, while it better preserves the spatial cues of the residual interference within a region of interest, in a noisy and reverberant environment.

0.25

RadarVox: Radar-Audio Multimodal Cocktail-Party Speech Separation with Speaker-Aware Cross-Modal Matching

eess.AS cs.MMcs.SD ·2026-09-20 ·Yanlin Xu, Yiwei Ru, Mupei Li, Yongji Liu, Jie Wang +1 more
benchmark similarity 0.52
Abstract

In embodied voice interaction, cocktail-party speech perception requires both speech separation and speaker attribution across machine-generated and human speech sources. However, conventional audio-only blind source separation remains permutation ambiguous, making the correspondence between separated streams and physical speakers unclear. This paper presents RadarVox, a radar-audio multimodal benchmark for identity-aware cocktail-party speech separation. RadarVox provides acoustic mixtures and source-level radar displacement signals from loudspeaker-emitted and human speech, enabling source-aware speaker assignment. FMCW radar captures laryngeal mechanical motion, providing speaker-specific spatial-motion cues unavailable to a single-channel microphone. We inject radar-derived priors into a DPRNN separator via gated fusion and learn a speaker-aware cross-modal matcher to associate unordered speech streams with radar-observed speakers. Experiments on multi-speaker mixtures show that radar cues provide complementary benefits, achieving scale-invariant signal-to-distortion ratio (SI-SDR) values of 9.75 dB and 7.13 dB in two- and three-speaker scenarios, respectively. More importantly, the proposed method improves ordered SI-SDR by more than 13 dB over audio-only methods while achieving over 80\% speaker assignment accuracy.

0.18

Voice-Light: A Full-Duplex Cascaded Voice Agent with Causal Turn-Taking and Speculative Generation

cs.SD cs.CLeess.AS ·2026-09-17 ·Bertil Braun
code/data similarity 0.52
Abstract · 9 pages, 4 figures, 6 tables. Code, datasets, and model artifacts: https://github.com/BertilBraun/Voice-Light ; live demo: https://voice.ber…

Natural spoken interaction requires more than streaming ASR, language generation, and speech synthesis: a system must react to overlap without canceling on every acknowledgment, prepare a response before a turn is certain, and ensure canceled audio cannot enter conversation history. We present Voice-Light, a full-duplex cascaded voice agent that combines immediate acoustic onset, a causal adapter sharing a streaming ASR encoder, reversible playback control, and private speculative response generation. Structured tool calls execute concurrently with audible bridge speech, while browser acknowledgments make rendered audio authoritative for durable history. Locked evaluation on 1,673 real-conversation silence candidates found that an earlier learned completion checkpoint preserved a 2.70% false-cutoff rate but reached only 12.53% end-of-turn recall, compared with 95.60% for a Silero timing policy. The deployed system therefore retains a hybrid controller rather than claiming a learned-policy replacement. Across three unscripted operator-run microphone sessions, 36 measured response turns had a 758 ms median from final VAD endpoint to first server audio; 21 turns were below 800 ms. These sessions are an instrumented case study, not a controlled user evaluation. We release the synthetic data, model artifacts, evaluation code and summaries, source code, and deployment configuration supporting the result.

0.60

A Lightweight Hybrid Framework for Acoustic Echo Cancellation and Suppression via Constrained Recursive Training

eess.AS ·2026-10-07 ·Huawei Zhang, Rilin Chen, Hao Zhang, Meng Yu, Dong Yu
similarity 0.51
Abstract · Accepted by the 19th International Workshop on Acoustic Signal Enhancement (IWAENC 2026)

We propose a hybrid framework that combines deep learning with adaptive filtering for acoustic echo cancellation (AEC) and suppression. It integrates a multi-output neural network to jointly update filter parameters and perform post-processing. A learnable variant of the normalized least mean squares (NLMS) filter is introduced, incorporating a variable step size and a variable transition factor that are recursively updated for dynamic adaptation. In addition, an enhanced near-end speech estimate is generated from the filter output to suppress the residual echoes. To ensure training stability, we propose a constrained recursive training strategy that aligns with the adaptive nature of the filter, where an upper-bound constraint is introduced on the filter output. For efficiency, the framework adopts a lightweight implementation with only 253 k parameters. Experimental results show that the framework outperforms the baselines in terms of both signal quality and speech intelligibility.

0.12

DiffVQE2: An Efficient Low-delay Diffusion Model for Acoustic Echo and Noise Control

eess.AS cs.SD ·2026-09-19 ·Haljan Lugo, Ernst Seidel, Pejman Mowlaee, Ziyue Zhao, Tim Fingscheidt
published similarity 0.51
Abstract · accepted at IWAENC 2026

Hands-free communication devices and speakerphones are inherently affected by acoustic echo and background noise. To mitigate these impairments, end-to-end discriminatively trained neural networks have emerged as the best-performing approach in research and deployment. While recent advancements in generative methods have provided remarkable results for various speech enhancement tasks, diffusion-based acoustic echo control (AEC) research is still restricted to non-causal, utterance-level processing, thereby not widely applicable in practice. With this work, we are the first to propose low-delay (i.e., causal) diffusion-based joint AEC and noise control models DiffVQE2 / DiffVQE2-S, excelling the so-far state of the art DeepVQE / DeepVQE-S models in multiple objective metrics, and, most importantly, in subjective MOS, respectively. In addition, our models are less complex. Furthermore, we show that a limited lookahead applied to the efficient DiffVQE2-S model allows for an even higher performance. These results have been obtained on the ICASSP 2023 AEC Challenge blind test set. We claim the first streaming-capable, diffusion-based acoustic echo and noise control that excels state-of-the-art discriminative approaches.

0.29

Active noise cancellation extends the benefit of AI speech enhancement in real hearing-aid recordings

eess.AS ·2026-10-12 ·Andrew T. Sabin, Linkai Li
similarity 0.51
Abstract · 8 pages, 5 figures, 1 table

Active noise cancellation (ANC) is common in headphones but rare in hearing aids, and its value for understanding speech in noise is not established. Algorithms that improve signal-to-noise ratio (SNR) act only on the hearing aid's amplified path, while unprocessed sound also reaches the eardrum directly through the vent, limiting the SNR improvement that is realized. Our earlier simulations predicted that attenuating this direct path with ANC would substantially increase the benefit of such processing. We tested that prediction in three hardware conditions: a standard receiver-in-canal (RIC) hearing aid, and an ANC-capable RIC with ANC off and on. Each was fit to NAL-NL2 targets for an N3 hearing loss and recorded on KEMAR with an AI speech-enhancement algorithm (AI-SE) off and on, in seven realistic scenes above 70 dB SPL. Speech and noise spectra were estimated from each recording with a binary time-frequency mask derived from the clean speech. AI-SE produced a similar peak benefit of about 4 dB in the high frequencies in all three conditions, but that benefit stayed at or above 1 dB only above 1500, 600, and 130 Hz for the standard RIC, ANC RIC (ANC off), and ANC RIC (ANC on), respectively, closely tracking the measured attenuation of the direct path. With AI-SE on, ANC RIC (ANC on) improved SII-weighted SNR by 5.1 dB relative to the open ear, compared with 3.3 dB for ANC RIC (ANC off) and 1.6 dB for the standard RIC. With AI-SE off, enabling ANC added only 0.2 dB. ANC is therefore an enabling technology: on its own it added little, but by attenuating the direct path it allowed SNR-enhancing processing to deliver substantially greater benefit at the eardrum, extending that benefit to much lower frequencies.

0.21

The Hearpiece Database of Binaural Room Impulse Responses and Driver Responses on KEMAR

eess.AS ·2026-11-04 ·Tong Xiao, Reinhild Roden, Matthias Blau, Simon Doclo
similarity 0.51
Abstract · 13 pages, 7 figures, 5 tables. Database and MATLAB loading script available at https://doi.org/10.5281/zenodo.23667308

This document describes the measurement setup, signal processing, data organization, and MATLAB file format of a database of acoustic responses measured on a Knowles Electronics Manikin for Acoustic Research (KEMAR) using the Hearpiece, a multi-microphone, multi-driver in-ear research device. The data include binaural room impulse responses (BRIRs) and Hearpiece driver responses, together with center-microphone room impulse responses and a loopback impulse response of the playback and recording system. The BRIRs cover two Hearpiece configurations, three room conditions, three independent insertions per configuration, and 24 horizontal source directions. The database supports reproducible research on binaural and hearing-device signal processing, with potential applications in speech enhancement, spatial filtering and source separation, dereverberation, active noise and occlusion control, and acoustic feedback cancellation. The database, MATLAB loading script, and technical documentation are publicly available at https://doi.org/10.5281/zenodo.23667308.

0.35

Reproduction of Simulated Acoustics Scenes Using Acoustics Room Transformer for speech intelligibility tests in Clinics

eess.AS physics.med-ph ·2026-11-13 ·Ali Fallah, Kirsten C Wagener, Pascal Pflueger, Steven van de Par
similarity 0.51
Abstract · This paper is submitted to Acta Acustica and is currently under review

An Acoustic Room Transformation (ART) method is proposed for clinical applications to render simulated acoustic environments using six loudspeakers in a reverberant room. In typical clinical settings, testing rooms are not acoustically treated and only a limited number of loudspeakers are available. The ART approach enables control of the playback-room reverberation, allowing speech intelligibility tests to be performed under realistic and perceptually compensated conditions. The method focuses on the two most common Speech Reception Threshold (SRT) configurations: S0N90 and S0N90. One front and one side loudspeaker reproduce the direct sound components, while the remaining four loudspeakers (two in front and two behind the listener) generate the reverberant sound field. The direct sound is optimized in terms of energy, and the reverberant field is adjusted based on both energy and interaural coherence. An additional direct-sound gain is applied to match the clarity index (C50) of the reproduced signals to that of the reference target. Results from speech intelligibility tests demonstrate that, with ART processing, the reproduced scenarios achieve SRT values very close to those of the reference signal in both S0N0 and S0N90 conditions and therefore allow for comparable speech test results independent of the particular test room acoustics.

0.27