CS Paper Radar

Direction-preserving Spatial Audio Signal Enhancement in The Spherical Harmonic Domain

Huawei Zhang, Jihui Aimee Zhang, Huiyuan June Sun, Prasanga Samarasinghe

eess.AS ·submitted 2026-10-07 08:59 UTC · v1
published

Abstract

Spatial audio signal enhancement (SASE) aims to separate a desired soundfield from interference and noise while preserving its spatial cues. However, existing algorithms pay limited attention to preserving the spatial cues of the residual interference, which reduces their effectiveness in practical applications. In this paper, we propose a direction-preserving SASE algorithm based on multi-output beamforming. The proposed algorithm extracts the desired soundfield while preserving the spatial cues of both the desired soundfield and the residual interference soundfield. The simulation study shows that the proposed algorithm achieves performance comparable to the existing SASE algorithm in terms of estimation error, while it better preserves the spatial cues of the residual interference within a region of interest, in a noisy and reverberant environment.

Comment
Accepted by the 55th International Congress & Exposition on Noise Control Engineering (INTER-NOISE 2026)

Closest papers

Nearest neighbours by meaning across the whole index.

Mask-Based Speech Enhancement for Spatial Audio: A Comparison of Ambisonics, Beamforming, and Microphone Channels

eess.AS ·2026-09-16 ·Sheli Hendel, Boaz Rafaely, Dorothea Kolossa
similarity 0.69
Abstract

Mask-based speech enhancement is widely used for suppressing noise and interference, but its performance in spatial audio algorithms with multichannel output has not been studied extensively. In such settings, speech enhancement must improve speech quality while preserving spatial cues that are essential for localization, spatial awareness, and spatial release from masking. In this work, we systematically compare time frequency masking applied to three signal representations: microphone signals, beamformer outputs, and Ambisonics signals. Performance is evaluated in terms of speech quality, intelligibility, binaural cue preservation, and reverberation preservation. Results reveal a clear trade-off between enhancement and spatial fidelity: beamformer-domain masking achieves the highest speech enhancement scores, while Ambisonics-domain masking better preserves the spatial attributes of the residual interference. All methods preserve the target's localization cues.

0.15

Echo Detection in Spatial Room Impulse Responses Measured with Spherical Microphone Arrays Using the Herglotz Wavefunction

eess.AS ·2026-09-23 ·Pierre Massé, Anthony Gallien, Wolfgang Kreuzer, Markus Noisternig
similarity 0.66
Abstract · 15 pages, 10 figures, 4 tables

Early reflections in spatial room impulse responses (SRIRs) measured using spherical microphone arrays (SMAs) play an important role in spatial audio analysis, rendering, and reverberation modeling. Their accurate localization and characterization can facilitate the analysis, processing, and manipulation of measured reverberation fields. This paper proposes a method for detecting and characterizing early reflections based on the Herglotz wavefunction formalism. The measured sound field is represented as a continuous superposition of incident plane waves, from which a localization function is derived in the spherical harmonic domain. An adaptive radial Gaussian fitting procedure is then used to estimate both the directions of arrival (DoAs) and the number of incident reflections within a single analysis frame. The proposed framework is evaluated using simulated and measured SRIRs and compared with conventional steered response power (SRP) and multiple signal classification (MUSIC) localization methods. The results demonstrate improved localization accuracy and more reliable detection of multiple simultaneous reflections, highlighting the potential of the proposed Herglotz-based formulation for the analysis of early reflections in SMA-measured SRIRs.

0.29

Fast Time-Varying Exponentiated Convolution Methods for Generative Direction Dependent Reverberation

cs.SD eess.ASeess.SP ·2026-09-21 ·Yuancheng Luo
published similarity 0.63
Abstract · Accepted to proceedings at Audio Engineering Society Convention Nashville 2027

Spherical harmonic encoded acoustic sound-fields capture directional characteristics of room impulse responses that are useful for accurate spatial audio reproduction. However, high costs of multi-microphone measurements and numerical simulations motivate alternative data-set augmentation and synthetic data generation methods that supplement small collections. This paper introduces time-varying exponentiated convolution methods that transform both Gaussian noise and impulse responses into reverberation and modified spectral-decay fields respectively. We derive two recursive and fast convolution algorithms that extend into the spherical harmonic domain, model smooth reverberation time distributions with non-stationary Gaussian processes, and realize an optimal filter design. Experiments evaluate computational performance, and validate out-of-distribution generated impulse responses.

0.46

Effects of HRTF Augmentation on Predicted Spatial Release from Masking in Music

eess.AS ·2026-08-28 ·Jack Webb, Christophe Lesimple, Volker Kuehnel, Lorenzo Picinali
published similarity 0.57
Abstract · Accepted for publication in the Proceedings of Forum Acusticum 2026

Separating individual musical instruments within a complex mixture of sounds poses a persistent challenge for listeners with hearing loss. Although spatial separation of sources improves speech recognition in this population, the potential benefits of spatial cue enhancement for music perception remain largely unexplored. This paper introduces a method to increase spatial cue salience through the augmentation of individual head-related transfer functions (HRTFs). Auditory model analyses indicate that augmented HRTFs may enhance the separability of musical instruments relative to individual HRTFs. Predicted benefits persist when moderate sensorineural hearing loss is modelled, though they are substantially reduced. Simulated hearing aid processing does not restore these benefits to normal-hearing levels.

0.30

Geometry-Conditioned Target Speaker Extraction based on spatial features incorporating acoustic propagation principles

eess.AS ·2026-10-21 ·Jiatong Li, Simon Doclo
similarity 0.57
Abstract

Recently, spatially selective non-linear filter (SSF) was proposed for target speaker extraction, utilizing the direction-of-arrival (DOA) of the target speaker as a spatial cue. To overcome its dependency on a fixed microphone array geometry, geometry-conditioned SSF (GCSSF) was proposed, which maps the target DOA and the microphone positions into abstract high-dimensional embeddings using positional encoding. As an alternative to these high-dimensional embeddings, in this paper we propose utilizing two spatial features incorporating acoustic propagation principles for geometry conditioning: 1) the steering vector of the target speaker, which captures inter-microphone phase differences, and 2) a spatial mask based on GCC-PHAT, which quantifies presence of the target speaker per time-frequency bin. These features are used as input to a geometry-conditioning encoder and integrated via a FiLM layer into the GCSSF system. Experimental results on circular and random arrays demonstrate that conditioning with spatial features improves target extraction performance compared to abstract high-dimensional embeddings, maintaining a clear performance advantage across a wide range of target DOA errors.

0.19

BAmbiDrop: Array-Agnostic Speech Enhancement with Zero-Shot binaural Reproduction using Multi-center Ambisonics Encoding

eess.AS ·2026-11-07 ·Michael Tatarjitzky, Vladimir Tourbabin, Boaz Rafaely
similarity 0.57
Abstract · Submitted for ICASSP 2027

Array-agnostic enhancement networks generalize across microphone geometries but produce a single channel, while binaural enhancement methods preserve interaural cues only for one fixed device geometry. We propose BAmbiDrop, a framework that extends array-agnostic enhancement to binaural reproduction without retraining. Exploiting the fact that the Ambisonics origin is an arbitrary point in space, a frozen single-channel AmbiDrop network estimates a complex mask at multiple centers across the array; these masks are fused by a complex mean into a single shared mask, applied to the microphone signals and rendered by fixed BSM filters. Across 21 free-field and rigid-sphere arrays, the fused mask improves enhancement and interaural cue reproduction simultaneously, whereas masking each microphone independently degrades the latter without a consistent gain in the former.

0.25

Spherical Harmonic Sliced Wasserstein Displacement Interpolation for Acoustic Source and Reflection Density Modeling

cs.SD eess.ASeess.SPmath.OC+1 ·2026-09-18 ·Yuancheng Luo
similarity 0.56
Abstract · Submitted to ICASSP 2027

Spatial room impulse responses (SRIRs) capture directional distributions of acoustic sound-sources and their reflections. However, collecting SRIRs of moving sound-sources remains a challenge, requiring complex interpolations across measurements that account for multi-path spatial-temporal dynamics. This paper investigates the Wasserstein metric and displacement for evaluating interpolated SRIR echo densities in the spherical harmonic domain. We present novel sum-of-magnitude square expansions for efficiently fitting probability density functions, maximizing likelihood, inverse sampling, and computing spherical sliced Wasserstein interpolations. Experiments compare the Wasserstein displacements and metric to linear and geometric interpolations of SRIR image-source densities on a line-path, and demonstrate model-order reduction.

0.33

Multiscale Generalized Sparse Plane Wave Decomposition in the Spherical Harmonic Domain

cs.SD ·2026-10-15 ·Huseyin Hacihabiboglu
publishedunusual similarity 0.56
Abstract · Accepted for publication in IEEE Transactions on Audio, Speech and Language Processing

Sparse plane wave decomposition (SPWD) is a physics-driven model-based approach for analyzing sound fields that is suitable for real-time operation. SPWD is used in different contexts such as direction of arrival (DOA) estimation and sound field separation. SPWD employs spherical Dirichlet kernels to decompose sound fields represented as steered response maps into a finite number of plane waves using sparse recovery techniques. This article proposes a multiscale generalized sparse plane wave decomposition approach that uses an optimal spherical kernel and a multiscale sparse decomposition method to improve recovery performance. The utility of the proposed approach is shown by comparisons with the original SPWD approach via extensive numerical simulations.

0.35