CS Paper Radar

Reproduction of Simulated Acoustics Scenes Using Acoustics Room Transformer for speech intelligibility tests in Clinics

Ali Fallah, Kirsten C Wagener, Pascal Pflueger, Steven van de Par

eess.AS physics.med-ph ·submitted 2026-11-13 12:32 UTC · v1

Abstract

An Acoustic Room Transformation (ART) method is proposed for clinical applications to render simulated acoustic environments using six loudspeakers in a reverberant room. In typical clinical settings, testing rooms are not acoustically treated and only a limited number of loudspeakers are available. The ART approach enables control of the playback-room reverberation, allowing speech intelligibility tests to be performed under realistic and perceptually compensated conditions. The method focuses on the two most common Speech Reception Threshold (SRT) configurations: S0N90 and S0N90. One front and one side loudspeaker reproduce the direct sound components, while the remaining four loudspeakers (two in front and two behind the listener) generate the reverberant sound field. The direct sound is optimized in terms of energy, and the reverberant field is adjusted based on both energy and interaural coherence. An additional direct-sound gain is applied to match the clarity index (C50) of the reproduced signals to that of the reference target. Results from speech intelligibility tests demonstrate that, with ART processing, the reproduced scenarios achieve SRT values very close to those of the reference signal in both S0N0 and S0N90 conditions and therefore allow for comparable speech test results independent of the particular test room acoustics.

Comment
This paper is submitted to Acta Acustica and is currently under review

Closest papers

Nearest neighbours by meaning across the whole index.

Reverberant Speech Conditioning for Material-Aware Acoustic Parameter Mapping

cs.SD ·2026-11-09 ·Yi Wu, Olha Townsend, Qianqian Fang, Magdalena Fuentes, You Zhang
benchmark similarity 0.60
Abstract

Dense maps of room acoustic parameters (T30, EDT, C50, DRR) describe how a room sounds at every position. Scene-wide estimation predicts such maps from a floor plan but requires a reference impulse response, which is hard to obtain. Our system instead receives a floor plan and easily recorded reverberant speech from one talker-microphone pair. We compare four speech-derived conditioning inputs: MFCCs, an embedding from the blind estimator BERP, BERP's scalar reverberation-time estimate, and an impulse response reconstructed by Rec-RIR. Our main benchmark is the MRAS dataset, where material assignments vary at fixed geometry. The reconstructed impulse response performs best among the four inputs, reducing T30 error from 31.5% with the floor plan alone to 19.9%, 83% of the reduction achieved by the reference response. We find that adding speech mainly sets the overall level of the map, with little improvement in predicting how the acoustics vary across the room.

0.16

AcousticAgent: A Floorplan-Centric Simulation Platform for Distributed Multi-Room Speech Processing

eess.AS ·2026-10-16 ·Zhiqi Ai, Han Cheng, Shiyi Mu, Yongjin Zhou, Shugong Xu
dataset similarity 0.59
Abstract

Existing acoustic simulation tools either generate room impulse responses (RIRs) efficiently in parameterized rooms or rely on preconstructed three-dimensional scenes, making it difficult to build large numbers of editable residential multi-room environments. We present AcousticAgent, a floorplan-centric acoustic simulation platform that converts structured floorplans into editable, acoustically connected multi-room scenes. AcousticAgent jointly models room geometry and connectivity, furniture, materials, sound sources, and microphone configurations. A scene-oriented Acoustic Materials Database maps semantic elements to acoustic parameters, while a floorplan-aware hybrid geometrical-acoustics solver generates multichannel RIRs and reverberant audio. The platform also supports directional and moving sources, distributed microphones, and VLM-assisted scene construction from floorplan images and text. Using AcousticAgent, we construct FP-RIR, a dataset covering 15,376 residential floorplans with diverse room topologies, propagation conditions, and source--receiver configurations. We validate its acoustic fidelity against real-world measurements and evaluate whole-home source localization, speech enhancement, and far-field speech processing under single-device and distributed microphone settings. The results demonstrate the effectiveness of floorplan-aware modeling for large-scale residential acoustic simulation and the benefits of distributed spatial processing in multi-room environments. AcousticAgent and FP-RIR provide scalable and configurable resources for developing and evaluating residential speech systems.

0.11

Spatial DJ: Spatial Audio Control for Arbitrary Loudspeaker Layouts

cs.SD cs.HCeess.AS ·2026-10-31 ·Anastasia Geleta, Margarita Geleta
similarity 0.58
Abstract · 20 pages, 6 figures

Object-based spatial audio promises render-anywhere playback, yet deploying it in a new venue still requires two tasks that are rarely addressed together: acquiring the physical loudspeaker geometry and enabling creators manipulate spatial audio while listening through the target loudspeaker system rather than a headphone proxy. We present Spatial DJ, a system for on-site loudspeaker layout acquisition and real-time spatial audio rendering and control, using head-worn AR in a coordinate frame aligned to the physical loudspeakers. In an 18-loudspeaker room, we evaluate calibration accuracy, repeatability, and control latency, and conduct an 18-participant listener study comparing diffuse and orbiting point-source rendering configurations applied to vocal and instrumental layers. Orbiting point-source conditions received higher ratings of perceived immersion, energy, and novelty than the diffuse baseline. Beyond this controlled setting, four representative deployments illustrate reuse of the same system across heterogeneous loudspeaker venues.

0.35

Mask-Based Speech Enhancement for Spatial Audio: A Comparison of Ambisonics, Beamforming, and Microphone Channels

eess.AS ·2026-09-16 ·Sheli Hendel, Boaz Rafaely, Dorothea Kolossa
similarity 0.58
Abstract

Mask-based speech enhancement is widely used for suppressing noise and interference, but its performance in spatial audio algorithms with multichannel output has not been studied extensively. In such settings, speech enhancement must improve speech quality while preserving spatial cues that are essential for localization, spatial awareness, and spatial release from masking. In this work, we systematically compare time frequency masking applied to three signal representations: microphone signals, beamformer outputs, and Ambisonics signals. Performance is evaluated in terms of speech quality, intelligibility, binaural cue preservation, and reverberation preservation. Results reveal a clear trade-off between enhancement and spatial fidelity: beamformer-domain masking achieves the highest speech enhancement scores, while Ambisonics-domain masking better preserves the spatial attributes of the residual interference. All methods preserve the target's localization cues.

0.15

Room Impulse Response Embeddings for Speech Enhancement in Noisy and Reverberant Environments

eess.AS cs.SD ·2026-09-25 ·Adrian Meise, Reinhold Haeb-Umbach
similarity 0.57
Abstract · Submitted to ICASSP 2027

We propose a self-supervised approach for learning room impulse response (RIR) representations from single-channel noisy-reverberant speech. It consists of first training on reverberant data, then on noisy-reverberant data, and finally with a teacher-student approach, where the student learns to replicate the teacher's embeddings when given a noisy version of the reverberant input. We assess their representational capabilities by estimating acoustic room parameters from them. Conditioning a discriminative speech enhancement model on the derived embeddings yields consistent gains across all evaluated metrics, including downstream word error rate, for both reverberant and noisy-reverberant speech.

0.26

The Hearpiece Database of Binaural Room Impulse Responses and Driver Responses on KEMAR

eess.AS ·2026-11-04 ·Tong Xiao, Reinhild Roden, Matthias Blau, Simon Doclo
similarity 0.56
Abstract · 13 pages, 7 figures, 5 tables. Database and MATLAB loading script available at https://doi.org/10.5281/zenodo.23667308

This document describes the measurement setup, signal processing, data organization, and MATLAB file format of a database of acoustic responses measured on a Knowles Electronics Manikin for Acoustic Research (KEMAR) using the Hearpiece, a multi-microphone, multi-driver in-ear research device. The data include binaural room impulse responses (BRIRs) and Hearpiece driver responses, together with center-microphone room impulse responses and a loopback impulse response of the playback and recording system. The BRIRs cover two Hearpiece configurations, three room conditions, three independent insertions per configuration, and 24 horizontal source directions. The database supports reproducible research on binaural and hearing-device signal processing, with potential applications in speech enhancement, spatial filtering and source separation, dereverberation, active noise and occlusion control, and acoustic feedback cancellation. The database, MATLAB loading script, and technical documentation are publicly available at https://doi.org/10.5281/zenodo.23667308.

0.35

FFASR: Benchmarking Far-Field Automatic Speech Recognition using High-Fidelity Simulated RIRs

cs.SD cs.AIcs.PF ·2026-09-30 ·Shivam Saini, Eric Bezzam, Georg Götz, Alessia Milo, Steinar Guðjónsson +3 more
benchmark similarity 0.56
Abstract · 9 Page Technical Report

Far-field automatic speech recognition(ASR) degrades under reverberation, noise, and talker motion, yet the benchmarks that drive model selection emphasize close-microphone speech. We present FFASR, a held-out corpus of 15,637 utterances and an open leaderboard spanning nine conditions, each varying a single acoustic factor: anechoic near-field speech, a measured-versus-simulated office-lab pair, static far-field mixtures at high/mid/low signal-to-noise ratio(SNR), and moving-talker variants at matched SNR. Dry speech from 15 talkers is convolved with hybrid wave/geometrical-acoustics room impulse responses from 14 furnished rooms; because the speech is newly recorded and the test waveforms are never released, the corpus resists training-data contamination. Across contemporary systems, mean word error rate (WER) rises from 4.4% near-field to 41.3% in the static low-SNR condition; a moving talker adds a small but consistent penalty at matched SNR; and on the office-lab pair, measured and simulated WER agree to within about 1.7 pp on average. These results support high-fidelity simulation as a scalable proxy for measured far-field evaluation under the conditions we test.

0.26

Training DeepFilterNet with Accurate Room Acoustic Simulations Improves Single-Channel Speech Enhancement

eess.AS cs.LGphysics.comp-ph ·2026-08-21 ·Alessia Milo, Georg Götz, Steinar Guðjónsson, Daniel Gert Nielsen, Jesper Pedersen +1 more
similarity 0.56
Abstract · 5 pages, 2 figures, IWAENC 2026

We investigate how the realism of synthetic room impulse response (RIR) datasets affects the training of DeepFilterNet3 for single-channel speech enhancement. We compare a DNS4 image-source-method (ISM) RIR dataset with a higher-acoustic-fidelity dataset generated using hybrid wave-based and geometrical acoustics simulation. Rather than isolating individual simulation factors, we compare complete RIR generation pipelines while keeping the enhancement model unchanged. Models are evaluated on unseen measured RIRs using objective speech enhancement metrics and downstream automatic speech recognition (ASR). Training with the higher-fidelity dataset consistently yields modest improvements in objective metrics and substantially lower ASR word error rates than the ISM dataset. Although the experiments do not attribute these gains to individual modelling components, they show that increasing the overall realism of synthetic acoustic training data improves the generalization of DeepFilterNet3 to unseen measured environments.

0.38