CS Paper Radar

A Device to Control and Manipulate Occlusion Effects for Own Voice Perception Studies

Rouben Rehman, Simon Kersten, Aron Schliep, Janina Fels

eess.AS ·submitted 2026-09-11 13:39 UTC · v1

Abstract

The occlusion effect (OE) refers to changes of the eardrum sound pressure through ear canal occlusion. It consists of two phenomena: an insertion loss (IL) attenuating air-conducted sounds, and an occlusion gain (OG) amplifying bone-conduction. Perceptual research on this is hindered by high variability of the OE across individuals, complicating repeatable presentation of precise OE conditions. Consequently, a method to control OE conditions reproducibly during perceptual experiments is needed. For such investigations, the system must enable separate control of IL and OG. We present an approach based on modified commercial earmuffs with integrated microphones. The design integrates dedicated impedance measurements and the derivation of digital filters, which are applied to the microphone signals to emulate arbitrary OE curves. The system is evaluated objectively through appropriate measurements. Results show that the headphones' inherent OG is guaranteed to be below 6dB above 115Hz, falling below 0dB above 155Hz. Emulation is shown to work accurately over the entire frequency range of interest. Limitations arise mainly due to a slight residual inherent OG for deep voices and the processing delay of the system. Future work will focus on the perceptual evaluation of the system and its application in perceptual studies.

Closest papers

Nearest neighbours by meaning across the whole index.

Sensing Bone-Conducted Speech with Earbuds

eess.AS ·2026-09-02 ·Christoph Weyer, Peter Jax
published similarity 0.68
Abstract · 14 pages, 12 figures, journal

Clear capture of the wearer's own voice (OV) is essential when using earbuds for mobile communication. However, OV capture remains challenging in noisy environments. Bone-conducted (BC) speech, which can be sensed as vibrations of the earbud housing, can be used to improve OV capture. However, neither bandwidth nor spatial characteristics of OV-induced earbud vibrations have been analyzed in detail, despite both characteristics being relevant, e.g., for sensor choice and placement. This study investigates both characteristics, based on measurements with two earbud models. Spectrally, results indicate that OV-induced earbud vibrations exhibit a low-pass characteristic, with a steep roll-off of -93 dB per decade above 400 Hz. Thus, sensors with comparatively low noise floors are required to sense the vibrations above \SI{1}{\kilo\hertz}. Spatially, results indicate that the earbuds mainly vibrate in and out of the ear canal entrance, with high consistency between subjects and fits. Simulations confirm that this enables capture of the high-power vibrations below 400 Hz by a single-axis sensor with less than 1.5 dB mean attenuation.

0.39

EarLog: Opportunistic Ear Physiology Sensing toward Personalized Hearing Risk Awareness

eess.AS cs.LGcs.SDeess.SP ·2026-09-30 ·Yongzhi Huang, Jiayi Zhao, Kaishun Wu
top venuebenchmark similarity 0.62
Abstract · 22 pages. Accepted at ACM MobiCom 2026. Includes appendix

Many headphone users risk irreversible hearing damage during high-load listening, yet current protection still relies on sound-pressure limits. Clinical tests detect damage after it becomes measurable, leaving the risk-accumulating process unobserved. The acoustic reflex (AR), an involuntary response to high acoustic load, marks when the ear enters a protective state. AR traces are weak, and existing measurements require dedicated probes and controlled conditions that are difficult to maintain during everyday audio. We present EarLog, which turns playback, the dominant interference, into an opportunistic probe. EarLog introduces content-conditioned residual sensing to suppress variations caused by nonstationary content, individual ear acoustics, and device response. It identifies weak AR through loudness-dependent changes and localized spectral irregularities in the residual. A resonance-constrained sparse finite impulse response (FIR) model captures the short-window response. Dual-microphone observations, mild-distortion recovery, and cross-session reference updates keep detection usable under low signal-to-noise ratio (SNR), fit changes, and environmental drift. EarLog runs in real time on an embedded controller using a low-cost dual-microphone add-on. We evaluate it with 81 participants, 16 headphone models, and more than 400 hours of recordings. EarLog achieves 99.0% sensitivity and 98.7% specificity on a clinically referenced benchmark. EarLog records listener-specific AR events during everyday listening, providing data for future longitudinal studies of hearing risk.

0.45

The Hearpiece Database of Binaural Room Impulse Responses and Driver Responses on KEMAR

eess.AS ·2026-11-04 ·Tong Xiao, Reinhild Roden, Matthias Blau, Simon Doclo
similarity 0.60
Abstract · 13 pages, 7 figures, 5 tables. Database and MATLAB loading script available at https://doi.org/10.5281/zenodo.23667308

This document describes the measurement setup, signal processing, data organization, and MATLAB file format of a database of acoustic responses measured on a Knowles Electronics Manikin for Acoustic Research (KEMAR) using the Hearpiece, a multi-microphone, multi-driver in-ear research device. The data include binaural room impulse responses (BRIRs) and Hearpiece driver responses, together with center-microphone room impulse responses and a loopback impulse response of the playback and recording system. The BRIRs cover two Hearpiece configurations, three room conditions, three independent insertions per configuration, and 24 horizontal source directions. The database supports reproducible research on binaural and hearing-device signal processing, with potential applications in speech enhancement, spatial filtering and source separation, dereverberation, active noise and occlusion control, and acoustic feedback cancellation. The database, MATLAB loading script, and technical documentation are publicly available at https://doi.org/10.5281/zenodo.23667308.

0.35

Active noise cancellation extends the benefit of AI speech enhancement in real hearing-aid recordings

eess.AS ·2026-10-12 ·Andrew T. Sabin, Linkai Li
similarity 0.57
Abstract · 8 pages, 5 figures, 1 table

Active noise cancellation (ANC) is common in headphones but rare in hearing aids, and its value for understanding speech in noise is not established. Algorithms that improve signal-to-noise ratio (SNR) act only on the hearing aid's amplified path, while unprocessed sound also reaches the eardrum directly through the vent, limiting the SNR improvement that is realized. Our earlier simulations predicted that attenuating this direct path with ANC would substantially increase the benefit of such processing. We tested that prediction in three hardware conditions: a standard receiver-in-canal (RIC) hearing aid, and an ANC-capable RIC with ANC off and on. Each was fit to NAL-NL2 targets for an N3 hearing loss and recorded on KEMAR with an AI speech-enhancement algorithm (AI-SE) off and on, in seven realistic scenes above 70 dB SPL. Speech and noise spectra were estimated from each recording with a binary time-frequency mask derived from the clean speech. AI-SE produced a similar peak benefit of about 4 dB in the high frequencies in all three conditions, but that benefit stayed at or above 1 dB only above 1500, 600, and 130 Hz for the standard RIC, ANC RIC (ANC off), and ANC RIC (ANC on), respectively, closely tracking the measured attenuation of the direct path. With AI-SE on, ANC RIC (ANC on) improved SII-weighted SNR by 5.1 dB relative to the open ear, compared with 3.3 dB for ANC RIC (ANC off) and 1.6 dB for the standard RIC. With AI-SE off, enabling ANC added only 0.2 dB. ANC is therefore an enabling technology: on its own it added little, but by attenuating the direct path it allowed SNR-enhancing processing to deliver substantially greater benefit at the eardrum, extending that benefit to much lower frequencies.

0.21

Effects of HRTF Augmentation on Predicted Spatial Release from Masking in Music

eess.AS ·2026-08-28 ·Jack Webb, Christophe Lesimple, Volker Kuehnel, Lorenzo Picinali
published similarity 0.57
Abstract · Accepted for publication in the Proceedings of Forum Acusticum 2026

Separating individual musical instruments within a complex mixture of sounds poses a persistent challenge for listeners with hearing loss. Although spatial separation of sources improves speech recognition in this population, the potential benefits of spatial cue enhancement for music perception remain largely unexplored. This paper introduces a method to increase spatial cue salience through the augmentation of individual head-related transfer functions (HRTFs). Auditory model analyses indicate that augmented HRTFs may enhance the separability of musical instruments relative to individual HRTFs. Predicted benefits persist when moderate sensorineural hearing loss is modelled, though they are substantially reduced. Simulated hearing aid processing does not restore these benefits to normal-hearing levels.

0.30

Speech-muscle coupling at jaw and ear electrodes: a volume-conductor model with orientation and electrode-count controls

cs.HC eess.SP ·2026-08-12 ·Carl Vincent Kho
code/data similarity 0.56
Abstract · Revised title, abstract and text. Reported both derived fibre models; clarified protocol history and current-normalization limits. Added a g…

Objective. We compared how strongly speech-muscle sources couple to electrodes on the jaw and around the ear, and tested sensitivity to source orientation, electrode count, and anatomical detail. Approach. Using reciprocity in MIDA (116 labelled compartments, 500 micrometres), we evaluated 22 electrode positions against ten segmented articulators. Muscle was modelled as both source and conducting tissue. Comparisons used equal electrode counts and a hemisphere orientation sweep, with anatomy-derived fibre models for temporalis and lateral pterygoid. Results. Orbicularis oris, buccinator, mentalis, depressor anguli oris, and platysma favoured the jaw at every sampled orientation and tested electrode subset. Temporalis showed a 2.57 dB ear advantage under the uniform sweep, reduced to 1.15 dB with the derived fibre field. Its jaw-minus-ear interval [-1.45, +5.46] dB crossed zero; 50.5% of four-site ear subsets favoured the ear. The derived lateral-pterygoid interval [-5.33, -1.12] dB favoured the ear at the fixed jaw basis. Both derived constructions have unresolved anatomical limitations. Simplifying non-muscle soft-tissue conductivities preserved montage assignments while changing gaps by up to 3.27 dB. Significance. In this head model, jaw placement better captures lip and chin activity. Ear-side preferences depend on source assumptions and electrode selection. Targeted four-site placement improved lateral-pterygoid coupling by 1.07 dB over the median random ear montage. These coupling predictions require experimental testing.

0.24

AESSI: An Around-Ear Silent Speech Interface for Cross-Day Online Reuse without Test-Day Calibration

cs.HC ·2026-09-18 ·Xiran Xu, Mochu Dong, Yujie Yan, Chenxi Wang, Yu Jiao +1 more
similarity 0.55
Abstract

Silent speech interfaces (SSIs) enable private communication without audible speech and may support people with post-stroke dysarthria. Everyday reuse requires articulation-related representations that generalize across days despite sensor repositioning and physiological changes. We present AESSI, an around-ear SSI using masked-context representation pretraining (MCRP): a student predicts teacher representations from masked time-frequency inputs to encourage robustness to recording variability. We collected 44 electrophysiological recordings from 24 participants for 25 everyday Mandarin sentences. With six participants' complete final recordings held out, AESSI achieved 92.24 percent mean accuracy without test-day calibration. AESSI exceeded the best adapted baseline by 50.57 percentage points. At least 21 days after each participant's last recording, five participants each completed 50 independently randomized online tests without calibration, achieving 98.0 percent overall accuracy. Median preprocessing and inference time in CPU replay was 31.70 ms. These results demonstrate end-to-end system operation and support online reuse without test-day calibration. Demo is included with the paper.

0.30

Audiovisual joint learning for end-to-end hearing aids

eess.AS ·2026-10-06 ·You-Jin Li, Yu Tsao, Borching Su, Kuan-Chung Ting, Fan-Gang Zeng
similarity 0.54
Abstract

Speech understanding in noise remains challenging for hearing-aid users, particularly in the presence of competing speakers. Conventional hearing aids typically perform speech enhancement (SE) and hearing-loss compensation in separate stages, which may cause enhancement errors and signal distortions to carry over to the amplification stage. Moreover, audio-only SE often provides limited benefits under competing-speech conditions because the target and interfering speech share similar acoustic characteristics, making them difficult to separate. To address these limitations, we propose AV-NeuroAMP, an end-to-end audiovisual framework that integrates noisy speech, target-talker video, and the listener's audiogram to jointly perform SE, personalized amplification, and dynamic-range compression. We further introduce audiogram-conditioned feature-wise linear modulation (AC-FiLM) to effectively incorporate listener-specific hearing profiles. Objective evaluations showed that AV-NeuroAMP outperformed conventional amplification, the audio-only NeuroAMP model, and two-stage systems on an in-domain English test set, and that these improvements were retained on an unseen Mandarin test set. Listening tests involving normal-hearing participants under simulated hearing loss and listeners with hearing loss further demonstrated improvements in speech quality and intelligibility, with the greatest benefits observed under competing-speech conditions. These findings support end-to-end audiovisual personalized amplification as a promising approach for improving hearing-aid performance in challenging acoustic environments.

0.14