CS Paper Radar

EarLog: Opportunistic Ear Physiology Sensing toward Personalized Hearing Risk Awareness

Yongzhi Huang, Jiayi Zhao, Kaishun Wu

eess.AS cs.LGcs.SDeess.SP ·submitted 2026-09-30 05:34 UTC · v1
top venuebenchmark

Abstract

Many headphone users risk irreversible hearing damage during high-load listening, yet current protection still relies on sound-pressure limits. Clinical tests detect damage after it becomes measurable, leaving the risk-accumulating process unobserved. The acoustic reflex (AR), an involuntary response to high acoustic load, marks when the ear enters a protective state. AR traces are weak, and existing measurements require dedicated probes and controlled conditions that are difficult to maintain during everyday audio. We present EarLog, which turns playback, the dominant interference, into an opportunistic probe. EarLog introduces content-conditioned residual sensing to suppress variations caused by nonstationary content, individual ear acoustics, and device response. It identifies weak AR through loudness-dependent changes and localized spectral irregularities in the residual. A resonance-constrained sparse finite impulse response (FIR) model captures the short-window response. Dual-microphone observations, mild-distortion recovery, and cross-session reference updates keep detection usable under low signal-to-noise ratio (SNR), fit changes, and environmental drift. EarLog runs in real time on an embedded controller using a low-cost dual-microphone add-on. We evaluate it with 81 participants, 16 headphone models, and more than 400 hours of recordings. EarLog achieves 99.0% sensitivity and 98.7% specificity on a clinically referenced benchmark. EarLog records listener-specific AR events during everyday listening, providing data for future longitudinal studies of hearing risk.

Comment
22 pages. Accepted at ACM MobiCom 2026. Includes appendix
DOI
10.1145/3795866.3844456

Closest papers

Nearest neighbours by meaning across the whole index.

A Device to Control and Manipulate Occlusion Effects for Own Voice Perception Studies

eess.AS ·2026-09-11 ·Rouben Rehman, Simon Kersten, Aron Schliep, Janina Fels
similarity 0.62
Abstract

The occlusion effect (OE) refers to changes of the eardrum sound pressure through ear canal occlusion. It consists of two phenomena: an insertion loss (IL) attenuating air-conducted sounds, and an occlusion gain (OG) amplifying bone-conduction. Perceptual research on this is hindered by high variability of the OE across individuals, complicating repeatable presentation of precise OE conditions. Consequently, a method to control OE conditions reproducibly during perceptual experiments is needed. For such investigations, the system must enable separate control of IL and OG. We present an approach based on modified commercial earmuffs with integrated microphones. The design integrates dedicated impedance measurements and the derivation of digital filters, which are applied to the microphone signals to emulate arbitrary OE curves. The system is evaluated objectively through appropriate measurements. Results show that the headphones' inherent OG is guaranteed to be below 6dB above 115Hz, falling below 0dB above 155Hz. Emulation is shown to work accurately over the entire frequency range of interest. Limitations arise mainly due to a slight residual inherent OG for deep voices and the processing delay of the system. Future work will focus on the perceptual evaluation of the system and its application in perceptual studies.

0.20

Active noise cancellation extends the benefit of AI speech enhancement in real hearing-aid recordings

eess.AS ·2026-10-12 ·Andrew T. Sabin, Linkai Li
similarity 0.61
Abstract · 8 pages, 5 figures, 1 table

Active noise cancellation (ANC) is common in headphones but rare in hearing aids, and its value for understanding speech in noise is not established. Algorithms that improve signal-to-noise ratio (SNR) act only on the hearing aid's amplified path, while unprocessed sound also reaches the eardrum directly through the vent, limiting the SNR improvement that is realized. Our earlier simulations predicted that attenuating this direct path with ANC would substantially increase the benefit of such processing. We tested that prediction in three hardware conditions: a standard receiver-in-canal (RIC) hearing aid, and an ANC-capable RIC with ANC off and on. Each was fit to NAL-NL2 targets for an N3 hearing loss and recorded on KEMAR with an AI speech-enhancement algorithm (AI-SE) off and on, in seven realistic scenes above 70 dB SPL. Speech and noise spectra were estimated from each recording with a binary time-frequency mask derived from the clean speech. AI-SE produced a similar peak benefit of about 4 dB in the high frequencies in all three conditions, but that benefit stayed at or above 1 dB only above 1500, 600, and 130 Hz for the standard RIC, ANC RIC (ANC off), and ANC RIC (ANC on), respectively, closely tracking the measured attenuation of the direct path. With AI-SE on, ANC RIC (ANC on) improved SII-weighted SNR by 5.1 dB relative to the open ear, compared with 3.3 dB for ANC RIC (ANC off) and 1.6 dB for the standard RIC. With AI-SE off, enabling ANC added only 0.2 dB. ANC is therefore an enabling technology: on its own it added little, but by attenuating the direct path it allowed SNR-enhancing processing to deliver substantially greater benefit at the eardrum, extending that benefit to much lower frequencies.

0.21

Sensing Bone-Conducted Speech with Earbuds

eess.AS ·2026-09-02 ·Christoph Weyer, Peter Jax
published similarity 0.58
Abstract · 14 pages, 12 figures, journal

Clear capture of the wearer's own voice (OV) is essential when using earbuds for mobile communication. However, OV capture remains challenging in noisy environments. Bone-conducted (BC) speech, which can be sensed as vibrations of the earbud housing, can be used to improve OV capture. However, neither bandwidth nor spatial characteristics of OV-induced earbud vibrations have been analyzed in detail, despite both characteristics being relevant, e.g., for sensor choice and placement. This study investigates both characteristics, based on measurements with two earbud models. Spectrally, results indicate that OV-induced earbud vibrations exhibit a low-pass characteristic, with a steep roll-off of -93 dB per decade above 400 Hz. Thus, sensors with comparatively low noise floors are required to sense the vibrations above \SI{1}{\kilo\hertz}. Spatially, results indicate that the earbuds mainly vibrate in and out of the ear canal entrance, with high consistency between subjects and fits. Simulations confirm that this enables capture of the high-power vibrations below 400 Hz by a single-axis sensor with less than 1.5 dB mean attenuation.

0.39

Audiovisual joint learning for end-to-end hearing aids

eess.AS ·2026-10-06 ·You-Jin Li, Yu Tsao, Borching Su, Kuan-Chung Ting, Fan-Gang Zeng
similarity 0.58
Abstract

Speech understanding in noise remains challenging for hearing-aid users, particularly in the presence of competing speakers. Conventional hearing aids typically perform speech enhancement (SE) and hearing-loss compensation in separate stages, which may cause enhancement errors and signal distortions to carry over to the amplification stage. Moreover, audio-only SE often provides limited benefits under competing-speech conditions because the target and interfering speech share similar acoustic characteristics, making them difficult to separate. To address these limitations, we propose AV-NeuroAMP, an end-to-end audiovisual framework that integrates noisy speech, target-talker video, and the listener's audiogram to jointly perform SE, personalized amplification, and dynamic-range compression. We further introduce audiogram-conditioned feature-wise linear modulation (AC-FiLM) to effectively incorporate listener-specific hearing profiles. Objective evaluations showed that AV-NeuroAMP outperformed conventional amplification, the audio-only NeuroAMP model, and two-stage systems on an in-domain English test set, and that these improvements were retained on an unseen Mandarin test set. Listening tests involving normal-hearing participants under simulated hearing loss and listeners with hearing loss further demonstrated improvements in speech quality and intelligibility, with the greatest benefits observed under competing-speech conditions. These findings support end-to-end audiovisual personalized amplification as a promising approach for improving hearing-aid performance in challenging acoustic environments.

0.14

Frequency-Weighted Soft-Constrained Spatially Selective Active Noise Control for Open-Fitting Hearables

eess.AS eess.SP ·2026-09-30 ·Tong Xiao, Reinhild Roden, Matthias Blau, Simon Doclo
similarity 0.58
Abstract · 5 pages, 4 figures, 1 table. Submitted to IEEE ICASSP 2027

Recently, soft-constrained spatially selective active noise control (SSANC) for open-fitting hearables has been proposed to enable a flexible trade-off between noise reduction and desired-speech preservation using a scalar trade-off parameter across all frequencies. This paper generalizes soft-constrained SSANC by introducing frequency-dependent weighting of the desired-speech preservation error while maintaining low-delay time-domain active control. Frequency-dependent weightings based on the speech intelligibility index (SII), the modified intermediate reference system (MIRS), the long-term average speech spectrum (LTASS), and a signal-dependent oracle are compared with scalar weighting using measured acoustic impulse responses in a multi-speaker scenario. The results show that LTASS and oracle weightings provide the largest speech-intelligibility improvements and comparable speech-quality improvements at substantially lower distortion levels than those obtained with SII and MIRS weightings. While the oracle weighting provides the best overall perceptual trade-off, LTASS weighting provides a comparable perceptual trade-off without requiring the clean desired-speech signal.

0.23

When Temporal Perturbations Act Like Sensor Biases: Label-Free Auditing of Wearable Activity Recognizers

cs.LG cs.AIcs.CR ·2026-09-24 ·Qingyu Wu, Yuan Wei, Renju Liu, Hua Cheng
similarity 0.58
Abstract

Wearable human-activity recognition (HAR) models operate across sensors, subjects, and backbones, yet a smooth waveform may appear temporal while exploiting a persistent sensor offset primarily. We introduce SpectrumAudit, a label-sealed audit that fits a phase-randomized full-window stimulus on calibration windows from subjects held out from training and testing. After selection, it replays its exact DC projection and budget-constrained zero-mean residual on the same frozen victim without refitting. Across 27 victims from three datasets and three backbones, the selected waveforms cause 2.87-40.83-point three-phase robust accuracy losses. Under this replay budget, DC is more damaging than AC on 24/27 victims and recovers at least 90% of the full drop on 22/27; all 5 failures occur on WISDM. In a held-out UTD-MHAD check, the selected waveform causes 13.49-pp accuracy and 11.68-pp macro-F1 losses, versus -0.66 pp for matched random changes. The audit diagnoses offset versus zero-mean variation under a common peak-budget cap. The code will be released upon acceptance.

0.34

Machine Hearing: Can Audio LLMs Generalize Beyond Human Auditory Perception?

cs.SD cs.CL ·2026-11-07 ·Liwei Liu, Jun Tao, Xingyuan Li, Xuenan Xu, Chen Zhang +6 more
benchmarkcode/data similarity 0.57
Abstract · 22 pages, 7 figures, 5 tables

Multimodal LLMs have made remarkable progress in perceiving the physical world, while their perceptual scope remains largely human-centric, focusing on what humans can directly see or hear. This progress raises the prospect of perception beyond human limits, such as extending hearing to sounds that are inaudible to humans. More broadly, the physical world is full of waves, vibrations, and oscillations, only a small fraction of which are directly audible to humans. This invites the extension of multimodal LLMs toward a broader form of machine hearing, which remains largely underexplored. To investigate this direction, we introduce the Machine Hearing Benchmark (MHB), comprising 6,128 instances across 13 tasks and seven domains. MHB spans highly heterogeneous input regimes, with sampling rates from approximately $10^{-5}$ to $10^6$ Hz, sequence lengths from $10^1$ to $10^6$ samples, and both single- and multi-channel inputs. Evaluations of current open-source and proprietary Audio LLMs (ALLMs) reveal limited zero-shot transfer to machine hearing. Supervised adaptation on machine-hearing data alone does not close this gap, suggesting that the challenge extends beyond data exposure to a systematic mismatch between existing audio front ends and machine-hearing inputs. To address this mismatch, we introduce MachEar, a lightweight encoder extension that complements the pretrained Audio LLM for machine-hearing inputs. The results show that MachEar equips a pretrained Audio LLM with stronger machine-hearing capabilities while largely preserving its existing audio understanding performance.

0.32

Real-Validated UAV Audition Under Rotor Ego-Noise for Low-False-Alarm Human Detection

cs.CE ·2026-09-19 ·Junhao Wei, Haochen Li, Dexing Yao, Yanxiao Li, Yifu Zhao +5 more
benchmark similarity 0.56
Abstract

Detecting human acoustic cues from UAV-mounted microphones could support acoustic search and rescue, but rotor ego-noise often masks speech, cries, coughs, and other human sounds at extremely low SNRs. We study UAV human-audible-presence detection under this real operating constraint. Models are trained on a reproducible synthetic mixture pipeline built from public audio, but selected and evaluated on real DroneAudioSet recordings using a metadata-defined audibility filter, recording-grouped Dev/Test splits, and group-bootstrap confidence intervals. Our results show that synthetic accuracy is a weak and non-monotonic proxy for real UAV transfer: a from-scratch SE-ResNet appears competitive on synthetic mixtures but collapses on real ego-noise, while frozen audio foundation models and lightweight adapters transfer more reliably. We further evaluate a BEATs adapter family with rotor-aware conditioning and domain regularization. The Real-Dev-selected EgoRAP-DA configuration achieves the best locked-test low-false-alarm recall among the candidates, but its advantage over a vanilla adapter is not statistically significant under paired group bootstrap. The main contribution is therefore a real-validated benchmark and evaluation protocol showing that honest progress in UAV audition requires real, group-level validation rather than synthetic scores alone.

0.11