CS Paper Radar

Model-Guided Design of Low-Context Speech Probes for Cochlear Synaptopathy

Ahsan J. Cheema, David Meng, Jorge Mejia, Sanna Hou, Sunil Puria

eess.AS ·submitted 2026-09-28 21:02 UTC · v1

Abstract

Cochlear neural degeneration (CND) can impair suprathreshold coding without elevating pure-tone thresholds, complicating its diagnosis when it coexists with hair cell loss. We present a unified comparison of temporal and noise-based probes for CND detection using low-context vowel-consonant-vowel (VCV) syllables to reduce linguistic and contextual cues. Using a phenomenological auditory nerve model, we simulated responses to 21 VCV tokens under time compression, reverberation, and speech-in-noise conditions across presentation levels and seven CND profiles. We computed mutual information (MI) between inner hair cell potentials and auditory nerve neurograms and quantified information loss relative to a normal-hearing baseline. Time compression and amplitude-modulated (AM) noise produced the largest modeled information losses. We then evaluated these stimuli in a consonant-identification study involving 36 listeners with normal audiograms, 12 of whom reported difficulty understanding speech in noise. Neither 40 percent time compression in quiet nor AM noise alone distinguished listeners with and without these difficulties. However, compressed speech presented in AM noise separated the two groups. This partial agreement between model predictions and behavior supports our MI-based stimulus design framework and motivates further evaluation of combined temporal and noise-based probes for CND detection.

Closest papers

Nearest neighbours by meaning across the whole index.

Quantifying Consonant Contributions to Word Intelligibility via Acoustic Masking

cs.CL ·2026-09-10 ·Eunjung Yeo, Kwanghee Choi, Krupaben Kothadia, Visar Berisha, Julie M. Liss +2 more
published similarity 0.60
Abstract · 7 pages, 5 figures, Accepted to SLT 2026

Consonants contribute unequally to whether a word is understood. Given the limited time available for therapy, ranking consonants by contribution to intelligibility helps prioritize intervention targets in motor speech disorders. However, measuring this contribution relies on perceptual studies that are difficult to scale. This paper presents a scalable method that measures consonant contribution using acoustic masking. We silence one consonant at a time in an isolated word and test whether an automatic speech recognition (ASR) model still recognizes the word. We define a consonant's contribution score as the proportion of its masked instances for which the word becomes misrecognized, which we refer to as the mask-induced misrecognition rate (MMR). We relate MMR to two linguistic factors previously reported to correlate with consonant contribution, namely phoneme frequency and functional load. We apply this analysis across four languages, English, Spanish, German, and Czech, using three ASR architectures, MMS (encoder-only), Whisper (encoder-decoder), and Qwen3-ASR (LLM-based). Using partial Spearman correlations, we find that phoneme frequency correlates negatively with MMR while functional load correlates positively. In other words, more frequent consonants are less disruptive when masked, whereas consonants carrying more lexical contrast are more disruptive. Further cross-language analysis shows that consonant rankings agree only partially across languages, indicating that consonant contribution is language-dependent.

0.47

Audiovisual joint learning for end-to-end hearing aids

eess.AS ·2026-10-06 ·You-Jin Li, Yu Tsao, Borching Su, Kuan-Chung Ting, Fan-Gang Zeng
similarity 0.60
Abstract

Speech understanding in noise remains challenging for hearing-aid users, particularly in the presence of competing speakers. Conventional hearing aids typically perform speech enhancement (SE) and hearing-loss compensation in separate stages, which may cause enhancement errors and signal distortions to carry over to the amplification stage. Moreover, audio-only SE often provides limited benefits under competing-speech conditions because the target and interfering speech share similar acoustic characteristics, making them difficult to separate. To address these limitations, we propose AV-NeuroAMP, an end-to-end audiovisual framework that integrates noisy speech, target-talker video, and the listener's audiogram to jointly perform SE, personalized amplification, and dynamic-range compression. We further introduce audiogram-conditioned feature-wise linear modulation (AC-FiLM) to effectively incorporate listener-specific hearing profiles. Objective evaluations showed that AV-NeuroAMP outperformed conventional amplification, the audio-only NeuroAMP model, and two-stage systems on an in-domain English test set, and that these improvements were retained on an unseen Mandarin test set. Listening tests involving normal-hearing participants under simulated hearing loss and listeners with hearing loss further demonstrated improvements in speech quality and intelligibility, with the greatest benefits observed under competing-speech conditions. These findings support end-to-end audiovisual personalized amplification as a promising approach for improving hearing-aid performance in challenging acoustic environments.

0.14

A Deep Neural Network for Predicting Continuous Human EEG Across the Auditory Pathway in Response to Sound

eess.AS eess.SPq-bio.NC ·2026-09-17 ·Thomas J Stoll, Ross K Maddox
similarity 0.59
Abstract · 5 pages. Submitted to ICASSP 2027. v2: Update funding acknowledgment

Computational models of auditory physiology commonly target specific responses or stages of the auditory pathway, limiting their ability to integrate findings across experimental paradigms and neural timescales. We present a foundation model of human auditory electrophysiology: a causal neural network trained to map binaural acoustic waveforms directly to high-sample-rate EEG. The model was trained on approximately 250 hours of EEG data from 92 subjects, with varied electrode montages and stimuli spanning tonebursts, speech, and music. We tested whether the model recovered effects of stimulus rate, frequency, and presentation method on auditory brainstem responses (ABRs); subcortical and cortical temporal response functions (TRFs) to continuous speech; and the click-evoked binaural interaction component (BIC). Predicted ABRs and TRFs reproduced established response morphology and stimulus-dependent effects, with model-grand-average correlations falling within the corresponding subject-level human distributions. The model-predicted BIC metrics closely resembled the values reported in the literature. These findings demonstrate that a single audio-to-EEG model can capture auditory physiology across paradigms and timescales, supporting future in silico experimentation and hearing technology applications.

0.38

Subjective Evaluation of DNN AND Auditory-Model-Based Hearing-Loss Compensation

eess.AS ·2026-09-23 ·Chuan Wen, Brent Nissens, Nele De Poortere, Morgan Thienpont, Matthias Inghels +3 more
similarity 0.59
Abstract

Outer-hair-cell (OHC) loss is a primary deficit of sensorineural hearing loss (SNHL), impairing cochlear amplification and frequency selectivity and thereby elevating hearing thresholds. Biophysically-inspired DNN-based hearing-aid (HA) algorithms have been proposed to compensate for OHC deficits and have shown clear benefits in objective speech intelligibility and quality metrics (e.g. HASPI, HASQI). However, comprehensive subjective validation of these benefits in human listeners is still missing. In this work, we present a subjective evaluation of a biophysically-inspired HA model targeting OHC deficits. The cochlear module of an auditory model was individualized based on each listener's pure-tone audiogram and integrated into a trainable system, which includes the personalized model and a normal-hearing reference model, and the resulting trained HA was evaluated using a Matrix test comparing intelligibility scores for unprocessed and HA-processed noisy speech. The results revealed a significant benefit of the HA model over the unprocessed condition in the range of +1 to +27%, providing behavioral confirmation of the efficacy of the HA model. This study closes the gap between objective and perceptual evidence for this new generation of DNN-based HA algorithms, paving the way for their integration into next-generation DNN-accelerated chips for hearables and hearing aids.

0.30

Improving Spectral Resolution via Simultaneous Extracochlear and Apical Ground Contacts: A Neural Simulation Study

eess.SP ·2026-10-30 ·Jared A. Rybarczyk, Erin L. Bratu, Robert F. Labadie, Jack H. Noble
similarity 0.59
Abstract

Objectives: While cochlear implants (CI) can provide excellent speech perception outcomes, speech recognition in noise remains a consistent problem for many patients due to channel interaction. Recent work shows the clinical feasibility of an apical return contact placed in the cochlear helicotrema, which presents new possibilities in terms of experimental stimulation schemes. This study explores the interactions between apical and extracochlear ground contacts, aiming to characterize the effects of dual ground usage on auditory nerve fiber (ANF) dynamics and determine their utility in improving spectral resolution. Design: 6 patients with CIs were used in this retrospective study. Volume conduction models encompassing patient specific electro-anatomical characteristics and ANF compartment models defining neural dynamics were used to generate activation thresholds for 75 evenly spaced fiber bundles throughout each modeled cochlea and for 4 different grounding configurations, including the use of combined grounds. We compare our intra-patient models in terms of threshold shifts and standard deviation of fiber proportions to determine the effects of ground configuration used on channel interaction. Results: For all 6 patients, we observe shifts in ANF activation thresholds for the combined ground models indicative of more specific fiber stimulation per contact. Additionally, our combined ground models exhibit reduced fiber proportion standard deviation for several contacts of the stimulating array when compared to the standard extracochlear ground configuration or apical ground configuration. Conclusions: The shifts in activation thresholds and reduction in standard deviations suggest that stimulation schemes utilizing extracochlear and apical grounds in conjunction can provide reduced channel interaction and enhanced spectral resolution for certain contacts in an array.

0.32

Low-Power End-to-End Cochlear Implant Speech Denoising with Spiking Neural Networks

cs.SD cs.NEeess.AS ·2026-08-28 ·Ludovic Boulanger, Sean U. N. Wood
published similarity 0.58
Abstract

Cochlear implants (CI) restore hearing for individuals with severe to profound hearing loss. However, CI users often struggle to understand speech in noisy environments. Deep neural networks (DNN) have shown promise in enhancing speech for CI users, yet their high energy demands make them non-ideal for low-power CI processors. Spiking neural networks (SNN), on the other hand, offer comparable performance with significantly lower energy consumption. Hence, we propose a novel SNN inspired by the Deep ACE architecture that simultaneously performs speech enhancement and CI coding. Our model achieves competitive vocoded short-time objective intelligibility (VSTOI) and signal-to-noise ratio improvement (SNRi) scores compared to Deep ACE, while achieving more than a sixfold reduction in energy consumption.

0.24

CochlearMark: Audio Watermarking via Phase Locked Auditory Nerve Representations

eess.AS ·2026-10-14 ·Qin Liu, Strahinja Nikolic, Milos Cernak
similarity 0.58
Abstract · 5 pages, 2 figures, and 2 tables

Modern audio watermarks achieve strong robustness with learned encoder-decoder models, but their behavior under new processing is established empirically. CochlearMark is introduced as a training-free audio watermark that uses auditory-nerve phase-locking as its feature representation. A small waveform perturbation is optimized against a keyed random projection of this representation, and the same projection is used for detection, with no trained encoder or decoder. Because phase-locking represents temporal fine structure, the resulting robustness has a direct physiological interpretation: the mark is retained when this structure is preserved and lost when it is disrupted or rebuilt. Across speech, music, and environmental audio, CochlearMark achieves signal-edit robustness and imperceptibility comparable to trained neural baselines while requiring only a lightweight computational footprint. Among the evaluated training-free methods, CochlearMark is the only one to retain substantial detectability under neural-codec re-encoding.

0.13

How large an effect would we have seen? Positive controls, detection floors and dataset pitfalls in scalp-EEG speech decoding

eess.SP q-bio.NCq-bio.QM ·2026-10-14 ·Blessing Isoyiza Adeika, Onyema Osuagwu
similarity 0.57
Abstract · 22 pages, 4 figures, 8 tables plus supplementary tables. To be submitted to Journal of Neural Engineering

Objective. Studies that decode imagined speech from scalp electroencephalography (EEG) commonly validate their pipelines with a positive control, usually overt speech, and report null results without stating what effect size the pipeline could have detected. Approach. Using ds003626 ("Thinking out loud"), KaraOne and Track 3 of the 2020 International Brain-Computer Interface Competition, we audited decoding of overt speech, articulator preparation and imagined speech with artifact-channel subsets, band-limited decoding and trial selection, under a protocol that enforces split integrity by assertion. We injected class-dependent effects of known amplitude into the real recordings to measure the detection floor of five decoder families, and we checked the ds003626 labels against the dataset's acquisition protocol. Main results. On ds003626, two lip electrodes decoded overt speech at 0.7430 and the eight external channels at 0.7068, against 0.4231 for the 128-channel scalp montage, and no decodable signal survived in the 8-30 Hz band. On the other two corpora, within-subject accuracy rose monotonically with frequency into the range dominated by muscle activity. Band-power logistic regression detected an injected 8-30 Hz desynchronization of 0.54 uV under a criterion fixed in advance, whereas a compact convolutional network (EEGNet) detected nothing within subject up to 4.31 uV. In ds003626, the condition codes are the reverse of the intuitive reading, the class encoding changed between public releases, and condition is a deterministic function of time within each session. Significance. In these corpora the overt-speech positive control is dominated by myogenic signal and cannot validate a decoding pipeline. We recommend that speech-decoding studies report band-limited and artifact-channel accuracy, the direction of accuracy across frequency, and a measured detection floor.

0.39