CS Paper Radar

Estimates of neural health using cochlear implant digital twins correlate with speech recognition

Erin L. Bratu, Andrea J. DeFreese, Katelyn A. Berg, Margaret Wilson, Aaron C. Moberly, Robert F. Labadie, Jack H. Noble

eess.SP ·submitted 2026-09-29 22:47 UTC · v1

Abstract

The cochlear implant is a neural prosthetic that uses an array of electrodes to directly stimulate auditory nerve fibers with electrical impulses. One factor that is known to impact outcomes is the quality of the electro-neural interface. In this work, we propose a pipeline that permits creating accurate and patient-specific digital twins that model the cochlear implant electro-neural interface. We leverage medical images and electrophysiological measurements from the patient's device for digital twin construction. We validate our digital twins by comparing predictions of neural response measurements to clinical measurements and speech recognition outcomes. Neural health estimated by the digital twin correlates strongly with word recognition rates (R=0.75, p<1e-5) in an analysis of 29 cases and sentence in noise recognition rates (R=0.78, p<1e-4) in an analysis of 21 cases. We also report preliminary findings with digital twin-based patient remapping with 6 subjects, where word recognition rates improved on average by 10 percentage points. These digital twins have the potential to provide clinicians with an unprecedented window into the electro-neural interface for individual cochlear implant recipients, which could lead to improved hearing outcomes when used as a foundation for program customization.

Closest papers

Nearest neighbours by meaning across the whole index.

When Can LLM Digital Twins Reduce Human Measurement? From Behavioral Fidelity to Statistical Substitutability

cs.AI stat.AP ·2026-09-07 ·Steven Wang, Kyle Hunt, Shaojie Tang, Kenneth Joseph
similarity 0.57
Abstract

LLM-based digital twins promise to reduce repeated human data collection by generating person- specific responses, yet existing evaluations provide little evidence about whether they can reduce human measurement while preserving valid inference. To address this, we introduce statistical substitutability, an inferential criterion that evaluates the extent to which twin predictions can reduce human measurement for a particular estimand while preserving valid inference. We develop a framework, grounded in mixed-subject and prediction-powered inference, that evaluates statistical substitutability along four dimensions: aggregate fidelity, paired respondent-level signal, finite-sample human-label recovery, and stability across populations. Across two empirical evaluations spanning behavioral experiments, multiple models, and alternative respondent representations, we find that digital twins can reproduce average human effects while providing little information about which individuals differ from those averages. Newer models and richer respondent information improve some dimensions of performance but do not reliably translate into human-data savings. Human calibration can reduce aggregate prediction error, yet limited labeled samples often fail to produce stable precision gains. Importantly, these findings demonstrate that behavioral fidelity is neither necessary nor sufficient for statistical substitutability. More broadly, they suggest that AI-generated evidence should be evaluated based on its ability to support valid scientific inference rather than its ability to reproduce human outcomes alone. Digital twins should therefore be judged for confirmatory use by whether they reduce uncertainty about human quantities, not merely by whether they reproduce human means, distributions, or effects.

0.61

Towards a faithful stochastic model for brain digital twins

cs.SE ·2026-09-12 ·Abdelhamid Rouatbi, Alexandre Muzy, Eugene Syriani
similarity 0.57
Abstract

Twinning the brain means reproducing its electrical activity with fidelity. This activity arises from many neuronal mechanisms across several scales, from a single neuron to whole brain regions. Current large initiatives rely on models that each capture only a few of these mechanisms. Some act at the scale of a single neuron, others at the scale of neuronal populations. No single model captures both scales with fidelity. We propose a new stochastic model, based on a combination of Random Neural Networks and Markov-Modulated Poisson Processes, that would improve the fidelity of a brain digital twin. We map the model to the Discrete Event System Specification. This yields an initial executable simulation model suitable for incorporation into a brain digital twin.

0.28

BioSync: Transformer-Based Cross-Modal Fusion for a Multimodal Physiological Digital Biomarker

cs.AI cs.IR ·2026-09-03 ·Seyed Mahmoud Sajjadi Mohammadabadi
benchmark similarity 0.55
Abstract

Cardiac, neural, behavioral, and speech measurements from wearable and mobile devices provide partial, noise-sensitive views of physiological state. BioSync combines these measurements into the \textbf{BioSync Index (BSI)}, a continuous composite digital biomarker defined under the BEST framework. The model applies multi-head self-attention to modality tokens and adds a linear branch whose hypothesis class includes standard feature concatenation. This architecture is motivated by latent-variable measurement theory and by the possibility that joint observations contain information unavailable from individual modalities. We evaluated BioSync on two literature-informed synthetic cohorts: a four-modality cognitive-decline cohort using HRV, EEG, actigraphy, and speech, and a metabolic-autonomic cohort structured around the public AI-READI wearable schema. In the cognitive cohort, BioSync and concatenation obtained AUCs of 0.928 and 0.926, respectively. In the metabolic cohort, BioSync obtained accuracy/F1 of 0.764/0.766, compared with 0.756/0.758 for concatenation. The BSI correlated with latent severity in both cohorts ($r=0.91$ and $r=0.68$). A pure-attention ablation obtained cognitive-cohort AUC 0.911, locating the increase to 0.928 in the combined wide-and-deep architecture. With matched modality-dropout training, BioSync led concatenation at five of six cognitive-cohort corruption rates and at the highest metabolic-cohort rate. Its cognitive-cohort AUC was also higher than five published digital-biomarker reference values, although differences in datasets and tasks preclude a controlled benchmark claim. Comparison with single-modality, early-fusion, and late-fusion designs across six prespecified criteria identifies the model's computational properties; validation on real cohorts remains necessary.

0.17

NeuronSifter: An Agent-in-Twin for Prioritizing Central Nervous System Interventions with World Action Models

cs.LG q-bio.NC ·2026-09-28 ·Haowei Xu, Wanyi Fu, Hongbin Han, Zhaoheng Xie
code/data similarity 0.52
Abstract · The submission was made without obtaining authorization from all co-authors

Effective central nervous system (CNS) intervention requires more than predicting biological responses: a scientific system must determine which intervention, observation, or additional evidence can improve a decision under uncertainty. However, in partially observed neuronal microenvironments, identical predicted outcomes may correspond to different exposure states, biological mechanisms, and intervention risks. We propose NeuronSifter, a decision-centric Agent-in-Twin framework, where an AI agent operates with an evolving biological digital twin rather than a fixed predictive model. NeuronSifter compiles interventions into state-conditional target-occupancy representations, propagates them through a mechanism-grounded World Action Model (WAM), and selects informative measurements based on their expected reduction in decision uncertainty. A shared probabilistic belief state couples intervention simulation, observation selection, and outcome assimilation, enabling the digital twin to continuously refine its decision-relevant representations through externally verified evidence. We evaluate NeuronSifter in Alzheimer's disease intervention scenarios using mechanistic neuronal microenvironment simulations and retrospective clinical endpoint references. The evaluation framework examines adaptive evidence acquisition, uncertainty-aware intervention planning, and robustness under model discrepancy through controlled environments and independent comparisons. NeuronSifter demonstrates how an AI system can actively identify missing evidence, refine biological hypotheses, and optimize intervention decisions under limited experimental budgets. Code is available at https://anonymous.4open.science/r/NeuronSifter.

0.35

Single-visit screening for intracochlear tissue growth validated against multi-visit electrical measurement changes

eess.SP ·2026-11-02 ·Minh Q. Vu, Erin L. Bratu, Jared A. Rybarczyk, Jack H. Noble
similarity 0.52
Abstract

Purpose: Tissue growth (TG) around cochlear implant electrodes raises impedance but is not reliably visible on CT scans. Routinely recorded stimulus current-induced non-stimulating electrode voltages (SCINSEVs) carry this information, but a single recording has no patient-specific reference. We present an algorithm for detecting signs of significant TG from a single SCINSEV measurement. Methods: TG is assumed to concentrate basally near the electrode insertion site, leaving the apical region mostly unaffected. A patient-specific forward model built from CT is fitted to the apical measurements and predicts the basal ones. The misfit score, T, measures each basal contact's signed relative misfit against the apical misfit, accounting for apical fit quality and measurement noise. An ear is flagged when two adjacent basal contacts cross a predetermined threshold. We compare T with T-delta, a model-free reference, tracking basal relative to apical SCINSEV change since the intra-operative recording, persisting over the last two visits. Results: T had a false-positive rate of 3% on growth-free ears. It agreed with T-delta in 81% of 68 ears (sensitivity 71%; specificity 86%; p = 6e-6). Over 200 patient-level two-fold splits, median held-out agreement was 78% at a false-positive rate of 5.1%. Conclusion: An apically fitted patient-specific model predicts basal SCINSEVs well enough to flag signs of significant TG at a single visit, without an intra-operative baseline. Detections largely agree with persistent multi-visit basal-versus-apical change, a surrogate ground truth for significant TG.

0.43

Improving Spectral Resolution via Simultaneous Extracochlear and Apical Ground Contacts: A Neural Simulation Study

eess.SP ·2026-10-30 ·Jared A. Rybarczyk, Erin L. Bratu, Robert F. Labadie, Jack H. Noble
similarity 0.52
Abstract

Objectives: While cochlear implants (CI) can provide excellent speech perception outcomes, speech recognition in noise remains a consistent problem for many patients due to channel interaction. Recent work shows the clinical feasibility of an apical return contact placed in the cochlear helicotrema, which presents new possibilities in terms of experimental stimulation schemes. This study explores the interactions between apical and extracochlear ground contacts, aiming to characterize the effects of dual ground usage on auditory nerve fiber (ANF) dynamics and determine their utility in improving spectral resolution. Design: 6 patients with CIs were used in this retrospective study. Volume conduction models encompassing patient specific electro-anatomical characteristics and ANF compartment models defining neural dynamics were used to generate activation thresholds for 75 evenly spaced fiber bundles throughout each modeled cochlea and for 4 different grounding configurations, including the use of combined grounds. We compare our intra-patient models in terms of threshold shifts and standard deviation of fiber proportions to determine the effects of ground configuration used on channel interaction. Results: For all 6 patients, we observe shifts in ANF activation thresholds for the combined ground models indicative of more specific fiber stimulation per contact. Additionally, our combined ground models exhibit reduced fiber proportion standard deviation for several contacts of the stimulating array when compared to the standard extracochlear ground configuration or apical ground configuration. Conclusions: The shifts in activation thresholds and reduction in standard deviations suggest that stimulation schemes utilizing extracochlear and apical grounds in conjunction can provide reduced channel interaction and enhanced spectral resolution for certain contacts in an array.

0.32

Low-Power End-to-End Cochlear Implant Speech Denoising with Spiking Neural Networks

cs.SD cs.NEeess.AS ·2026-08-28 ·Ludovic Boulanger, Sean U. N. Wood
published similarity 0.51
Abstract

Cochlear implants (CI) restore hearing for individuals with severe to profound hearing loss. However, CI users often struggle to understand speech in noisy environments. Deep neural networks (DNN) have shown promise in enhancing speech for CI users, yet their high energy demands make them non-ideal for low-power CI processors. Spiking neural networks (SNN), on the other hand, offer comparable performance with significantly lower energy consumption. Hence, we propose a novel SNN inspired by the Deep ACE architecture that simultaneously performs speech enhancement and CI coding. Our model achieves competitive vocoded short-time objective intelligibility (VSTOI) and signal-to-noise ratio improvement (SNRi) scores compared to Deep ACE, while achieving more than a sixfold reduction in energy consumption.

0.24

Towards Microphone-Invariant Speech Representations for Transformer-Based Voice Disorder Detection

eess.AS cs.LG ·2026-11-16 ·Iva Ewert, Felix Putze, Marvin Borsdorf, Tanja Schultz
similarity 0.51
Abstract · 5 pages, 3 figures, 1 table, under review

Automatic voice disorder detection from speech offers strong potential for early diagnosis and continuous disease monitoring. While models based on pre-trained transformers have improved detection performance, their robustness to microphone variation remains underexplored, particularly for consumer-grade devices. To the best of our knowledge, we present the first study of microphone mismatch in transformer-based binary voice disorder detection across 20 smartphone microphones. While most mismatched microphone conditions cause moderate performance degradation, the worst-case condition reduces unweighted average recall by up to 12.53 percentage points. To address this, we introduce a Barlow Twins-inspired module to learn microphone-invariant representations. Our approach reduces the performance gap between matched and mismatched conditions by up to 62%, while maintaining comparable matched-condition performance. Qualitative analysis of the embedding space demonstrates more compact, distinct speaker clusters across microphones. Importantly, results indicate generalisation to unseen microphones across manufacturers, smartphone generations, and release periods, without requiring any inference-time adaptation.

0.30