CS Paper Radar

MtReNIRS: A Self-Supervised Foundation Model for Transferable Neurovascular Representations

Tony Chae, Kleanthis Avramidis, Dimitra Emmanouilidou, Ivan J. Tashev

eess.SP q-bio.NC ·submitted 2026-10-26 18:59 UTC · v1

Abstract

Functional near-infrared spectroscopy (fNIRS) offers a promising approach for monitoring the hemodynamic correlates of neural activity in naturalistic settings. However, existing modeling methods for fNIRS are largely confined to small-scale, single-session data with low sampling rates, driven by high heterogeneity in acquisition devices and optode montages. In addition, the complex spatiotemporal structure of fNIRS signals further restricts model scalability and transferability across settings. As a result, it remains unclear whether a single fNIRS encoder can learn representations that are usable across subjects, tasks, devices, and montages. Here, we show that a montage-aware masked autoencoder, pretrained on 12 public fNIRS datasets spanning 268 subjects and 567 recording hours, learns generalizable neurovascular representations that transfer across three external datasets. Our fNIRS foundation model, MtReNIRS, jointly encodes the slow hemodynamic nature of fNIRS, chromophore identity and cortical location by mapping heterogeneous montages onto a shared anatomical reference. MtReNIRS achieves cross-subject performance on par or better than fully supervised baselines and excels in few-shot within-subject calibration, where it outperforms prior state-of-the-art fNIRS models, while remaining robust to sparse montages. Our results indicate that montage-aware self-supervision yields physiologically grounded, transferable fNIRS representations, providing a scalable foundation for label-efficient brain-computer interfaces.

Comment
submitted to IEEE OJSP

Closest papers

Nearest neighbours by meaning across the whole index.

fNIRSAtlas: A Large-Scale Benchmark for Functional Near-Infrared Spectroscopy Classification

cs.LG ·2026-11-06 ·Kalle Mäkelä, Tuukka Ruotsalo
top venuebenchmarkcode/data similarity 0.76
Abstract · Accepted to NeurIPS 2026 (Evaluations & Datasets Track)

Functional near-infrared spectroscopy (fNIRS) is a promising modality for brain-computer interfaces and cognitive state decoding, but progress in machine learning for fNIRS has been limited by small, isolated datasets and inconsistent evaluation protocols. We introduce fNIRSAtlas, the largest open benchmark for fNIRS classification to date, comprising 23 classification tasks from 19 public data collections, spanning diverse experimental paradigms, including motor execution, motor imagery, mental arithmetic, working memory, and emotion recognition. fNIRSAtlas provides a fully automated pipeline from raw data to evaluation and defines standardized benchmark tasks for both cross-subject and within-subject classification, ensuring reproducible comparison of methods. We evaluate a variety of baseline models from fNIRS and related neuroimaging and time-series machine learning literature on the benchmark. Our results demonstrate that performance varies substantially across tasks and that methods validated on limited data -- especially deep learning approaches -- often fail to generalize beyond their original evaluation. fNIRSAtlas serves as an extensible, open, and reproducible benchmark to support more robust and cumulative progress in machine learning for fNIRS data. Our code and data can be found at https://fnirsatlas.github.io.

0.32

GeoNIRS: Geometry-Aware Pretraining for Heterogeneous fNIRS Representation Learning

cs.LG ·2026-10-13 ·Zongsheng Li, Shengyuan Zhu, Zimo Zhang, Hanyao Li, Shengming Wang +1 more
code/data similarity 0.76
Abstract · 30 pages, 5 figures, and 21 tables. Code and pretrained checkpoints are available at https://github.com/GeoNIRS/GeoNIRS

Functional near-infrared spectroscopy (fNIRS) provides portable and spatially localized measurements of cortical hemodynamics, but differences in channel count, probe layout, signal distribution, and task type hinder joint pretraining across datasets. We introduce GeoNIRS, a geometry-aware framework that uses source-detector locations as a shared spatial reference across heterogeneous probe layouts. GeoNIRS compresses variable-size channel sets into a fixed-size latent representation and employs bidirectional HbO/HbR cross-reconstruction with contiguous temporal masking. GeoNIRS-base is pretrained on eight heterogeneous datasets, while GeoNIRS-large scales to 22 datasets. Neither downstream data nor labels are used during pretraining, enabling evaluation under a strict cross-task setting. To our knowledge, GeoNIRS is the first fNIRS framework to explicitly model physical channel geometry during joint pretraining across heterogeneous channel configurations, and the first to provide complete source code and downloadable pretrained checkpoints. We evaluate GeoNIRS on eight held-out tasks spanning clinical and auditory assessment, pain and affective processing, semantic decoding, and motor function. GeoNIRS achieves the highest task-averaged balanced accuracy among the evaluated conventional machine-learning, fNIRS-specific, general time-series, and fNIRS pretraining baselines. Compared with random initialization, pretraining improves average balanced accuracy by 4.12 percentage points under linear probing and 3.30 points under full fine-tuning, with larger benefits when labels are scarce. GeoNIRS also remains robust to missing input channels. Geometry perturbations and pretraining ablations further show that both channel geometry and cross-chromophore reconstruction contribute to the learned representations.

0.53

Towards fNIRS foundation models: A curated corpus of 67 public datasets with channel positions in MNI space

cs.HC ·2026-10-29 ·Santiago Posso-Murillo
datasetcode/data similarity 0.74
Abstract

Brain foundation models have transformed medical artificial intelligence and computational neuroscience by reducing the reliance on task-specific data through large-scale pretraining. While they have been successful with non-invasive neuroimaging data, their adoption in functional near-infrared spectroscopy (fNIRS) has lagged due to the limited size and heterogeneity of public datasets, which are collected under varying protocols, devices, and sensor configurations. In addition, no single fNIRS dataset is comparable in size to the largest datasets in functional magnetic resonance imaging (fMRI), electroencephalography (EEG), or magnetoencephalography (MEG). The fNIRS datasets are also spread across different platforms and often have insufficient information, or lack the protocols that would make them easier to use. Given the advances in EEG foundation models that enable flexible modeling across diverse EEG montages, we curated 1,955 hours of fNIRS data from 67 public datasets spanning 2,798 participants, representing the largest fNIRS curation effort to date. The curated data include oxygenated (HbO) and deoxygenated (HbR) hemoglobin signals along with the three-dimensional position of every channel in the standard space of the Montreal Neurological Institute (MNI), which makes positions comparable across datasets. We release dataloaders that handle each dataset automatically, along with the minimal preprocessing pipeline used to prepare the data, at https://github.com/sposso/fnirs-datasets. This work aims to facilitate the future development of foundation models for fNIRS.

0.19

The AI Neuroscientist: An Interactive Agentic Interface for Neuroimaging Analysis

cs.AI ·2026-09-21 ·Aakash Patel, Panos Ketonis, Shreya Saxena, Smita Krishnaswamy, David van Dijk
similarity 0.66
Abstract

Analyzing neuroimaging data requires specialized coding and statistical expertise, which limits accessibility for researchers without computational backgrounds. We present the AI Neuroscientist, a language agent for interactive data exploration. The system integrates a large language model (LLM) with a neuroimaging toolset to perform quality control, modeling, and visualization. This allows researchers to query data quality and specify analysis parameters directly in natural language, providing a transparent and interactive alternative to conventional scripted pipelines for small-scale data exploration. We demonstrate these capabilities using functional near-infrared spectroscopy (fNIRS) data, and evaluate the agent on a custom fNIRS benchmarking suite against general-purpose LLM agents with code sandboxes. Future extensions will generalize the architecture to additional modalities, including functional magnetic resonance imaging (fMRI) data, and expand the benchmarking suite to additional fNIRS tasks.

0.18

Spectrally optimized implicit neural representations mitigate acquisition-related image quality trade-offs in intracranial 4D Flow MRI

eess.IV cs.CV ·2026-10-23 ·Oliver Welin Odeback, Nerea González-Aranceta, Sebastián Jofre, Javier Bisbal, Edward Ferdian +10 more
similarity 0.65
Abstract · 36 pages, 7 main figures, 2 supplementary figures. Under review at Medical Image Analysis

4D Flow MRI promises opportunities for non-invasive mapping of neurovascular hemodynamics, but its clinical utility faces trade-offs between resolution, acquisition time, and noise. Deep learning-based super-resolution offers a post-scan solution, but supervised approaches require paired or domain-specific data, while patient-specific physics-informed models can be computationally demanding. This creates a need for unsupervised reconstruction models that can adapt to individual acquisitions without paired high-resolution training data, while remaining robust across anatomy, disease severity, and acquisition quality. To address this, we introduce a spectrally tuned implicit neural representation (INR) framework for intracranial 4D Flow MRI, representing the velocity field as a continuous coordinate-based neural field using WIRE activation functions with tunable spectral bias. Data-driven and physics-informed variants were evaluated in nine cerebrovascular cases spanning healthy controls and moderate-to-severe intracranial atherosclerotic disease, using CFD-derived high-resolution reference fields, MR-realistic synthetic low-resolution inputs, and direct fitting to acquired in-vivo data. Cohort-optimal spectral-bias settings generalized across subjects with only small increases in relative error compared with subject-specific optima, reducing the need for case-specific hyperparameter tuning. Physics-informed regularization provided modest additional accuracy but required substantially longer optimization, whereas the data-driven INR achieved near-comparable reconstruction performance within minutes. The framework also remained robust to acquisition-realistic noise and moderate VENC-dependent aliasing. These findings establish spectrally optimized INRs as a flexible unsupervised approach for mitigating acquisition-related trade-offs in intracranial 4D Flow MRI.

0.21

iBrain: A Unified Foundation Model Reading the Brain from Surface to Spikes

cs.AI ·2026-09-07 ·Ying Chen, Tiou Wang, Zhifeng Yue
similarity 0.63
Abstract

Invasive neural recordings provide high-fidelity measurements of brain activity, with signals such as intracranial EEG (iEEG) and intracortical spiking activity capturing neural dynamics at different spatial and temporal scales. Yet existing neural foundation models have largely been developed independently for different invasive recording paradigms, leaving joint pretraining across heterogeneous invasive signals underexplored. In this work, we introduce iBrain, a unified foundation model that jointly learns from iEEG and spiking activity. iBrain employs signal-specific encoders to accommodate their distinct signal characteristics and a shared spatiotemporal Transformer backbone to model dependencies across recording channels and time. We pretrain iBrain on over 7,000 hours of heterogeneous neural recordings using masked signal reconstruction and channel-view alignment, promoting contextual modeling of neural dynamics and robustness across different channels. iBrain consistently outperforms single-signal pretraining baselines and achieves state-of-the-art performance on multiple benchmarks. Further experiments demonstrate that iBrain exhibits transferability and data efficiency across diverse recording settings. These results highlight the potential of joint pretraining on heterogeneous invasive neural recordings to support scalable neural modeling and transferable representations across recording settings and downstream tasks.

0.24

Towards semantic reconstruction of individual words from fnirs using clip loss

cs.HC ·2026-10-05 ·Santiago Posso-Murillo, Nathan Palladino, Ben Pyykkonen, Dong Y. Han, Luis G. Sanchez-Giraldo +1 more
similarity 0.62
Abstract

Semantic reconstruction maps neural activity to a word-embedding space, recovering the meaning of a perceived word instead of selecting it from a fixed vocabulary. Functional near-infrared spectroscopy (fNIRS) carries semantic information suitable for this mapping. However, most fNIRS decoders are trained with a squared-error objective that fits each word independently and ignores the geometry of the embedding space. To address this limitation, we evaluate a contrastive loss based on the contrastive-language-image-pretraining (CLIP) loss, as an alternative to mean-squared-error (MSE) for reconstructing perceived words from fNIRS. We compare the two objectives by training a bidirectional long short-term memory (Bi-LSTM) decoder to map fNIRS signals to word embeddings. We use GloVe-50 and T5 word embeddings as targets, across three fNIRS datasets recorded under a shared paradigm pairing each word image with its spoken name. Performance is measured with a pairwise matching score and open-vocabulary top-$k$ retrieval. The Bi-LSTM trained with CLIP is the most consistent decoder across experiments. T5 produces higher matching scores, whereas every significant retrieval result uses GloVe-50. These results support the use of contrastive objectives as a promising direction for fNIRS semantic decoding and motivate validation on larger datasets.

0.58

Pretraining for Sample-Efficient Neural Interfaces

cs.LG q-bio.NC ·2026-09-11 ·Ben Tang, Zachary Spalding, Gregory B. Cogan
benchmarkcode/data similarity 0.61
Abstract · 15 pages, including references and appendix; 5 figures. Code: https://github.com/bentang18/MAPA

Brain-computer interfaces (BCIs) decode neural activity to restore lost function. Typically, training a high-performance neural decoder requires a large labeled dataset to be collected from every new subject. One way to reduce the labeled data cost is self-supervised pretraining, which learns general neural representations from unlabeled recordings that accumulate across subjects. However, for intracranial electroencephalography (iEEG) recordings, self-supervised learning has been challenging due to differences in contact placement and neuroanatomy between subjects. We propose MAPA, an otherwise vanilla masked autoencoder with two spatial encodings, an anatomical region embedding and a relative positional encoding, which together enable it to learn neural representations that transfer to unseen subjects and across various tasks. MAPA sets a new state of the art across all three regimes of the Neuroprobe benchmark without fine-tuning: within-session, cross-session, and cross-subject. In the cross-subject regime, a linear probe on MAPA's features needs only ${\sim}164$ labeled trials to reach the accuracy that takes 3,500 without pretraining. Our results show that self-supervised pretraining can scale across heterogeneous iEEG recordings and reduce the labeled data needed for accurate decoding in new subjects.

0.41