CS Paper Radar

FiberGeoText: A Vision-Language Model for Population- Level Organization of Superficial White Matter

Yuqian Chen, R. Jarrett Rushmore, Guikun Chen, Fan Zhang, Edward Yeterian, Nikos Makris, Yogesh Rathi, Lauren J. O'Donnell

cs.CV ·submitted 2026-10-02 03:31 UTC · v1

Abstract

The superficial white matter (SWM), a critical brain region for cognition across the lifespan and brain disease, contains abundant short-range association fibers whose organization remains incompletely characterized, in part because the short trajectories and highly variable cortical folding make correspondence across individuals challenging. Anatomically corresponding connections may vary in spatial location across individuals and therefore may not be adequately defined by geometric proximity alone. We introduce FiberGeoText (FGT), a vision-language model (VLM) for organizing short-range superficial white matter (SWM) streamlines reconstructed from ultra-high-resolution diffusion MRI into population-level clusters. FGT jointly represents three complementary properties of each streamline: its three-dimensional trajectory, its cortical anatomical context, and its shape. Cortical endpoint information from multiple parcellation schemes is expressed as text and encoded using a pretrained large language model (LLM), enabling heterogeneous anatomical descriptions to contribute to a common continuous representation. We evaluated FGT on acquired submillimeter 0.76 mm diffusion MRI data. Compared with state-of-the-art (SOTA) methods, FGT produced substantially greater cortical parcel coherence, within-cluster shape consistency, cluster-size consistency, and cross-subject correspondence. The trained model also generalizes well to unseen subjects with an average of 96.7% of the 5,000 learned clusters recovered, and high consistency of cluster structure between training and testing data. Together, these findings demonstrate that integrating geometric, anatomical, and shape information by learning multimodal deep embeddings with a VLM model enables robust learning of population-consistent SWM organization despite interindividual anatomical variability.

Comment
22 pages, 3 figures

Closest papers

Nearest neighbours by meaning across the whole index.

Midsagittal Corpus Callosum Parameterization: A Framework for Spatially Detailed Diffusion MR Imaging Analysis

eess.IV q-bio.NCq-bio.QM ·2026-11-14 ·Caio Santana, Catherine Lebel, Richard Frayne, Letícia Rittner
similarity 0.71
Abstract · 47 pages, 10 figures, 6 tables, plus 11 pages of supplementary material (12 figures, 6 tables). Under review at Imaging Neuroscience

The corpus callosum (CC) is the largest white matter structure in the human brain and plays a central role in interhemispheric communication. Diffusion MR imaging is widely used to investigate microstructural organization, but commonly used analysis approaches have important limitations. Voxel-based methods rely heavily on accurate inter-subject registration and smoothing choices, tract-based spatial statistics (TBSS) restricts the analysis to a narrow white matter skeleton, and parcellation approaches reduce spatial detail by averaging diffusion measures over relatively large regions. In this work, we introduce a parameterization framework for the analysis of the midsagittal CC that resamples the structure using a standardized grid of points, establishing a geometric correspondence across individuals without explicit inter-subject registration. In a test-retest dataset, the method provided stable measurements while covering most of the midsagittal CC, and sensitivity analyses showed that results in the central CC changed little under perturbations of the input CC mask, whereas peripheral regions were more sensitive. The framework was further evaluated in group analyses of aging and Alzheimer's disease in datasets that differ in acquisition protocol and spatial resolution. Effect-size maps and quantitative comparisons showed that its results were largely consistent with TBSS and parcellation-based analyses in the overall spatial pattern of effects, while also revealing additional spatially localized differences. These findings suggest that the parameterization provides a simple, computationally efficient, and spatially detailed approach for investigating midsagittal CC microstructure, offering a structure-specific complement to whole-brain and region-based methods.

0.18

Generalizable field of view extension for diffusion MRI via conditional flow matching

cs.AI ·2026-10-12 ·Gaurav Rudravaram, Lianrui Zuo, Ema Topolnjak, Michael E. Kim, Adam M. Saunders +20 more
similarity 0.66
Abstract

Incomplete field-of-view (FOV) diffusion MRI (dMRI) acquisitions compromise whole-brain white matter analysis by excluding brain regions from tractography and connectivity studies. While deep generative models for dMRI FOV extension have been proposed, their generalizability remains limited by the acquisition-dependent nature of dMRI, where signal intensity varies with b-value, gradient direction, and scanner protocol, and the inherent 4D complexity of the data, making it difficult to train models that transfer across sites or acquisition schemes without retraining. We propose a flow-matching generative model that extends the dMRI FOV in both the superior and inferior directions by predicting apparent diffusion coefficients (ADC) in six directions, conditioned on the two nearest acquired slices and the full-FOV T1w image to enforce both local diffusion continuity and anatomical consistency. The ADC representation decouples the model from acquisition-specific b-values and gradient directions, providing a middle-ground across protocols. The model was trained on 3,103 subjects (5,105 sessions) across five different datasets spanning diverse acquisition schemes (b = 500 and 1000 s/mm$^2$; 21--192 gradient directions), four single-shell (b = 1000) and one multi-shell (b = 500/1000). Evaluated on 299 subjects across five independent datasets spanning b = 750--1500 s/mm$^2$ and 32--90 gradient directions, with single- and multi-shell schemes unseen during training, the proposed method achieves significantly improved bundle Dice score on downstream tractography (p < 0.01).

0.16

dMRI-F: A Foundation Model for Generalizable Diffusion MRI Analysis from Sparse Acquisitions

cs.CV ·2026-10-13 ·Xi Zhu, Yijie Li, Xiaofan Wang, Wei Zhang, Huafu Chen +2 more
similarity 0.66
Abstract

Diffusion MRI (dMRI) probes water diffusion within the brain, providing unique information about tissue microstructure and white matter connectivity. High-quality dMRI enables advanced and accurate analyses but demands dense acquisitions, resulting in long scan times and hardware constraints that are often infeasible. Further, dMRI requires dedicated computational methods to support diverse analysis tasks (e.g., parcellation, registration, and synthesis) for both neuroscientific and clinical applications. Here, we present dMRI-F, a foundation model that unifies dMRI data enhancement and downstream tasks across diverse acquisitions and populations, while requiring only minimal acquisition input. dMRI-F is pre-trained with a q-space masked reconstruction task: predicting densely sampled multi-shell data from only six volumes. It learns generalizable latent feature representations of dMRI data, which serve as a core foundation for adapting to diverse downstream tasks, including brain parcellation, brain registration, and cross-modal synthesis. Across nine independently acquired datasets, we demonstrate that dMRI-F outperforms state-of-the-art methods with robust generalization across acquisitions, populations, and tasks. Our results demonstrate dMRI-F's versatility as a general-purpose framework that enables diverse dMRI applications from low-cost, sparse acquisitions.

0.15

CoFlu-Brain: An fMRI Connectivity Foundation Model with Cofluctuation-Based Pretraining

cs.NE ·2026-10-11 ·Ziteng Sui, Junfeng Xia, Wenhao Ye, Mo Wang, Quanying Liu
code/data similarity 0.66
Abstract

Functional magnetic resonance imaging (fMRI) commonly characterizes large-scale brain organization through functional connectivity (FC). However, an observed FC matrix is not a fixed brain graph but a statistical estimate determined by the finite BOLD frames used to compute it. Conventional FC-based approaches typically represent each scan with a single Pearson-correlation matrix, leaving frame-resolved variations in regional interactions unexploited. To address this limitation, we introduce CoFlu-Brain, which organizes framewise cofluctuation observations into multiple retained and dropped views, each summarized as an FC matrix. The model learns connectivity structure reproducible across retained views and predicts the representations of the corresponding dropped views, while adopting SIGReg from LeJEPA to prevent representation collapse. We pretrained CoFlu-Brain on 13,444 subjects from eight dataset groups and evaluated its representations via frozen-encoder linear probing on seven classification and two age-prediction tasks across seven datasets. CoFlu-Brain showed strong transfer across demographic, developmental, and clinical prediction tasks, outperforming the evaluated released models on most tasks. Random frame partitioning improved aggregate transfer, while the complete objective achieved the strongest overall performance. Code is available.

0.20

Separating mixtures of single-fiber orientation distributions for increased sensitivity to crossing white matter fibers

eess.IV q-bio.QM ·2026-10-14 ·Adam M. Saunders, Gaurav Rudravaram, Michael E. Kim, Elyssa M. McMaster, Yifan Shuai +8 more
similarity 0.63
Abstract · 25 pages, 8 figures

Intro: Diffusion MRI allows for in vivo probing of brain tissue architecture via micron-level diffusion aggregated at the millimeter scale, but crossing white matter fibers decrease the sensitivity of downstream tasks such as microstructural modeling and tractography. Current fixel-based methods for identifying the number, orientation, and spread of fibers rely on finding the peaks of fiber orientation distributions from constrained spherical deconvolution. However, this method is biased by the spreads of nearby fibers and fails at angular separations lower than approximately 40-50 degrees. Methods: In this work, we perform a constrained nonlinear optimization called fiber segmentation by signal splitting and iterative least squares estimation (FISSILE), modeling each voxel as a mixture of single-fiber distributions. We use FISSILE to fit axially symmetric fibers in simulations and on three in vivo human subjects from the Human Connectome Project, an ex vivo raccoon brain, as well as the same human subject scanned twice at two different signal-to-noise ratios (SNRs). Results: On simulated data, FISSILE successfully identifies fibers at an angular separation of 40° and a volume fraction of 0.1 at an SNR as low as 30, while MRtrix3's fod2fixel is limited to 60° separation and 0.1 volume fraction at the same SNR. On acquired data, FISSILE identified 85.8% of white matter voxels on average in human brains and 79.4% in the raccoon with at least one fiber crossing, whereas fod2fixel identified 30.1% and 44.5%. The number of white matter fiber crossings was mildly sensitive to different noise levels in the human subject with two acquisitions. Conclusion: A method that models the crossing fiber phenomenon as an unmixing problem increases sensitivity to individual fibers for more precise characterization of anatomy.

0.18

Neural fields for adaptive white matter microstructural modeling

eess.IV ·2026-10-26 ·Adam M. Saunders, Gaurav Rudravaram, Elyssa M. McMaster, Michael E. Kim, Trent Schwartz +4 more
published similarity 0.63
Abstract · 12 pages, 7 figures. Accepted to SPIE Medical Imaging 2027: Image Processing

Diffusion magnetic resonance imaging (MRI) is sensitive to the micron-level diffusion motion of water molecules, allowing in vivo characterization of white matter architecture in the brain. Microstructural models like diffusion tensors or the Standard Model are typically fit independently on each voxel, limiting their ability to incorporate local spatial context and adapt to regional tissue complexity. Here, we introduce FiberField, an approach using neural fields that selects from multiple candidate models with different numbers of fibers to estimate fiber configurations and properties. This method incorporates spatial context through coordinate representations and model-weighted priors inspired by Bayesian model averaging to adapt to local microstructure. To compare FiberField with ground truth fiber properties, we validate on simulated diffusion MRI before applying to in vivo data. In simulated diffusion MRI, FiberField accurately estimates fiber directions and diffusivities using a multi-stick model (angular error: $2.2 \pm 2.8°$, diffusivity root mean square error (RMSE): $4.4 \times 10^{-4} \pm 5.2 \times 10^{-4}$ mm$^{2}$/s, fiber sensitivity: $0.87 \pm 0.21$). FiberField resolves fibers at 25% smaller angular separations than fod2fixel, and the diffusivity RMSE is 52% lower within fiber crossings than the Standard Model. On acquired diffusion MRI, FiberField's estimated fiber directions agree with those from MRtrix3's fod2fixel while also mapping microstructural properties such as diffusivity (angular difference: $10.5 \pm 7.1°$). Using neural fields allows for adaptive white matter modeling for selecting from a set of alternative models while maintaining accurate fiber property estimation.

0.36

Prior-Guided Implicit Neural Representations for Single-Subject Diffusion MRI Super-Resolution

eess.IV cs.CV ·2026-09-01 ·Abdulkader Ghandoura, Marsil Zakour, William Consagra, Yogesh Rathi
publishedcode/data similarity 0.63
Abstract · Accepted at the British Machine Vision Conference (BMVC) 2026. 16 pages, 5 figures, 2 tables. Project page: https://abdulkaderghandoura.gith…

Resolving complex fiber geometries in brain white matter requires high-resolution diffusion MRI at the cost of long acquisition times. This leads many clinical protocols to opt for low-resolution scans, making downstream microstructure estimation and tractography challenging. Implicit neural representations (INRs) can model the diffusion signal continuously, enabling native single-subject super-resolution by querying the network at arbitrary spatial coordinates, yet existing methods often suffer from long training times and lack a mechanism to incorporate anatomical priors to regularize super-resolution by constraining the space of plausible reconstructions. To address these limitations, we propose a novel transfer-learning framework that pre-trains an INR on a high-resolution template and then adapts it to subject-specific scans via registration and fine-tuning. For $4\times$ through-plane super-resolution from 5 mm to 1.25 mm on Human Connectome Project (HCP) data, our method reduces NRMSE by 36-49% and increases FSIM by 24-43% over a recent baseline with $6\times$ faster training, outperforming competing INR-based methods across both image quality and domain-specific metrics. Code is available on the project page at https://abdulkaderghandoura.github.io/research/msc-thesis/ .

0.81

Interpretable Brain Age Prediction Using White Matter Fiber Orientation Distributions with Rotation-Equivariant Deep Learning

cs.CV cs.LG ·2026-10-26 ·Chenyang Fan, Robert D. Sanders, Elie Matar, Yixuan Yuan, Xiang Li +3 more
similarity 0.62
Abstract · 10 pages, 8 figures and 2 tables

Diffusion MRI (dMRI) provides information about white matter microstructure that can support brain age prediction. However, many existing prediction models use diffusion tensor imaging (DTI) scalar metrics that omit orientation information. Deep learning is increasingly used for brain age prediction, but conventional CNNs do not explicitly respect the geometric structure of orientation-dependent features. We present an interpretable brain age prediction framework that combines white matter fiber orientation distributions (WM-FODs) with an SE(3) (Special Euclidean group in 3 dimensions) equivariant CNN. The network operates directly on spherical harmonic (SH) coefficients of the FOD, preserving their transformation properties under rotation. Evaluation in 692 participants aged 36-90 years from the Human Connectome Project Aging dataset showed that the combined framework outperformed the evaluated DTI-based models and conventional CNNs. Averaging predictions from five cross-validation models yielded a mean absolute error of 3.54 years and Pearson's correlation of 0.958. Our results indicated that the performance advantage depended on combining WM-FODs with equivariant processing. Prediction accuracy was highest at a maximum SH order of Lmax = 2 and declined at higher orders. Tract-level occlusion, where each segmented tract was masked in turn, revealed age-dependent patterns of model sensitivity, with importance peaks in frontal projection pathways at 36-44 years, the fornix at 45-54 years, the callosal isthmus at 55-64 years, the middle cerebellar peduncle at 65-74 years, and the callosal genu at 75-90 years. These findings support rotation-equivariant processing of WM-FODs for accurate brain age prediction with anatomically interpretable model sensitivity.

0.25