CS Paper Radar

dMRI-F: A Foundation Model for Generalizable Diffusion MRI Analysis from Sparse Acquisitions

Xi Zhu, Yijie Li, Xiaofan Wang, Wei Zhang, Huafu Chen, Ce Zhu, Fan Zhang

cs.CV ·submitted 2026-10-13 08:43 UTC · v1

Abstract

Diffusion MRI (dMRI) probes water diffusion within the brain, providing unique information about tissue microstructure and white matter connectivity. High-quality dMRI enables advanced and accurate analyses but demands dense acquisitions, resulting in long scan times and hardware constraints that are often infeasible. Further, dMRI requires dedicated computational methods to support diverse analysis tasks (e.g., parcellation, registration, and synthesis) for both neuroscientific and clinical applications. Here, we present dMRI-F, a foundation model that unifies dMRI data enhancement and downstream tasks across diverse acquisitions and populations, while requiring only minimal acquisition input. dMRI-F is pre-trained with a q-space masked reconstruction task: predicting densely sampled multi-shell data from only six volumes. It learns generalizable latent feature representations of dMRI data, which serve as a core foundation for adapting to diverse downstream tasks, including brain parcellation, brain registration, and cross-modal synthesis. Across nine independently acquired datasets, we demonstrate that dMRI-F outperforms state-of-the-art methods with robust generalization across acquisitions, populations, and tasks. Our results demonstrate dMRI-F's versatility as a general-purpose framework that enables diverse dMRI applications from low-cost, sparse acquisitions.

Closest papers

Nearest neighbours by meaning across the whole index.

Generalizable field of view extension for diffusion MRI via conditional flow matching

cs.AI ·2026-10-12 ·Gaurav Rudravaram, Lianrui Zuo, Ema Topolnjak, Michael E. Kim, Adam M. Saunders +20 more
similarity 0.71
Abstract

Incomplete field-of-view (FOV) diffusion MRI (dMRI) acquisitions compromise whole-brain white matter analysis by excluding brain regions from tractography and connectivity studies. While deep generative models for dMRI FOV extension have been proposed, their generalizability remains limited by the acquisition-dependent nature of dMRI, where signal intensity varies with b-value, gradient direction, and scanner protocol, and the inherent 4D complexity of the data, making it difficult to train models that transfer across sites or acquisition schemes without retraining. We propose a flow-matching generative model that extends the dMRI FOV in both the superior and inferior directions by predicting apparent diffusion coefficients (ADC) in six directions, conditioned on the two nearest acquired slices and the full-FOV T1w image to enforce both local diffusion continuity and anatomical consistency. The ADC representation decouples the model from acquisition-specific b-values and gradient directions, providing a middle-ground across protocols. The model was trained on 3,103 subjects (5,105 sessions) across five different datasets spanning diverse acquisition schemes (b = 500 and 1000 s/mm$^2$; 21--192 gradient directions), four single-shell (b = 1000) and one multi-shell (b = 500/1000). Evaluated on 299 subjects across five independent datasets spanning b = 750--1500 s/mm$^2$ and 32--90 gradient directions, with single- and multi-shell schemes unseen during training, the proposed method achieves significantly improved bundle Dice score on downstream tractography (p < 0.01).

0.16

MnemoDyn: Learning Resting State Dynamics from 40K FMRI sequences

cs.LG ·2026-08-25 ·Sourav Pal, Viet Luong, Hoseok Lee, Tingting Dan, Guorong Wu +3 more
published similarity 0.70
Abstract · ICLR 2026

We present a dynamical-systems based model for resting-state functional magnetic resonance imaging (rs-fMRI), trained on a dataset of roughly 40K rs-fMRI sequences covering a wide variety of public and available-by-permission datasets. While most existing proposals use transformer backbones, we utilize multi-resolution temporal modeling of the dynamics across parcellated brain regions. We show that MnemoDyn is compute efficient and generalizes very well across diverse populations and scanning protocols. When benchmarked against current state-of-the-art transformer-based approaches, MnemoDyn consistently delivers superior reconstruction quality. Overall, we find that with such large-scale pre-training on (non-proprietary) rs-fMRI datasets, we get a highly performant model for various downstream tasks. Our results also provide evidence of the efficacy of the model on small sample size studies which has implications for neuroimaging studies at large where resting state fMRI is a commonly acquired imaging modality.

0.52

Multimodal-Conditioned Latent Diffusion Models for Spatiotemporal Brain MRI Forecasting

cs.CV cs.AI ·2026-10-18 ·Antonio Scardace, Silvia Ingala, Sebastiano Battiato, Daniele Ravì
publishedcode/data similarity 0.70
Abstract · Accepted to WACV 2027

Spatiotemporal forecasting of 3D anatomical changes is a critical generative vision challenge for modeling Alzheimer's Disease (AD) progression. While brain MRI forecasting from single-modality data has advanced, other key complementary multimodal biomarkers remain underutilized. In this work, we propose the Multimodal-Conditioned Latent Diffusion Model (MC-LDM), a novel framework for patient-specific brain MRI synthesis. MC-LDM leverages multimodal biomarkers---MRI, tau-PET, Clinical Dementia Rating (CDR), and APOE4---during training, but relies only on baseline MRI, APOE4, and patient metadata at inference, reflecting realistic clinical availability. Our contributions are threefold: (1) a Latent Diffusion Model (LDM) fine-tuned via Low-Rank Adaptation (LoRA) for data-efficient learning; (2) a multimodal conditioning that integrates molecular and clinical signals to model heterogeneous disease trajectories; and (3) auxiliary predictors estimating unobserved multimodal biomarkers from MRI features and patient covariates to condition the diffusion model, removing the need for these assessments at inference. Trained on 1,355 visits from 852 subjects in the Alzheimer's Disease Neuroimaging Initiative (ADNI), MC-LDM reduces average regional volumetric MAE by 18% over the second-best baseline on an independent test set of 664 visits. To our knowledge, MC-LDM represents the first diffusion-based framework to leverage multimodal priors for MRI forecasting. This conceptual advancement enables patient-specific trajectory generation that captures aspects of AD heterogeneity not observable from structural anatomy alone, bridging the gap between rich multimodal supervision and the strict constraints of routine clinical deployment. Code is available at: https://github.com/antonioscardace/MC-LDM.

0.43

A generalizable structural brain MRI foundation model via dual-priority federated pretraining

cs.CV ·2026-09-23 ·Zhen Yu, Yang Liu, Jianfeng Feng, Xiahai Zhuang, Qingchao Chen
similarity 0.70
Abstract

Foundation models hold promise for generalizable analysis of structural brain magnetic resonance imaging (MRI) scans across diverse populations and imaging conditions. However, existing models typically rely on centralized pretraining using data pooled across cohorts, which is constrained by privacy and data-governance requirements. Moreover, larger cohorts can dominate optimization, underutilizing anatomical information from smaller cohorts and limiting generalization. Here we present BrainFedFM, a structural brain MRI foundation model federatively pretrained on 164,707 three-dimensional scans drawn from diverse real-world data distributions and organized across 42 federated sites. BrainFedFM uses dual-priority federated pretraining, in which spatial-priority masking emphasizes informative anatomical regions during local training, while site-priority aggregation adaptively weights contributions during global aggregation. Across 20 downstream datasets spanning 17 classification, regression and segmentation tasks, BrainFedFM achieved the state-of-the-art performance across seven foundation models, including four centralized models, while showing consistent advantages in classification and regression tasks and strong robustness under underrepresented populations and challenging imaging conditions. These findings demonstrate the generalizability of BrainFedFM and highlight federated pretraining as a practical strategy for developing neuroimaging foundation models from distributed data without pooling raw images.

0.25

Prior-Guided Implicit Neural Representations for Single-Subject Diffusion MRI Super-Resolution

eess.IV cs.CV ·2026-09-01 ·Abdulkader Ghandoura, Marsil Zakour, William Consagra, Yogesh Rathi
publishedcode/data similarity 0.69
Abstract · Accepted at the British Machine Vision Conference (BMVC) 2026. 16 pages, 5 figures, 2 tables. Project page: https://abdulkaderghandoura.gith…

Resolving complex fiber geometries in brain white matter requires high-resolution diffusion MRI at the cost of long acquisition times. This leads many clinical protocols to opt for low-resolution scans, making downstream microstructure estimation and tractography challenging. Implicit neural representations (INRs) can model the diffusion signal continuously, enabling native single-subject super-resolution by querying the network at arbitrary spatial coordinates, yet existing methods often suffer from long training times and lack a mechanism to incorporate anatomical priors to regularize super-resolution by constraining the space of plausible reconstructions. To address these limitations, we propose a novel transfer-learning framework that pre-trains an INR on a high-resolution template and then adapts it to subject-specific scans via registration and fine-tuning. For $4\times$ through-plane super-resolution from 5 mm to 1.25 mm on Human Connectome Project (HCP) data, our method reduces NRMSE by 36-49% and increases FSIM by 24-43% over a recent baseline with $6\times$ faster training, outperforming competing INR-based methods across both image quality and domain-specific metrics. Code is available on the project page at https://abdulkaderghandoura.github.io/research/msc-thesis/ .

0.81

AnaDiffusion: Anatomically Compositional Latent Diffusion for Controllable 3D Brain MRI Generation

cs.CV ·2026-08-24 ·Huiwen Han, Lulin Liu, Bangya Liu, Yuanhao Cai, Nuo Chen +6 more
similarity 0.68
Abstract

3D brain MRI generation has made significant advances in medical imaging, simulation, and controllable anatomical analysis. However, existing generative models typically synthesize 3D volumes monolithically, often overlooking regional anatomical structures and limiting local controllability. To address these limitations, we introduce AnaDiffusion, an anatomically compositional latent diffusion framework that factorizes the generation process into distinct, anatomically meaningful regions, followed by part-to-whole assembly and global refinement. Our approach first trains part diffusion models to capture local structural priors. We then inject an assembled anatomical composite of the parts into the whole-brain latent representation and continue denoising. This mechanism enables the model to resolve global context while preserving the injected anatomy. As a result, AnaDiffusion produces both explicit part assets and a globally coherent volume, thereby enabling controllable part editing without requiring subject-specific dense segmentation maps at inference time while maintaining consistent part-to-whole brain structure. On the subject-disjoint ADNI test split, AnaDiffusion achieves the lowest FID across the whole brain, left and right hemispheres, cerebellar-brainstem complex, and seam regions. It also achieves the best cerebellar and second-best ventricular and brainstem absolute Cohen's d values among the evaluated methods. In localized editing experiments, paired MS-SSIM demonstrates high target transfer and off-target preservation, supporting controllable part replacement with minimal unintended anatomical alterations.

0.24

PI-NOMT: Physics-Informed Neural Optimal Mass Transport for Brain Fluid Dynamics

cs.LG cs.AI ·2026-09-27 ·Mehmet Emin Acar, Vahit Bugra Yesilkaynak, Helene Benveniste, Gozde Unal
benchmark similarity 0.68
Abstract

Recovering hidden transport mechanisms from sparse spatiotemporal observations is a fundamental inverse problem in scientific machine learning. In brain tracer imaging, dynamic contrast-enhanced MRI (DCE-MRI) provides time-resolved measurements of tracer concentration, while the underlying velocity and source mechanisms governing tracer propagation remain unobserved. We formulate this problem as physics-informed latent-state inference, in which the transport field itself is the primary object of inference rather than an auxiliary variable used only to reconstruct observed densities. We propose Physics-Informed Neural Optimal Mass Transport (PI-NOMT), a framework that represents density, velocity, and source as continuous neural fields and combines a continuous neural density teacher, recursive differentiable advection--diffusion--source rollout, unbalanced optimal-transport regularization, and governing-equation supervision. Physical laws act as structural priors that constrain the space of admissible transport mechanisms, while observed tracer dynamics provide evidence for estimating the latent transport state. We evaluate PI-NOMT on a synthetic benchmark with known ground-truth transport and on DCE-MRI sequences from nine control rats. On the synthetic benchmark, PI-NOMT accurately recovers the prescribed velocity field, including its magnitude, direction, and integrated trajectories, rather than merely reconstructing endpoint densities. Across the nine rat datasets, the framework yields sub-percent local endpoint error, consistent physical speed scales, and low post-training PDE and incompressibility residuals. These results support physics-informed latent-state inference as a general framework for recovering hidden transport mechanisms from observed dynamic scalar fields.

0.28

Revolutionizing Diffusion MRI Microstructure Mapping via Global Inversion

eess.IV eess.SP ·2026-09-24 ·Yuxiang Wan, Hamza Farooq, Wenjie Zhang, Qiaozhi Huang, Lingjie Su +2 more
similarity 0.67
Abstract

Diffusion MRI microstructure mapping (MM) is conventionally solved voxel by voxel, ignoring the fact that tissue microstructure forms a spatially organized field. This isolation leaves each estimation problem ill-posed and nonconvex. We instead cast MM as a single global inverse problem, reconstructing the entire parameter field jointly from all measurements of a subject. An untrained neural representation supplies implicit spatial priors and eases the nonconvex optimization, requiring no training data, while coregistered T1-weighted anatomy contributes structural guidance that is freely available in standard protocols. On both synthetic and in-vivo data, our method compares favorably with established voxel-wise and learning-based baselines, suggesting global inversion is a promising alternative.

0.18