CS Paper Radar

Fully-Automated Multi-Modal Registration of Timelapse Zebrafish OCT+LS Images

Mahshid Babeli Nia, Leah A. Lewis, Mohammad Mobarak Karim, Manmohan Singh, Arne C. Lekven, Guoning Chen, Kirill V. Larin, David Mayerich

eess.IV ·submitted 2026-10-23 20:05 UTC · v1

Abstract

Optical coherence tomography (OCT) and light sheet (LS) fluorescence microscopy provide complementary views of tissue morphology and molecular expression, offering a powerful approach for studying embryonic development. However, longitudinal integration of OCT+LS images is challenging because the modalities differ substantially in contrast, spatial resolution, field of view, and visible anatomical features, while embryo growth and movement introduce additional misalignment over time. These challenges stem from both the scale and multimodal nature of the OCT and LS image stacks. We present a fully automated three-dimensional rigid registration framework for aligning OCT and LS volumes of developing zebrafish embryos acquired from 21 to 48 hours post fertilization (HPF). The method does not require pre-existing segmentations or cross-modal feature correspondences, which are often unreliable because OCT and LS capture fundamentally different tissue properties. Registration performance was evaluated across developmental time points using mean target registration error (mTRE) and compared across multiple similarity metrics and optimization methods. Normalized cross-correlation combined with particle swarm optimization produced the most accurate and consistent registration, achieving the lowest mTRE at every evaluated time point compared with the alternative methods. The registration establishes spatial correspondence between OCT tissue morphology and LS fluorescence signals throughout development, enabling integrated longitudinal analysis of structural and molecular changes in living embryos.

Closest papers

Nearest neighbours by meaning across the whole index.

Modality-Invariant Coarse-to-Fine Retinal Image Registration

eess.IV cs.CV ·2026-08-14 ·Bo Wen, Nehal Nailesh Mehta, Melanie Tran, Dirk-Uwe Bartsch, William Freeman +1 more
published similarity 0.60
Abstract · This paper is a submission to IEEE Transactions on Image Processing (TIP-40498-2026)

Retinal image registration is essential for ophthalmic diagnosis, longitudinal disease monitoring, and multimodal retinal image analysis. Existing retinal registration methods are typically modality-dependent: they are designed or optimized either for a single imaging modality in mono-modal registration or for a fixed pair of modalities in cross-modal registration. This limits their flexibility and applicability in practical scenarios involving diverse retinal imaging modalities and different combinations of them. In this work, we propose a generalizable two-stage, modality-invariant framework for retinal image registration. First, we introduce a sparse feature-matching model driven by a universal retinal vessel segmentation to achieve robust coarse global alignment across modalities. Second, we develop a modality-invariant optical flow estimation network, termed MI-RAFT, to refine the alignment through dense local registration. Extensive experiments demonstrate that the proposed method can handle diverse combinations of commonly used retinal imaging modalities, exhibiting strong modality invariance while outperforming state-of-the-art modality-dependent registration methods.

0.17

Fast and Accurate Monomodal 3D High Resolution Deep Registration of Drosophila Larval Brain Volumes

cs.CV ·2026-09-10 ·Daniel Reisenbüchler, Yousef Sadegheih, Michael Dittrich, Pratibha Kumari, Muhammad Usman +1 more
code/data similarity 0.60
Abstract

The larval stage of Drosophila melanogaster is a compact model system for neuroscience whose genetic toolkit allows fluorescent markers to be expressed in defined neural populations, and comparing the resulting expression patterns across animals requires every brain to be registered into a shared anatomical reference space. Existing pipelines for this task are predominantly based on classical registration methods, which perform a new optimization for each volume, often require per-case parameter tuning, and can take minutes per brain, limiting their use as a routine preprocessing step. We present a trained deep registration pipeline that deformably aligns a larval brain to a reference template in a single forward pass at high spatial resolution, on volumes that hold several times more voxels than those learned 3D registration is normally reported on, together with the preprocessing and anatomy-anchored evaluation pipeline required to apply it. Against eleven classical and seven further learned baselines on a held-out collection acquired with different acquisition and quality strata, the proposed pipeline is the most accurate, improving on the strongest classical baseline by 23 percentage points of anatomical landmark-local mutual information. It registers a volume one to two orders of magnitude faster than the classical deformable pipelines, and it retains more of its accuracy than any other method as acquisition quality degrades. The network, its trained weights and the full pipeline are released as the open-source deep larval brain registration framework: https://github.com/agentdr1/deep-larval-brain-reg

0.40

Evaluating Transformation Models for pCLE Mosaic Registration

cs.CV ·2026-09-21 ·Ahmed Aboelela, Johannes Barcsay, Jana Friedhof, Miguel Gonçalves, Alexander Hann +1 more
similarity 0.59
Abstract

Confocal Laser Endomicroscopy (CLE) provides real-time, cellular-resolution optical biopsy but has a narrow field of view, which image mosaicing can extend to provide anatomical context. Because of line-by-line acquisition, probe motion, and probe-tissue interaction, frame alignment generally requires a non-linear transformation whose accuracy is difficult to quantify: flexible transformation models can fit intensity features and noise, so appearance-based metrics such as Normalized Cross-Correlation (NCC) can improve without a genuine gain in geometric accuracy. We therefore establish a dataset of 132 frame pairs across fourteen pCLE sequences from 4 patients with manually annotated landmark correspondences, so that Target Registration Error (TRE) can serve as a geometrically grounded complement to NCC. We assess the effect of progressively increasing the transformation model's degrees of freedom, from translation to Thin Plate Spline (TPS), and of six feature-matching backends spanning classical (Shi-Tomasi, Lucas-Kanade) and learned (SuperPoint, SuperGlue, LightGlue, LoFTR, RoMa) approaches. Translation and rigid models prove insufficient under tissue deformation, while TPS with random sampling achieves the strongest landmark-derived alignment of the evaluated configurations; among the learned matchers, used without fine-tuning, only RoMa offers a robust, if modest, advantage over other methods. At the sequence level, pairwise registration quality proved an unreliable predictor of final mosaic quality, so mosaic quality must be evaluated directly rather than inferred from pairwise metrics.

0.34

2D Gum-Net: Unsupervised Dense Elastic Image Registration via Symmetric Correlation and Spectral Pooling

cs.CV cs.AI ·2026-11-09 ·Aarya Bhave, Anushka Ajay Bhave
published similarity 0.55
Abstract · 19 pages, 11 figures, 3 tables. Accepted at the NewInML Workshop at the 40th Conference on Neural Information Processing Systems (NeurIPS 20…

Dense non-rigid registration, the recovery of a pixel-wise deformation field that warps one image into geometric agreement with another, is fundamental across medical imaging, structural biology, and correspondence estimation, yet learning-based approaches face a severe bottleneck: ground-truth deformation fields are notoriously difficult to obtain for real data. We present 2D Gum-Net, an end-to-end architecture that predicts dense elastic deformation fields fully unsupervised. We transfer the Geometric Unsupervised Matching Network (Gum-Net), originally developed for 3D subtomogram alignment in cryo-electron tomography, to 2D elastic registration: all three modules are redesigned in 2D, and the rigid transformation head is replaced by a Dense Spatial Transformer that regresses a sparse control-point grid, lifted to a full-resolution field $Φ$ by bicubic interpolation. Downsampling uses DCT spectral pooling, implemented as frozen-basis matrix multiplications ($\approx 50\times$ GPU speedup), preserving the fine, quasi-periodic structure that max and average pooling destroy. We evaluate on contact-based fingerprints, a challenging testbed for this task: locally self-similar ridge patterns make correspondence maximally ambiguous, skin pressed against a sensor generates authentic large-displacement elastic distortion, and minutiae act as precise landmarks through which an independent matcher externally verifies the topological correctness of predicted fields. Trained purely on synthetic impressions and evaluated zero-shot on real benchmarks, our method improves structural correlation by up to 15.7% on FVC2004 and raises genuine match scores under an independent matcher while leaving imposter scores essentially unchanged. This suggests that the predicted deformations restore true structure without fabricating correspondences.

0.32

PET Quantification-Preserving Registration for Longitudinal Whole-Body PSMA PET/CT

cs.CV ·2026-10-15 ·Fryderyk Kögl, Anna Reithmeir, Daniel M. Lang, Emily Chan, Rickmer Braren +1 more
code/datahot direction similarity 0.55
Abstract

We adapt the diffeomorphic coarse-to-fine LapIRN architecture for longitudinal whole-body PSMA PET/CT registration in the Learn2Reg 2026 PSMAReg challenge. The method combines affine pre-registration, multi-modal deformable registration, and test-time instance optimization. We further introduce PET biomarker preservation losses for metabolic tumor volume (MTV) and total lesion glycolysis (TLG), including Jacobian-based constraints, and a per-structure rigidity regularization for skeletal structures. The submitted configuration achieved 81.0% DSC and 6.17 mm HD95, with MTV and TLG errors of 3.3% and 3.3%, respectively, on our evaluation protocol. Code is available at https://github.com/koegl/psmareg.

0.37

Registration is a Representation Problem: Solving Whole-Body PET/CT Registration

cs.CV cs.LG ·2026-10-13 ·Neel Dey, Adrian V. Dalca
publishedbenchmarkcode/data similarity 0.54
Abstract · Technical report. First place winning solution for the MICCAI Learn2Reg 2026 PSMAReg challenge. Code and volumetric visualizations are avail…

Raw image intensities are a poor surrogate for similarity across images in correspondence problems. Further, while auxiliary segmentation labels can provide semantic identification and improve matching, they can assign only coarse identities to fine-grained anatomy and often cover only a subset of structures, particularly in whole-body settings. We present an approach that instead establishes correspondence using complementary representations of anatomy and demonstrate its utility for longitudinal whole-body PET/CT registration in the Learn2Reg 2026 PSMAReg Challenge. We use our 3D foundation model, anatomix, to derive fine-grained, per-voxel semantic representations that are consistent across volumes and further employ off-the-shelf segmentation models to obtain coarse anatomical identities. Together, these representations drive a GPU-accelerated iterative registration solver (FireANTs) in a hybrid multistage framework: the first stage estimates alignment from dense multi-channel features, after which a second refines the deformation using both anatomix- and segmentation-based losses. Lastly, because registration should not introduce non-biological tumor volume changes across time, we develop lesion-specific, component-wise volume preservation schemes. Without any task-specific training, our system placed first on the PSMAReg Challenge leaderboard. Code and interactive visualizations are available at https://www.neeldey.com/reps-for-reg.

0.31

Predictive Multi-Landmark OCT Tracking for Increased Motion Robustness

cs.CV ·2026-09-10 ·Konrad Reuter, Suresh Guttikonda, Chaitali Uday Karekar, Christian Betz, Alexander Schlaefer
similarity 0.54
Abstract · Accecpted at CURAC conference 2026

Optical coherence tomography is a promising modality for markerless motion tracking due to its high spatial resolution and inherent depth perception. However, existing OCT-based tracking approaches are limited in terms of trackable velocity, particularly when multiple landmarks are tracked sequentially for 6D pose estimation. In this work, we present a predictive tracking approach that propagates positional updates between multiple tracked landmarks to obtain a global pose prediction. This enables more robust tracking under high velocities. Our results demonstrate RMSEs below 1 mm for velocities up to 100 mm/s and up to nine consecutively tracked landmarks, highlighting the potential of global motion propagation and prediction for improving the robustness of OCT-based tracking.

0.25

MultiPASE: Shape-Aware Comparative 3D Genome Analysis

cs.HC q-bio.QM ·2026-10-16 ·N. Nipu, G. Johnson, C. Roth, D. Rogers, S. R. Starkenburg +2 more
similarity 0.53
Abstract

3D genome structures reconstructed from Hi-C data provide valuable insights into chromatin organization, but comparing them across conditions and time points remains challenging because of noise, variability, and arbitrary orientation. State-of-the-art comparison approaches often rely on contact-matrix-based summaries, which do not preserve the spatial geometry of the reconstructed structures and make integration with gene expression and chromatin accessibility difficult. There is therefore a need for robust structural alignment and spatial abstraction methods that support integrated analysis across conditions and time points. We present MultiPASE, a computational pipeline for comparative analysis of reconstructed 3D genome structures represented as gene-level spatial point clouds. MultiPASE aligns point clouds into a shared coordinate frame using coarse-to-fine rigid registration with PCA-based axis disambiguation and robust ICP refinement, then summarizes spatial organization using two complementary shape abstraction methods that produce stable, nested, multi-scale representations from dense core regions to broader structural extent. Using Hi-C-derived reconstructions from viral infection experiments, we show how the approach reveals condition-dependent structural changes that are difficult to interpret from raw 3D structures alone. By integrating spatial structure with gene expression and chromatin accessibility, MultiPASE supports interactive analysis of spatial organization and gene relocation patterns. A quantitative validation, reported in the Supplementary Materials, shows that the proposed shape abstractions preserve non-convex features, remain stable across samples, and that the alignment pipeline is necessary for meaningful comparison. A usage case and a usability evaluation with eight participants demonstrate the pipeline's effectiveness for comparative structural analysis.

0.24