CS Paper Radar

Flow Matching for Fluctuation-Based Fluorescence Super-Resolution

Alberto Cozzani, Giacomo Meanti, Laure Blanc-Féraud, Luca Calatroni

eess.IV math.OC ·submitted 2026-10-27 18:23 UTC · v1
code/dataunusual

Abstract

Fluctuation-based super-resolution techniques are an appealing alternative to single-molecule and structured-illumination microscopy, as they adapt to standard acquisition settings and exploit the independent stochastic fluctuations of fluorophores across a sequence of frames. However, most existing approaches lack an explicit model of the acquisition process and provide only relative intensity estimates, limiting quantitative analyses. In this work, we combine model-based and generative approaches to exploit the full stochastic information in the sequence, proposing a reconstruction framework built on flow matching and a double-Poisson forward model accounting for blinking, blur, under-sampling and noise. The method alternates two steps: a flow matching model first learns the distribution of the acquired data; then, the sample and the background are jointly estimated by minimising a Kullback-Leibler divergence between observed and simulated distributions via regularised proximal gradient steps. On simulated and real Argolight data, the method resolves lines separated by 120 nm, outperforming SACD and eSRRF.

Comment
5 pages, 3 figures, submitted to ISBI 2027. Code available at https://github.com/cozzalberto/flow_fluo

Closest papers

Nearest neighbours by meaning across the whole index.

CryoGaussian: Heterogeneous Cryo-EM Reconstruction Made Explicit with Gaussian Splatting

cs.CV ·2026-11-19 ·Ziwen Wang, Jiajun Fan, Chaoran Cheng, Ruihan Guo, Yanru Qu +2 more
similarity 0.59
Abstract · 59 pages, 25 figures, 15 tables

Single-particle cryo-electron microscopy (cryo-EM) determines macromolecular structures from noisy particle images. However, rare, transient compositional states and subtle, continuous conformational variation are difficult to resolve. We present CryoGaussian, a Gaussian splatting method for heterogeneous cryo-EM reconstruction that fits an explicit Gaussian density representation directly to the particle images through a differentiable rasterizer rendering orthographic line integrals modulated by the contrast transfer function. The Gaussians are initialized randomly, with their number derived from the estimated spatial support of the molecular density and their minimum size bounded by the Nyquist frequency of the particle images. To capture the compositional and conformational variation across particle images, we learn particle-image and per-Gaussian latents that jointly modulate the base position, amplitude, and scale of each Gaussian. Each structural state is then reconstructed by fitting the Gaussians conditioned on its inferred latent. On CryoBench, CryoGaussian achieves state-of-the-art reconstruction accuracy for both compositional and conformational heterogeneity. On experimental data, it resolves a rare compositional state of the 50S ribosomal subunit (class C4, 1.3% of particles) with rRNA helix 68 docked in the absence of the central protuberance, and continuous conformational motion of the SF3b and helicase subcomplexes of the pre-catalytic spliceosome. We further optimize the rasterizer for additive cryo-EM projection, reducing training time by 12.8-28.0$\times$.

0.33

Junction Geometry Survives an Unidentifiable Blur

cs.CV physics.ins-det ·2026-09-30 ·Sohail, Sarkar, Shakuntala Baichoo
unusual similarity 0.57
Abstract · 37 pages, 13 figures, 11 tables

Thin filaments cross in microscopy, and dispersed spectra cross on X-ray detectors. At a junction, where these structures cross or branch, how many straight arms meet, and which way do they go? Unknown blur obscures the answer. At a balanced crossing, distinct Gaussian blurs can even produce the same observation law. We show that the arms can still be recovered. For separated rays of nonvanishing weight and an unknown centered Gaussian-mixture blur, a distance combining arm count, directions, relative weights and supporting lines is bounded by a constant times the Euclidean difference in cell probabilities on a sufficiently fine fixed grid. The bound is uniform over a bounded model class, including unidentifiable blurs. From $n$ positions or photon counts, the minimax error is of order $n^{-1/2}$. This rate is proved for a global estimator. In practice we fit rays and blur by constrained local likelihood, reducing the BIC count when two detectors agree on fewer arms in the microscopy studies. Across three studies with protocols fixed before evaluation, on 360 crossings and branches assembled from measured single-molecule localizations, the fit gets the arm count and every direction within $10^\circ$ 24 to 37 percentage points more often than a tuned fixed-scale Hessian ridge detector, averaged over 25 to 400 localizations. On acute angles with correct counts, mean absolute error is $3.5^\circ$ to $4.3^\circ$, versus $10.4^\circ$ to $15.5^\circ$. On Chandra spectra, 38 of 90 fits at 800 photons find all four arms within $10^\circ$; among these, median error is $0.023^\circ$.

0.29

PyFLI: A Python Library for Simulation, Parameter Estimation, and Benchmarking in Fluorescence Lifetime Imaging

cs.MS q-bio.QMphysics.med-phphysics.optics ·2026-09-09 ·Vikas Pandey, Ismail Erbas, Margarida Barroso, Stefan Radev, Xavier Intes
code/data similarity 0.56
Abstract

Fluorescence lifetime imaging (FLI) measures the temporal decay of fluorescence after excitation and provides quantitative information about a fluorophore's local environment and molecular interactions. Depending on the fluorophore and experimental design, lifetime can report changes associated with pH, oxygenation, cellular metabolism, and Forster resonance energy transfer. These properties make FLI useful across microscopy, biophysics, biomedical optics, and preclinical imaging, where the same type of molecular contrast can be studied across different biological scales. FLI measurements, however, are acquired with instruments that record fluorescence in different ways. Intensified charge-coupled device (ICCD) cameras, single-photon avalanche diode (SPAD) arrays, and time-correlated single-photon counting (TCSPC) systems differ in temporal sampling, data organization, detector noise, instrument response, and file format. Lifetime-estimation methods also make different assumptions about the recorded decay, while learning-based approaches require realistic training and validation data for which the underlying parameters are known. PyFLI is an open-source framework for FLI processing and standardized data simulation. It imports measurements from acquisition systems, simulates labeled data under configurable acquisition and noise conditions, and provides complementary approaches for parameter estimation. These include nonlinear least-squares fitting (NLSF), maximum-likelihood estimation (MLE), phasor analysis, rapid lifetime determination (RLD), Laguerre-based estimation, and optional Bayesian and deep-learning inference. CPU and GPU processing support image-scale analysis, while reconstruction, visualization, statistical analysis, and cross-software comparison provide tools for evaluating results. PyFLI includes compressed-sensing reconstruction for single-pixel hyperspectral FLI.

0.55

Empirical Bayes Flow Matching for Continuous Cryo-EM Heterogeneity

cs.LG q-bio.BM ·2026-11-03 ·Daniel Aibinder, Azmi Haider, Dan Rosenbaum
top venue similarity 0.56
Abstract · Accepted at NeurIPS 2026. 20 pages, 6 figures, 5 tables. Code: https://daiyral.github.io/Empirical-Bayes-Flow-Matching-for-Continuous-Cryo-E…

We address the problem of learning generative priors over high-dimensional latent variables from indirect, noisy observations, with a focus on continuous heterogeneity in cryo-electron microscopy (cryo-EM). In this setting, 3D atomic structures $x \in \mathbb{R}^{3N_a}$ are never directly observed and must be inferred from 2D projection images $y$ generated by a complex, non-linear forward operator. We propose Empirical Bayes Flow Matching (EB-FM), a method that learns a flow matching prior $p_θ(x)$ directly from observations using a Monte Carlo stochastic approximation Expectation-Maximization framework. EB-FM alternates between an E-step that performs approximate posterior sampling from $p_θ(x \mid y)$ via guided flow-based generation while maintaining persistent latent estimates through stochastic approximation, and an M-step that updates the flow model using these stabilized latent variables as training targets. This approach eliminates the need for pretraining on clean data and naturally accommodates non-linear forward models. We validate our method on controlled inverse problems using two-moons and MNIST data, and demonstrate its effectiveness on simulated cryo-EM data with known poses, showing that EB-FM can recover continuous distributions of protein conformations directly in atomic-coordinate space.

0.48

From Pixel Generation to Topological Inference: Structural Dual Super-Resolution for Trustworthy Cross-Physical-Domain Trabecular Morphology Learning

cs.CV ·2026-09-28 ·Fan Zhang, Yi Zhang, Yuhui Dong, Ling Wang, Xin Xu
similarity 0.56
Abstract · 23 pages,7 figures

Clinical CT and UHRCT cannot resolve individual trabeculae, whereas synchrotron radiation microCT (SRuCT) provides high-resolution references but is not applicable for in vivo imaging. The two domains differ by a 32x resolution gap, are only coarsely paired, and exhibit severe physical differences including partial volume effects, noise, and artifacts. Existing super-resolution networks and pretrained-prior methods (GLEAN/StyleGAN2, Stable SR/LDM) underperform because they target pixel generation---diverse details and SSIM/PSNR---and do not model these physical differences. Pixel generation for a 32x resolution gap is intrinsically ill-posed. We propose a paradigm shift from pixel generation to topological inference: deterministically predicting invariant microstructures from macro-scale low-resolution inputs, evaluated by morphological parameters. The core of our 2D morphology learning lies in training on 2D slices while evaluating on 3D morphological parameters, ensuring that the learned representations capture true three-dimensional trabecular topology rather than 2D pixel statistics. We realize this paradigm via structural dual super-resolution, coupling forward physical degradation (micro-to-macro) with inverse structural inference (macro-to-micro) through structural duality constraints. The method is an end-to-end, few-shot, compact structural dual network (SDN), comprising a bidirectional modeling network, a multi-scale structural consistency discriminator, and four structural duality constraints. On the test set, SDN achieves morphological parameters largely consistent with SRuCT across six metrics, with SSIM reaching 0.8. Trained on 3.2 um SSRF data, the model generalizes well to 3.25 um isotropic BSRF data from an independent source, validating cross-source generalization and confirming trustworthy structural inference rather than pixel generation.

0.19

Matching Particle-Arrival Rates for Low-Count Image Denoising

eess.IV cs.CV ·2026-10-23 ·Huazhen Liu, Zipei Yan, Jizhou Li
similarity 0.54
Abstract

Low-count imaging arises when limited illumination or dose yields only a few detected particles in microscopy, such as photons or electrons, causing measurements to be dominated by signal-dependent Poisson shot noise. Supervised denoisers typically require paired clean and noisy observations, whereas many self-supervised approaches exploit spatial or temporal redundancy without directly estimating the underlying particle-arrival process. We introduce PARM, a self-supervised denoising framework based on particle-arrival-rate matching. By modeling particle accumulation over exposure as a Poisson counting process, PARM identifies the conditional particle-arrival-rate field with the posterior mean of the latent clean rate. Poisson thinning then splits each observation into complementary lower-exposure views that provide self-supervised rate targets for one another. In implementation, the network estimates the normalized spatial allocation of the conditional rate, while the observed total count determines its global particle mass. Experiments on synthetic data, natural-video sequences corrupted with Poisson noise, and real low-dose electron microscopy demonstrate leading or competitive performance while effectively preserving fine structures. PARM therefore provides a statistically grounded approach to low-count image denoising when clean references are unavailable.

0.19

FlowSGS: Improving Flow Priors for Inverse Imaging with Stochastic Interpolants

cs.CV ·2026-09-17 ·Tianao Li, Xinhui Qian, Emma Alexander
similarity 0.54
Abstract

Flow matching has emerged as the state-of-the-art generative model and has been used for plug-and-play (PnP) priors to solve inverse problems in computational imaging. However, existing flow-based inverse solvers make simplifying approximations in posterior sampling and/or assume linear forward models. In contrast, principled diffusion-based methods exist but are computationally expensive. To circumvent these problems, we introduce FlowSGS, a flow-based posterior sampling method using Split Gibbs Sampling (SGS) with annealed coupling, and make flow-specific interventions to the prior sampling and annealing steps, theoretically grounded in the Stochastic Interpolants (SI) framework. Using a novel timestep correction and accelerated warm-up with one-step flow models, our method is faster and more accurate than the state of the art across a range of imaging problems. We demonstrate the first use of flow-based samplers for a nonlinear inverse problem (Fourier phase retrieval) and apply one-step flow models to principled Bayesian inverse imaging.

0.29

Stochastic Optimisation for Scalable Ptychographic Image Reconstruction

eess.IV physics.comp-phphysics.optics ·2026-11-18 ·Alan W. Muriithi, Jared Tanner, Jaroslav M. Fowkes, Benedikt J. Daurer
similarity 0.54
Abstract · 38 pages, 12 figures

X-ray ptychography is a lensless coherent diffraction imaging technique capable of high spatial resolution, in which an image is reconstructed by solving a large-scale inverse problem from highly redundant far-field diffraction measurements acquired under overlapping illumination. Whilst the measurement redundancy created by overlapping illumination is essential for reconstruction fidelity, it leads to computational and memory demands that scale poorly with object size and target resolution when using conventional reconstruction algorithms. This work proposes a ptychographic reconstruction framework that reduces peak memory usage and time to convergence by leveraging stochastic optimisation techniques developed for large-scale machine learning. Specifically, the framework employs stochastic gradient descent with a decaying step size that progressively reduces the effect of gradient noise, referred to here as variance reduction (VR), with gradients that agree with automatic differentiation, to optimise the ptychographic forward model using randomly sampled subsets of diffraction measurements. For an experimental dataset of 200,000 diffraction patterns of $128\times128$ pixels, VR is demonstrated to require $65\%$ of the peak GPU memory and $22\%$ of the reconstruction time of the established maximum-likelihood (ML) algorithm. The VR framework incorporates the Poisson maximum-likelihood formulation and partial coherence within a unified and extensible optimisation setting. Numerical experiments demonstrate that the framework achieves reconstruction quality visually comparable to established methods, with lower peak GPU memory and a shorter time

0.20