CS Paper Radar

Image Moment Estimation for Crowded Datasets

Andy Zhang, Oscar Mickelin, Amit Singer

eess.IV q-bio.QM ·submitted 2026-10-16 02:32 UTC · v1

Abstract

Single-particle cryogenic electron microscopy (cryo-EM) is an imaging technique capable of reconstructing high-resolution three-dimensional (3D) structure of biological macromolecules from a set of noisy projection images taken at random viewing directions. The mathematical model for cryo-EM images typically assumes that each image contains exactly one particle, which is centered at the origin. However, many experimental datasets contain particle images which include multiple particles: one central particle and a few crowding particles. This deviation from the model leads to inaccurate estimation of image statistics, such as the low-order image moments. To account for this, we propose a method to estimate image moments while correcting for the effect of crowding particles. This method can be run directly from a set of cryo-EM micrographs with picked particles, and we demonstrate its efficacy on a wide array of synthetic data.

Comment
29 pages, 11 figures

Closest papers

Nearest neighbours by meaning across the whole index.

Reconstruction-Aware Cryo-EM Particle Picking

cs.CV q-bio.BM ·2026-08-28 ·Riku Itsuji, Yuanhao Wang, Xingjian Li, Seonghui Min, Hideo Saito +1 more
similarity 0.67
Abstract

Cryo-electron microscopy (cryo-EM) determines the structures of proteins and macromolecular assemblies at near-atomic resolution, and the final 3D reconstruction depends on extracting a clean particle stack from noisy micrographs. This extraction decomposes into three sub-tasks, namely particle picking, contamination removal, and 2D class selection. Each of them, however, is trained and evaluated in isolation, and none is optimized for the reconstruction. We instead integrate the three sub-tasks into a single pipeline posed against downstream reconstruction quality. We instantiate the pipeline with a state-of-the-art component for each sub-task, CryoTransformer picking permissively, MicrographCleaner masking contamination, and CryoSift selecting 2D classes by a continuous quality score, and close the loop with a fine-tuning step that returns the surviving particles to the picker. The pipeline achieves a better 3D resolution than every picker we compare. We also show that the best 2D F1 is not the best resolution, so particle selection is better treated as one reconstruction-aware pipeline judged by the map it delivers.

0.23

Learning the Shared Latent Structure of Cryo-EM Inverse Problems

cs.CV cs.LGq-bio.QM ·2026-10-15 ·Nithin Chalapathi, Theo Sternlieb, Ethan Han, Sonya M. Hanson, Pilar Cossio +2 more
similarity 0.66
Abstract

Understanding biomolecular function requires characterizing three-dimensional structure and conformational variability, for which cryogenic electron microscopy (cryo-EM) is a powerful tool. Cryo-EM produces noisy two-dimensional particle images in which molecular structure, particle pose, and imaging conditions are jointly encoded. Recovering biological information from these observations spans inverse problems including pose estimation, heterogeneity analysis, and reconstruction. These tasks are usually addressed independently despite shared protein structure and image formation, motivating a common representation across inverse problems. Since biologically meaningful differences may be spatially localized, we study self-distillation with complementary global and masked patch objectives. Because experimental dataset discrimination can reflect acquisition-specific cues, we develop controlled synthetic and experimental evaluations and find that structural discrimination benefits from dense spatial features. We introduce the EMber family of vision transformers, pre-trained on >50 million experimental particle images from 214 EMPIAR datasets together with simulated projections from 268,000 molecular assemblies. EMber improves upon existing methods at conformational and compositional discrimination by 14.85 and 14.26 percentage points, estimates conformational populations to within 1.59pp error with a linear probe, and produces particle assignments yielding reference-quality reconstructions in fewer epochs. We demonstrate how to learn representations that capture biological information for use across multiple cryo-EM inverse problems.

0.14

ARCHER: Amortized cross-specimen pose estimation for cryo-electron microscopy

cs.LG math-phq-bio.BMq-bio.QM ·2026-08-22 ·Nhan D. Nguyen, Bao Pham
published similarity 0.64
Abstract · 28 pages, 15 figures

Single-particle cryo-electron microscopy (cryo-EM) pose estimation is traditionally solved anew for each dataset, where iterative refinement is done from scratch while the estimator learns to store the molecule in its weights. In this work, we show that pose inference is a generalizable, specimen-agnostic operation when conditioned explicitly on a reference volume. We introduce ARCHER, an amortized contrastive classifier that models the pose posterior over a discrete rotation grid. Trained across a variety of protein structures, it operates zero-shot without retraining per structure. This transferability is grounded in Fourier-space information mechanics, where all specimen dependence is captured by the reference structure's power spectrum and spatial extent. ARCHER achieves a median angular error of 5.0° on 100 held-out test structures and 2.5° on experimental particles, matching dedicated estimators within 0.16 Å in 3D reconstruction. Crucially, downstream conformational signal is preserved. The leading conformational coordinate correlates at 0.97 with deposited benchmarks, faithfully reconstructing free-energy basins and mobile domains. These results overall demonstrate that cryo-EM pose estimation can be generalized across different structures.

0.41

Provable Method of Moments for Cryo-EM

eess.SP math.NA ·2026-10-13 ·Amnon Balanov, Tamir Bendory, Dan Edidin, Josh Katz, Shay Kreymer +1 more
similarity 0.64
Abstract

We study the recovery of a three-dimensional volume in single-particle cryo-electron microscopy (cryo-EM) from noisy tomographic projections acquired at unknown viewing rotations, drawn independently and uniformly from $\mathrm{SO}(3)$. We show that, in a spherical-shell representation satisfying an explicit shell-separation condition, the first three moments generically determine the underlying real volume up to its intrinsic global $\mathrm{O}(3)$ ambiguity. The proof is constructive and yields a frequency-marching procedure that successively recovers the volume. Consequently, consistent recovery in the high-noise regime has sample complexity $n=ω(σ^6)$, where $n$ is the number of observations and $σ^2$ is the noise variance. Numerical experiments validate the constructive recovery scheme under finite sampling and additive noise, and indicate that direct third-moment optimization can succeed beyond the structural assumptions required by the constructive proof.

0.31

CryoTracer: A Synthetic-to-Real System for Filament Instance Tracing in Cryo-EM

cs.CV ·2026-10-13 ·Radosław Kuczbański, Wojciech Kozłowski, Mateusz Grzesiuk, Konrad Karanowski, Lukas Frey +2 more
code/data similarity 0.62
Abstract

Particle picking in cryo-electron microscopy is commonly formulated as an object-detection problem in which individual particles are represented by bounding boxes, a natural representation for globular particles but a poor match for filaments that can extend across an entire micrograph. Existing methods reconstruct filament trajectories by linking local predictions in a separate post-processing stage, decoupling detection from instance formation and creating potential ambiguities at gaps and crossings. Directly preserving filament identity is particularly useful for polymorphic specimens, where segments originating from the same filament should remain associated. However, learning such instance-level representations is challenging because expert centerline annotations are scarce and costly to obtain. We introduce CryoTracer, a synthetic-to-real framework that addresses this limitation through procedural micrograph generation, transformer-based polyline prediction, and specimen-specific fine-tuning. Procedural pretraining exposes the model to diverse filament geometries, intersections, and imaging conditions before adaptation using a limited number of fully annotated experimental micrographs. CryoTracer represents filaments as ordered centerline polylines and optimizes their geometry using an orientation-invariant discrete Fréchet objective, enabling consistent learning regardless of tracing direction. Evaluation on established and newly expert-annotated datasets shows that CryoTracer improves instance-level filament recovery over existing particle-detection approaches. These results establish end-to-end polyline prediction as a practical alternative to detection-and-linking pipelines for recovering complete filament instances with limited micrograph annotation budgets. Code and data are available at https://github.com/cryotracer/cryotracer

0.32

Fold'EM: Direct atomic structure inference from Cryo-EM particles

cs.AI q-bio.BM ·2026-10-01 ·Advaith Maddipatla, Märt-Erik Mäeots, Marco Pegoraro, Nikolaus Dräger, Roberto Covino +3 more
similarity 0.61
Abstract

Single-particle cryo-electron microscopy (cryo-EM) has become a widely adopted technique for biomolecular structure determination. The conventional cryo-EM computational pipeline first combines many particle images to reconstruct an electrostatic potential (ESP) map and then fits an atomic model to the recovered map. Density reconstruction has high sample complexity, requiring large numbers of particle images and making structure determination high-cost and low-throughput, particularly for heterogeneous samples. Downstream atomic model building, in turn, becomes increasingly difficult as the resolution of the reconstructed map deteriorates. Protein structure prediction models provide strong sequence-derived priors on atomic structure, and experiment-guided approaches can use these priors to recover structures consistent with experimental measurements. Yet, in cryo-EM, such priors are typically integrated only after density reconstruction during atomic model fitting. We introduce Fold'EM, an inference-time framework that combines priors from protein generative models directly with cryo-EM particle images to determine atomic models from a small number of single particle images, bypassing both intermediate density reconstruction and downstream model building against the reconstructed map. Across synthetic and experimental cryo-EM datasets, Fold'EM recovers accurate atomic structures both with known particle orientations and in an ab-initio setting where orientations are inferred jointly with structure. In heterogeneous datasets, Fold'EM further resolves distinct conformational states from mixed particle populations without separately reconstructing a density map and building an atomic model for each state. We believe these results open new avenues for structure determination in the low-sample regime and for characterizing low-population conformational states directly from cryo-EM particles.

0.16

The microscope is the mask: privileged views and labels from a cryo-ET forward model

cs.CV cs.LGmath.OC ·2026-09-03 ·Bogdan Toader, Kiarash Jamali, Tanmay A. M. Bharat, Sjors H. W. Scheres
benchmark similarity 0.54
Abstract · 18 pages, 7 figures

We explore the use of simulated data for training a model for protein annotation in crowded cryo-electron tomography volumes reconstructed from images collected at limited tilt angles and severely corrupted by the measurement operator. Firstly, we leverage the corruptions imposed by the forward model to generate domain-specific augmented paired views of the exact same scene for an invariance objective integrated into the LeJEPA self-supervised training framework. Secondly, we use additional information from the simulation pipeline such as the positions and identity of proteins in the simulated volumes to inform the architecture of the model and the loss function, so that semantic information is localised at protein positions in the resulting dense feature volume. The resulting model, CARNIVAL, is evaluated without finetuning on classification and detection tasks in real tomograms, using a benchmark dataset containing multiple protein types and two tomogram processing types. We show that CARNIVAL outperforms a state-of-the-art model trained using a contrastive objective on simulated data but without forward model-based paired views or privileged information.

0.25

Matching Particle-Arrival Rates for Low-Count Image Denoising

eess.IV cs.CV ·2026-10-23 ·Huazhen Liu, Zipei Yan, Jizhou Li
similarity 0.54
Abstract

Low-count imaging arises when limited illumination or dose yields only a few detected particles in microscopy, such as photons or electrons, causing measurements to be dominated by signal-dependent Poisson shot noise. Supervised denoisers typically require paired clean and noisy observations, whereas many self-supervised approaches exploit spatial or temporal redundancy without directly estimating the underlying particle-arrival process. We introduce PARM, a self-supervised denoising framework based on particle-arrival-rate matching. By modeling particle accumulation over exposure as a Poisson counting process, PARM identifies the conditional particle-arrival-rate field with the posterior mean of the latent clean rate. Poisson thinning then splits each observation into complementary lower-exposure views that provide self-supervised rate targets for one another. In implementation, the network estimates the normalized spatial allocation of the conditional rate, while the observed total count determines its global particle mass. Experiments on synthetic data, natural-video sequences corrupted with Poisson noise, and real low-dose electron microscopy demonstrate leading or competitive performance while effectively preserving fine structures. PARM therefore provides a statistically grounded approach to low-count image denoising when clean references are unavailable.

0.19