CS Paper Radar

Universal Drift Correction for Multidimensional Scanning Microscopy

Sangjoon Lee, William Millsaps, Dasol Yoon, Caitlyn Obrero, Guoliang Hu, Corrie Barnes, Cedric Lim, Andrew Barnum, Arthur R. C. McCray, Colin Ophus

cs.CV cond-mat.mtrl-sci ·submitted 2026-09-25 06:17 UTC · v1
code/dataunusual

Abstract

In scanning microscopy, drift causes the specimen to be sampled at positions displaced from the nominal probe positions. This displacement alters the spatial assignment of the recorded signals and biases quantitative measurements across two-dimensional imaging, channel-resolved spectroscopic mapping, and scan-position-resolved diffraction analysis. Here, we extend orthogonal-scan drift correction from 2D images to spectrum images and diffraction datasets. We demonstrate how to recover probe positions using either differently oriented multidimensional scans or structural reference images. The recovered positions are used either to resample the multidimensional data onto a regular grid or to assign each recorded signal to its corrected coordinate. Our method combines affine and non-rigid correction, requires no prior structural model, and is implemented as open-source, GPU-accelerated software that reduces processing times by two to three orders of magnitude, enabling routine and automated drift correction for quantitative multidimensional microscopy.

Closest papers

Nearest neighbours by meaning across the whole index.

A benchmark dataset and baseline methods for four-dimensional STEM diffraction patterns

cs.CV ·2026-09-18 ·Yuyan Guan, Haoran Zhang, Zian Mao, Antong Yang, Caifei Li +5 more
benchmarkcode/data similarity 0.56
Abstract · 16 pages, 5 figures. Data and trained model weights: https://doi.org/10.57760/sciencedb.nbsdc.00281. Code: https://github.com/Gaiya69-rgb/4D…

Four-dimensional scanning transmission electron microscopy (4D-STEM) records a two-dimensional diffraction pattern at each electron-probe position, yielding spatially resolved reciprocal-space information but large, heterogeneous data volumes. Here we describe 4D-ImageNet, a collection of 174,000 diffraction patterns comprising 145,000 experimental patterns selected from 29 acquisitions and 29,000 multislice simulations. The experimental data cover acquisition-level labels for Ag, Au, mixed Au-Ag, CoO, Pd and ZnO specimens across multiple fields of view, scan dimensions, camera lengths and exposure times. Each acquisition contributes 5,000 quality-ranked patterns with source scan coordinates and acquisition metadata. A set-prediction detector provides model-derived pseudo-labels for the direct-beam position and Bragg-disk centres, with a confidence score for each disk. The simulation data cover 13 crystal structures and include Euler rotations, reciprocal-space sampling and approximate low-index beam directions. A grouped mixed-domain masked-reconstruction benchmark is provided to assess leakage-resistant loading and evaluation across experimental and simulated data. The dataset is intended for representation learning, disk detection, diffraction-pattern retrieval, orientation analysis and simulation-to-experiment studies.

0.41

Real-Time Atomic-Resolution Electron Phase Imaging without Probe Calibration via Ptychography-Supervised Learning

cs.CV cond-mat.mtrl-sci ·2026-09-22 ·H. Yue, C. -C. Chen, C. -N. Hsiao, J. Cheng, Y. Liu +2 more
similarity 0.54
Abstract · Submitted to Advanced Science on June 18, 2026

Atomic-scale phase imaging is central to resolving defects, interfaces, and weakly scattering atoms that govern the behavior of nanoscale materials. Electron ptychography delivers sub-ångström phase sensitivity but remains an offline technique, because its iterative reconstruction is computationally expensive and sensitive to experimental calibration, preventing live use during data acquisition. Here, a ptychography-supervised local inference framework is presented that converts four-dimensional scanning transmission electron microscopy (4D-STEM) into an acquisition-compatible phase-imaging workflow. Physics-constrained reference phase maps reconstructed from a single experimental AuPd dataset serve as teacher labels for a compact model that predicts local phase patches directly from diffraction measurements, without explicit probe input or online iterative optimization. Full-field images are assembled by deterministic overlap stitching. The workflow reaches an online latency of about 0.27 ms per probe position and a throughput of about 20,000 positions per second, an approximately 1,000-fold speed-up over GPU-accelerated ePIE, while preserving atomic-scale lattice contrast and reciprocal-space fidelity. Without fine-tuning, the same model transfers across materials (WS2), defocus conditions (high-entropy alloy nanoparticles), and instruments (hBN at 300 kV). The approach amortizes ptychographic redundancy into a fast, generalizable workflow that enables real-time atomic-scale phase imaging for materials microscopy.

0.14

High-resolution retinal matrix imaging via computational motion and aberration correction

eess.IV physics.opticsphysics.app-phphysics.med-ph ·2026-10-13 ·Aymeric Melt, Léo Puyo, Victor Barolle, Claude Boccara, Gereon Hüttmann +1 more
unusual similarity 0.54
Abstract · 46 pages, 9 figures

High-resolution optical imaging of the human retina is essential for diagnosing ophthalmic and neurodegenerative diseases. While adaptive optics combined with coherence gating can resolve retinal structures at the cellular scale, it requires complex, costly, and cumbersome hardware to physically correct for ocular aberrations and motion. Matrix imaging offers a powerful digital alternative by leveraging wave linearity to undo aberrations and multiple scattering; however, its in vivo deployment has been hindered by continuous, involuntary eye movements that destroy phase coherence during acquisition. Here, we overcome this fundamental barrier and demonstrate the first in vivo reflection matrix imaging of the human retina using an ultra-simplified optical setup without physical correctors. We introduce a fully computational framework that tracks and compensates for multi-axial ocular motion directly from raw interferometric data, thereby restoring the phase coherence of a multi-spectral distortion matrix. This enables local, high-order aberration correction to achieve diffraction-limited, volumetric imaging of retinal tissues. By shifting the hardware burden to physics-guided numerical computation, this paradigm opens the way for accessible, non-invasive, and high-resolution digital ophthalmology.

0.25

Multitask Scanning Probe Microscopy

cs.LG cond-mat.mtrl-sciphysics.ins-det ·2026-08-10 ·Aditya Raghavan, Yu Liu, Ian Mercer, JP Maria, Sergei Kalinin
similarity 0.52
Abstract

Scanning probe microscopy provides nanoscale access to structural, electrical, electromechanical, magnetic, and mechanical properties of materials. Its increasing use for wafer-scale characterization and combinatorial materials exploration creates a need to distribute measurements efficiently across large spatial domains. This is particularly important when available modalities differ in acquisition time and potential for tip and sample damage, making exhaustive multimodal mapping over spatial grids impractical. Here, we demonstrate multitask scanning probe microscopy, a live, closed-loop workflow in which a multitask Gaussian process learns spatial and cross-modal relationships and autonomously selects both the next measurement location and the next experimental protocol. The approach is implemented on an automated large-sample atomic force microscope and demonstrated on a composition-spread AlScN wafer using tapping-mode and Dual AC Resonance Tracking (DART) measurements. Paired initial measurements establish the relation between the tasks, after which noncoincident measurements are used to update both response landscapes. The resulting workflow extends active learning in scanning probe microscopy from spatial sampling to autonomous allocation of measurement modalities and provides a basis for combining rapid, weakly perturbative imaging with slower contact, electrical, electromechanical, magnetic, or spectroscopic measurements.

0.04

Progressive Coupling Method for Diffusion Posterior Sampling in Ptychography

cs.LG ·2026-10-28 ·Yihan Qiu, Mingtao Huang, Tianyuan Li, Shudong Li, Yuan Shen
similarity 0.52
Abstract

Ptychography is a computational imaging method that reconstructs a sample from overlapping diffraction measurements. This technique relies on these overlapping measurements to provide the redundancy information needed for robust reconstruction, but dense scanning increases acquisition time and data volume. Reducing scan overlaps can improve measurement efficiency but weakens the physical constraints available for reconstruction. Diffusion models provide strong learned prior information, offering a promising approach to compensate for the loss of measurement redundancy. However, effectively utilizing this prior information under weak measurement constraints remains a challenge. We propose a progressive coupling posterior sampling (PCPS) method, which allows for a broader exploration of the solution space under high uncertainty while maintaining stronger diffusion-guided consistency as the reconstruction becomes more refined. Experiments on real X-ray ptychographic data at various scan overlaps demonstrate that PCPS consistently improves reconstruction accuracy compared to traditional iterative methods and existing diffusion posterior samplers, especially at low overlaps. These results show that diffusion priors can reduce the measurement redundancy required for accurate ptychography reconstruction.

0.24

Physics-Informed Sequential Reconstruction of Scanning Probe Microscopy Images with Calibrated Uncertainty

eess.IV ·2026-09-09 ·Surya Prakash Reddy, Sergei V. Kalinin
similarity 0.52
Abstract

Scanning probe microscopy (SPM) has become a mainstay of materials science, condensed matter physics, nanotechnology, biology, and semiconductor metrology. An SPM image, however, is acquired sequentially as the probe traverses the surface under closed-loop feedback while thermal drift, feedback dynamics, tip state, mechanical disturbances, and electronic noise evolve during the experiment. Image correction has therefore become an intrinsic part of SPM data analysis. Classical approaches rely on line leveling, filtering, registration, interpolation, and explicit models of tip or scanner distortions, whereas recent work increasingly uses neural networks trained to map corrupted images to corrected ones. Here, we explore a different formulation in which SPM reconstruction is treated as a Bayesian sequential state-estimation problem. The hidden state represents surface height and its low-order evolution along the slow-scan direction; an artifact-dependent quality score continuously modifies the observation likelihood; a forward Kalman pass provides the causal estimate and innovation diagnostics; and a Rauch-Tung-Striebel (RTS) backward pass incorporates information from the complete acquisition. The result is a reconstructed surface, a relative posterior uncertainty map, and line-resolved diagnostic signals. The recursion is computationally lightweight and scales linearly with the number of image pixels, while the physical parameters can in principle be initialized from instrument characterization or from priors learned during previous operation, an extension not exercised here. We organize the method as a multi-axis family of models so that the contributions of state representation, artifact recognition, lateral coupling, and acquisition redundancy can be evaluated independently.

0.29

A Digital Simulation Toolkit for Physics-Based Generation of Realistic Experimental Scanning Tunneling Microscopy Images

cs.LG cond-mat.mtrl-sci ·2026-09-29 ·Huanhuan Zhao, Laxmi Bhurtel, Connor Vernachio, Fahmy Paiziah, Wonhee Ko +1 more
similarity 0.51
Abstract · 17 pages, 6 figures in main text and 2 supplementary figures

Scanning Tunneling Microscopy (STM) is a widely used tool for characterizing surfaces of materials at the atomic scale, playing a crucial role in discoveries across condensed matter physics and materials science. Despite its extreme spatial resolution, STM is one of the most sensitive microscopy techniques and is highly prone to noise. While existing unsupervised denoising methods are very cheap to train, these are primarily focused on removing the noise with minimal recovery of key physical information. While supervised methods can offer superior performance, the major bottleneck is that a large amount of paired clean-noisy experimental images is required which are impractical to obtain. Thus, we developed a low-cost physics-driven digital toolkit to rapidly generate large volume of realistic STM images. Firstly, we simulate clean images from a chosen material system. Then, with prior knowledge of the physical characteristics of the artifacts and noise present in STM experiments, we formulate several artifact-noise functions such as Gaussian electronic noise, 1/f flicker noise, scan-line noise, background tilt and mechanical drift. These physically informed noise components are then added to the simulated clean images to generate realistic STM images. We demonstrated the capability of the proposed digital toolkit to generate AI-ready data for denoising images of the (111) surfaces of copper and lead, while preserving atoms, defects, and electron waves. We also validated the quality of the downstream image analysis of learning electron wave patterns induced by quantum interference from Cu(111) images. Results show that the supervised models trained on digitally generated AI-ready data can more effectively denoise and learn electron wave patterns on Cu(111) images than benchmarked unsupervised approaches, indicating that the proposed toolkit facilitate scientific discovery.

0.26

ARCHER: Amortized cross-specimen pose estimation for cryo-electron microscopy

cs.LG math-phq-bio.BMq-bio.QM ·2026-08-22 ·Nhan D. Nguyen, Bao Pham
published similarity 0.51
Abstract · 28 pages, 15 figures

Single-particle cryo-electron microscopy (cryo-EM) pose estimation is traditionally solved anew for each dataset, where iterative refinement is done from scratch while the estimator learns to store the molecule in its weights. In this work, we show that pose inference is a generalizable, specimen-agnostic operation when conditioned explicitly on a reference volume. We introduce ARCHER, an amortized contrastive classifier that models the pose posterior over a discrete rotation grid. Trained across a variety of protein structures, it operates zero-shot without retraining per structure. This transferability is grounded in Fourier-space information mechanics, where all specimen dependence is captured by the reference structure's power spectrum and spatial extent. ARCHER achieves a median angular error of 5.0° on 100 held-out test structures and 2.5° on experimental particles, matching dedicated estimators within 0.16 Å in 3D reconstruction. Crucially, downstream conformational signal is preserved. The leading conformational coordinate correlates at 0.97 with deposited benchmarks, faithfully reconstructing free-energy basins and mobile domains. These results overall demonstrate that cryo-EM pose estimation can be generalized across different structures.

0.41