CS Paper Radar

Acquisition Geometry-Assisted Whole-Group Localization of X-ray Fluorescence Maps in Optical Microscopy Images

Xiangyu Yin, Tatjana Paunesku, Letonia Copeland-Hardin, Martina Ralle, Zichao Wendy Di, Si Chen, Gayle E. Woloschak, Barry Lai, Mathew J. Cherukara, Stefan Vogt

cs.CV ·submitted 2026-08-18 20:33 UTC · v1
unusual

Abstract

X-ray fluorescence (XRF) microscopy maps elemental distributions, while optical microscopy can provide complementary morphological context. Localizing XRF fields of view (FOVs) in optical images is difficult because the two modalities differ in contrast mechanism and resolution. Most current workflows place each XRF tile independently, even when acquisition metadata already record the tiles' relative scan positions. This study formalizes XRF tile-group localization, in which one optical-frame placement is estimated for the whole group, constrained by acquisition geometry and quantified using group intersection-over-union (GroupIoU). In a controlled case study, independent localization failed with GroupIoU 0.000, whereas group localization achieved 0.931. Replacing the normalized cross-correlation (NCC) metric with mutual information (MI) gave nearly identical results, showing that the outcome is not specific to one local similarity metric. In another multiscale case study, using a coarse XRF survey scan to connect the fine-scale tile group to the optical image increased mean GroupIoU from 0.694 to 0.856. These case studies support using acquisition geometry as an explicit constraint when localizing related XRF tiles.

Closest papers

Nearest neighbours by meaning across the whole index.

XRF-to-Optical Field-of-View Localization with Vision Language Models

cs.CV ·2026-08-18 ·Xiangyu Yin, Tatjana Paunesku, Letonia Copeland-Hardin, Martina Ralle, Zichao Wendy Di +5 more
similarity 0.68
Abstract

Registering images acquired with different microscopy modalities is essential for relating complementary measurements of the same specimen. In correlative X-ray fluorescence (XRF) and optical microscopy, the XRF map often covers only a small region of an optical image acquired from the same or an adjacent tissue section. Field-of-view (FOV) localization is necessary but can be difficult when appearance and structure differ across modalities. Here we evaluate training-free vision language model (VLM) localization on two datasets representing same-section high-correspondence and adjacent-section low-correspondence imaging. We test unconstrained and metadata-constrained search and compare VLMs with geometric controls, classical template matching, and two alternative training-free approaches (DINOv2 and multiGradICON). Direct VLM prompting produced content-dependent spatial signals but was not reliable alone. Classical matching was most accurate when cross-modal structure was preserved but failed in the low-correspondence collection. A proposal-and-verify workflow used repeated VLM predictions as candidates and image-based similarity to select the final location. This workflow recovered useful localization in the low-correspondence regime.

0.25

Overlapping Visual Grouping Without Semantic Priors

cs.CV ·2026-09-23 ·Teemu Saukkio, Hashem Haghbayan, Juha Plosila
similarity 0.52
Abstract · 39 pages, 13 figures

Most computer-vision systems organize visual input toward a predefined interpretation, such as semantic categories, prompted regions, learned object-like representations, or a single spatial partition. This work considers an earlier stage of visual organization: the formation of candidate perceptual units directly from sensor measurements before their identity, meaning, or task relevance is known. We introduce Domain Parent Grouping (DPG), a sensor-grounded grouping method in which complementary measurement relationships are represented in separate processing domains. Spatially connected groups formed within these domains are related through cross-domain overlap, yielding a non-exclusive grouping representation rather than a single mutually exclusive segmentation. This representation retains broader and more localized groups, as well as alternative grouping boundaries over the same image locations, simultaneously available. DPG also includes a native mechanism for reprocessing selected group content, in which input-relative measurement ranges allow the observational resolution to change while preserving previously formed groups. DPG is implemented using three domains representing locally contextualized luminance, direct chromatic relationships, and contextual chromatic relationships. Experiments on the BSDS500 dataset demonstrate the benefit of combining the three domains. The results further show that DPG forms measurement-supported groups corresponding to low-level image structure, and that these groups exhibit measurable correspondence with human-annotated regions and boundaries. This demonstrates that structured visual organization can emerge directly from relationships among sensor measurements.

0.29

Junction Geometry Survives an Unidentifiable Blur

cs.CV physics.ins-det ·2026-09-30 ·Sohail, Sarkar, Shakuntala Baichoo
unusual similarity 0.52
Abstract · 37 pages, 13 figures, 11 tables

Thin filaments cross in microscopy, and dispersed spectra cross on X-ray detectors. At a junction, where these structures cross or branch, how many straight arms meet, and which way do they go? Unknown blur obscures the answer. At a balanced crossing, distinct Gaussian blurs can even produce the same observation law. We show that the arms can still be recovered. For separated rays of nonvanishing weight and an unknown centered Gaussian-mixture blur, a distance combining arm count, directions, relative weights and supporting lines is bounded by a constant times the Euclidean difference in cell probabilities on a sufficiently fine fixed grid. The bound is uniform over a bounded model class, including unidentifiable blurs. From $n$ positions or photon counts, the minimax error is of order $n^{-1/2}$. This rate is proved for a global estimator. In practice we fit rays and blur by constrained local likelihood, reducing the BIC count when two detectors agree on fewer arms in the microscopy studies. Across three studies with protocols fixed before evaluation, on 360 crossings and branches assembled from measured single-molecule localizations, the fit gets the arm count and every direction within $10^\circ$ 24 to 37 percentage points more often than a tuned fixed-scale Hessian ridge detector, averaged over 25 to 400 localizations. On acute angles with correct counts, mean absolute error is $3.5^\circ$ to $4.3^\circ$, versus $10.4^\circ$ to $15.5^\circ$. On Chandra spectra, 38 of 90 fits at 800 photons find all four arms within $10^\circ$; among these, median error is $0.023^\circ$.

0.29

Micro-Localization: High-Precision Mobile Robot Localization Using Microscopic Ground Texture

cs.RO cs.CV ·2026-10-15 ·Aaron Wilhelm, Marina de Albuquerque Marcon, Emith Uyanwatte, Nils Napp
similarity 0.51
Abstract

We demonstrate high-precision global localization using natural ground texture viewed through microscope optics, achieving localization in the tens-of-micrometers regime. For the planar ground texture localization problem considered here, we relate optical magnification and image-space localization uncertainty to physical localization precision. Leveraging this relationship, we then develop a microscope-based localization system that addresses the calibration, camera-modeling, and focus challenges introduced by high-magnification imaging. We evaluate this system across several surface textures using a calibrated precision gantry. Across 1,007 held-out queries per surface, the system localizes every query and achieves translation RMSEs of 28$-$73 $μ$m. Independent photometric registration agrees with the feature-based localization estimates to within approximately 9 $μ$m RMSE. We further demonstrate localization on a low-cost mobile robot using the gantry-collected maps, and also show that the system can resolve micrometer-scale displacement caused by thermal expansion. These results show that microscopic natural surface texture can bring mobile localization into a precision regime typically associated with fixed positioning systems.

0.20

Cross-polarization pairing for label-free few-shot thin-section classification

cs.CV ·2026-10-17 ·Bingchen Yan
unusual similarity 0.48
Abstract

Few-shot classifiers of rock thin sections are meta-trained on many rock types that a petrographer has identified slide by slide, and this identification is the costly step that new collections lack. We study few-shot recognition of unseen rock types when no training slide is identified, and the only information available is what the microscope records anyway: which slide an image comes from, and whether it was taken in plane-polarized (PPL) or cross-polarized (XPL) light. We first show why generic unsupervised pseudo-tasks fit this setting poorly: the positives they find without labels are either wrong or near-duplicates of the anchor, so they teach the model little. Polarized-light microscopy provides positives that avoid both problems. The PPL and XPL views of one field show the same grains, so they are correct by construction, yet they look very different. We propose cross-polarization pairing (XPP), which treats each slide as a pseudo-class and pairs its PPL and XPL views of the same field location, so that matching must rely on grain shape and texture rather than on colour. On the Nanjing University collection of 108 rock types, with support and query images taken from different slides, XPP is the best label-free method on average over three random splits, and matches a supervised model trained on 78 identified rock types. Controls show that colour augmentation and other acquisition positives do not reproduce the gain. We also show that the image-level protocol of earlier work is saturated, and propose a cross-slide protocol in its place.

0.22

Beyond Local Refinement: Wide-Area Precise Cross-View Localization

cs.CV ·2026-11-03 ·Qingguo Hu, Xinyu Ma, Yujie Lin, Yaoxiang Wang, Qi Shi +3 more
benchmarkcode/data similarity 0.47
Abstract · Project page: https://qghuxmu.github.io/RingMatch/

Fine-grained cross-view localization aims to precisely localize a ground camera against geo-referenced aerial imagery, but current methods typically assume a narrow geographic prior, substantially limiting their applicability when upstream localization remains coarse. To bridge this gap, we study this task over much larger aerial regions. However, this seemingly simple extension fundamentally changes the localization problem: the growing disparity in spatial extent between ground and aerial views makes reliable cross-view matching difficult to establish directly, while the increasing number of look-alike locations in larger regions introduces substantial visual ambiguity. To address these challenges, we propose RingMatch, a search-and-verification framework for wide-area cross-view localization. RingMatch first leverages predictive uncertainty to uncover plausible locations and progressively zooms into their surroundings to obtain increasingly fine-grained evidence, yielding a compact set of promising candidates. We then introduce the depth ring, a novel geometric representation that reveals subtle variations in the spatial layout around a location and serves as a view-shared spatial signature for an LVLM verifier to resolve residual ambiguity. To benchmark this setting, we construct VIGOR-Pro by composing VIGOR aerial tiles into contiguous regions with spatial extents of up to 400 m. Experiments show that RingMatch maintains strong localization performance as the aerial region expands, consistently outperforming representative end-to-end and retrieval-based methods.

0.28

X$^2$Localizer: Cross-grained Alignment for Progressive Cross-view Video Geo-localization

cs.CV cs.AIcs.RO ·2026-08-17 ·Zichao Zeng, Weijia Fan, Yufan Chen, June Moh Goo, Junwei Zheng +5 more
publishedbenchmark similarity 0.46
Abstract · Accepted to The 37th British Machine Vision Conference (BMVC 2026)

Cross-view Video Geo-localization (CVG) aims to localize ground-view videos by retrieving their corresponding geo-tagged aerial images. However, CVG approaches rely on fixed-length inputs and post-hoc refinement, hindering online-oriented localization under partial or dynamic observations. In this work, we formulate Progressive Cross-view Video Geo-localization (PCVG) as a deployment-oriented extension and evaluation protocol of CVG, enabling localization under varying temporal budgets, prefix-based inference, random-start evaluation, and long-range localization with interruptions. To explore PCVG, we introduce X$^2$Localizer, a cross-grained alignment framework that jointly supervises global prefix-to-aerial retrieval and token-aggregated frame--aerial-tile matching with a budget-dependent asymmetric objective. Furthermore, we introduce a Sliding-Window Re-Localization (SWRL) strategy that dynamically refreshes candidate regions for failure recovery and long-range deployment without full-sequence reprocessing. Extensive experiments show that X$^2$Localizer preserves conventional full-video performance, with marginal gains of +0.1 Recall@1 and +0.3 Recall@10, while substantially improving early localization. In the challenging single-frame setting, X$^2$Localizer improves coarse retrieval by +4.7 Recall@1 and +11.5 Recall@10 over the previous state-of-the-art method. With SWRL, our approach further enables robust progressive localization under random-start and long-distance scenarios, narrowing the gap between benchmark evaluation and real-world deployment.

0.49

Multiscale Closing Index (MCI) for measuring structural similarity between 2D point sets

cs.CG math.MGcs.CV ·2026-11-06 ·Nicolò Zava, Angel Franco-Alvarez, Samy Blusseau, Santiago Velasco-Forero, Maria-Jose Jimenez
similarity 0.46
Abstract

We introduce Multi-scale Closing Index (MCI), a new dissimilarity measure for evaluating the alignment of two 2D point sets. MCI is bounded between 0 and 1 and is based on multiscale mathematical morphology operations, with smaller values indicating greater structural agreement. The measure was motivated by the need to assess the quality of registration between point sets representing cell populations in biological images. To evaluate its behaviour under controlled conditions, we generated synthetic point clouds from Perlin-noise-based spatial structures, following established approaches for simulating biologically plausible spatial organization. We assessed MCI between those point clouds and different transformed versions, obtained by local perturbation, point removal, translation, rotation and addition of impulsive noise. Across these experiments, the dissimilarity MCI increased gradually and consistently with perturbation severity, while showing a clear discontinuity between clouds originating from the same underlying spatial structure and point clouds generated from different structures. We further compared MCI with commonly used point-set distances, including Hausdorff-based measures and Sliced Wasserstein distance. These experiments show the ability of MCI to capture structural agreement and quantify deviations between point sets, highlighting its potential as a complementary metric for evaluating two-dimensional point-set registration.

0.22