CS Paper Radar

Evaluating classification and explainability in multimodal petrographic image analysis

Thomas James Wood, Oktay Karakuş, Can Eyüpoğlu

cs.AI cs.CV ·submitted 2026-11-07 00:02 UTC · v1

Abstract

Automated thin-section classifiers increasingly combine plane-polarised and cross-polarised light (PPL and XPL), two complementary views central to petrographic identification. Classification accuracy alone does not reveal whether model errors reflect mineralogical relationships, how predictions depend on each optical view, or whether attribution maps identify regions that influence model decisions. Here, we examine these complementary aspects of the released LITHOS dual-stream vision transformer using outputs from an earlier evaluation of 105,802 expert-annotated grains across 25 categories. Classification errors frequently followed the label taxonomy: 72.6\% of misclassified plagioclase, microcline and sanidine grains were assigned the generic Feldspar label, while 87.1\% of quartz-family grains received a label within that family, compared with 66.6\% assigned their exact label. Replacing the XPL input with its per-channel spatial means produced a greater reduction in true-class probability than equivalent PPL replacement in 20 of 25 categories, but not in the three quartz categories. Five explainable artificial intelligence (XAI) attribution procedures generated visually distinct maps for identical inputs. In a superpixel-deletion analysis involving 30 grains from 29 thin sections, method-minus-random contrasts ranged from $-0.043$ to $0.057$, with all 41 simultaneous 95\% confidence intervals including zero. Together, these findings show that error structure, modality sensitivity and attribution behaviour capture distinct aspects of model performance that cannot be established from classification accuracy or visual inspection of attribution maps alone.

Closest papers

Nearest neighbours by meaning across the whole index.

Cross-polarization pairing for label-free few-shot thin-section classification

cs.CV ·2026-10-17 ·Bingchen Yan
unusual similarity 0.59
Abstract

Few-shot classifiers of rock thin sections are meta-trained on many rock types that a petrographer has identified slide by slide, and this identification is the costly step that new collections lack. We study few-shot recognition of unseen rock types when no training slide is identified, and the only information available is what the microscope records anyway: which slide an image comes from, and whether it was taken in plane-polarized (PPL) or cross-polarized (XPL) light. We first show why generic unsupervised pseudo-tasks fit this setting poorly: the positives they find without labels are either wrong or near-duplicates of the anchor, so they teach the model little. Polarized-light microscopy provides positives that avoid both problems. The PPL and XPL views of one field show the same grains, so they are correct by construction, yet they look very different. We propose cross-polarization pairing (XPP), which treats each slide as a pseudo-class and pairs its PPL and XPL views of the same field location, so that matching must rely on grain shape and texture rather than on colour. On the Nanjing University collection of 108 rock types, with support and query images taken from different slides, XPP is the best label-free method on average over three random splits, and matches a supervised model trained on 78 identified rock types. Controls show that colour augmentation and other acquisition positives do not reproduce the gain. We also show that the image-level protocol of earlier work is saturated, and propose a cross-slide protocol in its place.

0.22

Automated binary classification of hazelnut X-ray images: A deep-learning benchmark for quality assessment

cs.CV cs.LGphysics.app-ph ·2026-08-12 ·Giancarlo Sportelli, Nicola Belcari, Roberta Pace, Umberto Bernardo, Sharmin Sultana +2 more
benchmarkcode/data similarity 0.56
Abstract · 26 pages (including 5 pages of supplementary material), 4 figures, 5 tables. Dataset available at https://doi.org/10.5281/zenodo.21739932

Non-destructive X-ray imaging can reveal internal hazelnut defects that are difficult to detect by external inspection alone; however, automated interpretation remains challenging because of subtle radiographic differences among classes, marked class imbalance, and limited annotated data. Here, we present a benchmark for binary hazelnut quality classification (healthy versus defective) based on 799 segmented single-kernel X-ray images (224 x 224 pixels, grayscale), grouped into 101 acquisition units. Seven single-model configurations and ten probability-aggregation ensembles were evaluated using a group-wise split-rotation protocol across five data splits generated using different random seeds. Decision thresholds were selected on the validation set, and performance was assessed deterministically on validation and test sets. Under the expert-reassessed annotation condition, the average-probability ensemble of the binary cross-entropy-trained convolutional neural network and frozen Swin Transformer achieved the highest mean balanced accuracy (86.3% +/- 1.8%, five seeds), with several other ensembles providing comparable performance. Across methods, substantial split-to-split variability was observed, indicating that multi-split evaluation is essential for reliable model comparison at this dataset scale. Expert reassessment of ambiguous samples improved the performance of all 17 evaluated methods by 2.8-8.1 percentage points, while having only a limited effect on cross-split variance. The results highlight both the potential of deep learning for automated X-ray-based hazelnut quality assessment and the importance of rigorous evaluation and label curation in small, imbalanced agricultural imaging datasets.

0.26

Minerals in the Wild: A Hyperspectral-XRF Dataset for Elemental Composition Estimation

cs.CV cs.LG ·2026-08-31 ·Eleftheria Tetoula-Tsonga, George Arvanitakis, Theodoros Giannakas
dataset similarity 0.56
Abstract

Rapid mineral characterization is essential for applications ranging from mineral exploration to industrial ore processing. To this end, Hyperspectral Imaging (HSI) has emerged as a promising sensing modality thanks to its fine spectral resolution, enabling mineral discrimination in both close-range and remote sensing settings. However, the scarcity of publicly available datasets with reliable ground-truth labels hinders the development and evaluation of HSI-based mineral identification methods. We release Minerals in the Wild, a multi-purpose dataset comprising 1,132 rock specimens collected across Europe. For each specimen, we provide an HSI acquisition together with an elemental characterization obtained via an XRF sensor. We define the task of elemental characterization on our dataset and propose a pruning mechanism that removes distant signatures from the USGS dictionary prior to a convex optimization approach for matching HSI pixels with USGS spectral signatures. Finally, we empirically show that our approach outperforms simpler baselines.

0.56

X-LIBS: Interpretable Soil Classification Using Explainable AI and Laser-Induced Breakdown Spectroscopy

eess.SP ·2026-09-19 ·Yingchao Huang, Xin Wang
similarity 0.54
Abstract

Machine learning (ML) has emerged as a powerful tool for soil analysis using Laser-Induced Breakdown Spectroscopy (LIBS). However, traditional black-box models often lack interpretability, limiting their effectiveness in decision-making processes. This study introduced explainable AI (XAI) techniques to enhance both the interpretability and classification performance of Partial Least Squares Discriminant Analysis (PLS-DA) models for soil classification with LIBS. Local Interpretable Model-agnostic Explanations (LIME) was employed to identify the local spectral features associated with soil elements, providing explanations for their contributions to classification outcomes. To improve classification performance on unlabeled spectra, prediction uncertainty was quantified by sequentially removing the top local spectral features identified by LIME as critical to the classification. Higher uncertainty was associated with a smaller number of feature removals needed to change the label. Spectra for which a large number of features had to be removed before the label changed were treated as high-confidence predictions and admitted to a co-training process. Thresholds on this flip count were defined separately for spectrally ambiguous and stable classes to manage uncertainty identification effectively. To address the sensitivity of PLS-DA to class imbalances, equal proportions of pseudo-labels from each class were included in co-training. The proposed method was evaluated on the publicly available EMSLIBS dataset, achieving a test accuracy of 92.69\%, competitive with the best-performing methods in the literature. The XAI results provided insights into the causes of misclassifications and identified the dominant spectral features critical for accurate predictions, advancing interpretable AI solutions for LIBS-based soil analysis.

0.23

Expert lithological labels do not improve learning when used to predict marine sediment properties

cs.AI physics.geo-ph ·2026-10-26 ·John M. Aiken, William Gilpin, Thorsten W. Becker
similarity 0.54
Abstract

Scientific drilling has produced large archives of physical, chemical and magnetic measurements linked to descriptions of the rock recovered. These archives are mostly incomplete: instruments sample at different intervals, recovery is partial, and destructive analyses preclude later measurement of the same material. We train an self-supervised embedding model on the LILY ocean drilling database using six routinely logged properties (bulk density, magnetic susceptibility, natural gamma radiation, and red, green and blue reflectance) across 236,963 observations from 296 boreholes, with a masked variational autoencoder that has a heteroscedastic Gaussian decoder and learnable mask tokens. The embeddings separate geologist-assigned lithologies as well as a variant trained with those labels, and increasing the weight on the labels degrades reconstruction while leaving classification unchanged. The labels are recoverable from the measurements geologists use to assign them, so training on them adds nothing. Lithological categories compress continuous measurements into classes, and compressing them discards what the measurements record about the processes that produced the rock. The embeddings also predict physical properties that were absent from training, on boreholes the model has never seen. While depth should account for this since sediments compact with burial, it does not. On held-out boreholes depth alone reaches a median $R^2$ of -0.02, against 0.20 for the embedding.

0.32

On the Benefits of Uncertainty Estimation for Species Classification: A Case Study on Optimizing Expert re-Annotation

cs.AI cs.CV ·2026-10-19 ·Kamenan N'Gadi, Martin Laviale, C{é}dric Pradalier, J{é}r{é}my Fix
publishedcode/data similarity 0.54
Abstract

Automated identification of diatoms from microscopic images is a cornerstone of large-scale freshwater biomonitoring, yet the high diversity of species and strong class imbalance pose significant challenges for reliable classification. In this study, we develop a ResNet-18 baseline for a 759-class diatom dataset and investigate how calibrated confidence estimates support selective classification to reduce expert workload without sacrificing taxonomic integrity. While the initial model exhibits overconfidence with an Expected Calibration Error (ECE) of 0.117, post-hoc temperature scaling (T = 2.12) dramatically improves reliability, lowering the ECE to 0.055.By leveraging these calibrated probabilities within a triage framework, we demonstrate that a Selective Macro-F1 score of 99.01% can be maintained at 66.2% coverage (rejection threshold $τ$ = 0.934). Qualitative analysis reveals that the system effectively functions as an intelligent filter, consistently deferring rare taxa-such as AAMB and AASI-and ambiguous morphologies for expert review. Our findings, supported by the torch-uncertainty framework, highlight the potential of simple calibration techniques to make automated diatom identification practical and robust, prioritizing the preservation of rare species metrics essential for ecological assessment. To support reproducibility, our code, environment specifications, and calibration results are available anonymously at https://anonymous.4open. science/r/greenprwksp-B53D/README.

0.47

Simulated petrological labels enable probabilistic mineralogy prediction from whole-rock geochemistry

cs.LG ·2026-10-27 ·Matthew J. Liu, Aaron D. Kaplan, Michael L. Whittaker, Kristin A. Persson
similarity 0.54
Abstract

Modal mineralogy, the mineral identities and abundances in rocks, guides geological studies and industrial resource extraction. While measuring modal mineralogy is time-intensive, whole-rock chemical measurements furnish elemental concentrations at higher throughput. Predicting mineralogy from elemental data, however, poses a one-to-many inverse problem, and labeled mineralogical datasets are too sparse to train on at scale. We address both challenges by simulating petrological labels that express multiple formation conditions per composition and at a scale unattainable by measurements. Nearly one million simulated labels supervise the middle component of a three-part model: a transformer encoder self-supervised on roughly 788,000 whole-rock compositions, the simulation-trained heads that predict distributions over mineral assemblages, and a recalibration layer that aligns the predictions with measured mineralogy. Zero-shot on 640 volcanic rocks, the model discriminates the presence of most mineral categories and predicts which rocks are richer in each mineral. However, the predicted abundances are systematically offset from measured values. Recalibration fit on as few as 25 labeled rocks recovers 76 percent of the likelihood improvement from fitting on the full 368-rock fitting set, while abundance error responds more slowly (11.0% zero-shot and 9.5% with the full fitting set). This work demonstrates how a machine learning model in the geochemical sciences can both leverage an imperfect simulator and mitigate its systematic biases.

0.26

Multispectral Household Plastic Classification for Recycling Using a Camera Array

eess.IV ·2026-08-23 ·Katja Kossira, Jürgen Seiler, André Kaup
publishedcode/data similarity 0.53
Abstract

Plastic pollution has become a persistent problem in natural ecosystems. Driven by insufficient waste management, limited recycling efficiency, and high costs for recycling, plastic waste in the environment poses significant ecological and health risks. Recycling requires accurate identification of polymer types, but existing optical sorting systems often struggle to distinguish common household plastics. In this work, we present a novel classification approach based on a multispectral imaging system consisting of nine cameras equipped with near-infrared bandpass filters. The system is designed to discriminate the seven most common household plastics. From the resulting multispectral images, we extract the spectral fingerprints and derive features such as intensity differences between specific wavelength pairs and their slopes, as well as false-color image representations. A dedicated preprocessing pipeline aligns and normalizes the data before classification. We recorded a multispectral household plastic database (https://github.com/FAU-LMS/MHPM) and trained four different classifiers Gradient Boosting, Extreme Gradient Boosting, Light Gradient Boosting Machine, and CatBoost. The best-performing model achieves a classification accuracy of 86.7%. The computational runtime is 2.603 μs per pixel, enabling efficient processing of high-resolution images. The entire setup is built from off-the-shelf hardware components, which makes replication straightforward and allows direct integration into industrial sorting pipelines.

0.56