CS Paper Radar

Decision Tree and K-Means Analysis of Raman Spectra for Edible Oils: A Physics-Informed AI Approach

Amrita Shaw, Chandrasekar S. N., Sai Muthukumar V., Jhinuk Gupta, Deepak L. N. Kallepalli

cs.LG cs.AI ·submitted 2026-08-20 14:07 UTC · v2

Abstract

Classification of edible oils in processed foods is important for food quality, fraud prevention, and regulatory compliance. This study develops a Mutually Exclusive, Collectively Exhaustive framework integrating spectral organization, interpretable classification, Physics-Informed Artificial Intelligence (PI-AI), and Frugal AI-based feature reduction. Five edible oils were analyzed in pure form and within a fried-potato-chip matrix using t-SNE, K-means clustering, Decision Trees, and Non-Negative Least Squares (NNLS)-based spectral decomposition. Unsupervised analyses showed stronger class organization and separability in pure oils, while food-matrix effects caused substantial spectral overlap. Decision Trees achieved 100% classification accuracy for pure oils using only four Raman variables from 1866 spectral features. These variables represented only 0.21% of the available spectral information while retaining perfect test-set performance. Two variables associated with lipid unsaturation (about 1650 cm-1) and hydrocarbon-chain organization (about 1127 cm-1) remained important after NNLS matrix correction. Their combined contribution increased from 50% in pure oils to about 62% and 89% in paper-subtracted and paper-plus-potato-subtracted datasets, respectively. NNLS-based PI-AI improved food-matrix classification by separating oil signatures from paper and potato contributions. Optimized post-pruned models achieved nearly 80% test accuracy using only five and four Raman variables, respectively. The four-feature representation reduced the data footprint by 99.44% without loss of accuracy. These findings demonstrate that Raman-based oil identification can use compact, physically meaningful, and interpretable spectral representations, supporting Frugal AI, Edge AI, portable sensing, and embedded food-quality monitoring.

Comment
46 pages, 11 figures, 2 tables, 1 supplementary table, 9 supplementary figures

Closest papers

Nearest neighbours by meaning across the whole index.

Hybrid Machine Learning-Assisted Raman Spectroscopy with Generative Feature Augmentation for Pharmaceutical Identification

cs.LG cond-mat.mtrl-sci ·2026-09-18 ·Quach Thi Thai Binh, Ton Nu Quynh Trang, Thang B. Phan, Vu Thi Hanh Thu, Nguyen Tuan Hung
similarity 0.57
Abstract · 12 pages, 7 figures, 2 tables

Rapid and reliable identification of pharmaceutical residues is important for safeguarding public health, ensuring food safety, and enabling practical Raman-based screening. In this study, we propose HyMLRaman, a hybrid Raman spectroscopy framework that combines deep spectral feature extraction, generative models, and classical machine-learning classifiers to identify six pharmaceutical compounds, including amoxicillin, chloramphenicol, ciprofloxacin, tetracycline, ibuprofen, and paracetamol. Raman spectra are converted into spectral images and encoded with several deep neural-network backbones, among which EfficientNet-B3 yields the most effective representation. The resulting 1536-dimensional embeddings are then used to train downstream classifiers, including SVM, KNN, logistic regression, random forest, XGBoost, and ANN, using stratified 10-fold cross-validation. The hybrid EfficientNet-B3--SVM configuration achieves the strongest baseline performance, reaching 96.31% accuracy and a macro-F1 score of 96.36%, outperforming the standalone CNN baseline. To address limited-data conditions, a generative model, a DDPM-based feature augmentation, is introduced in a PCA-reduced EfficientNet-B3 latent space. The low-data ablation results show that DDPM augmentation provides selective benefits, particularly for KNN with reduced training fractions, and that its effect remains classifier-dependent. Finally, an application-level Raman Pharmaceutical Analyzer demonstrates the feasibility of embedding the trained model into an interactive Raman analysis workflow. These results suggest that HyMLRaman provides a practical and interpretable route for rapid Raman-based pharmaceutical screening.

0.19

A Multispectral Framework for the Detection of Calcium Carbide-Induced Ripening and Shelf-Life Estimation in Climacteric Fruits

cs.LG ·2026-08-13 ·Gurbhit Chaurakoti, Harshit Kumar, Hani Kumar, Anurag Singh, Ram Asrey
similarity 0.54
Abstract

Significant health risks are associated with the illegal, yet commonly practiced use of industrial-grade Calcium Carbide (CaC2) for ripening climacteric fruits like mango and banana, which leaves behind trace residues of arsenic and phosphorus. To address this, the proposed study explores a novel, non-invasive multispectral framework for distinguishing safely ripened fruits (naturally ripened and ethephon-induced) from calcium carbide-ripened samples, while also estimating their ripening progression (in percentage) and remaining shelf life (in days). The spectral profiles of mango (Mangifera indica) and banana (Musa acuminata) at 18 discrete wavelengths in the visible-near infrared (NIR) range (410 nm - 940 nm) are studied using the AS7265x spectral triad sensor. CaC2-treated samples exhibit sharper spectral intensity drops in the visible region, consistent with accelerated chlorophyll degradation and carotenoid development. To characterize these physiological changes, the feature engineering strategy integrates inter-method spectral variance, intensity ratios at distinct wavelengths, and environmental parameters including temperature and humidity. Dimensionality reduction using Principal Component Analysis (PCA) retains >90% of spectral variance within the first 5-7 components. The resulting feature set is used to train three independent eXtreme Gradient Boosting (XGBoost)-based learning algorithms for ripening method classification, along with quantitative estimation of remaining shelf life and ripening progression. A classification accuracy of 95% along with carbide class recall of 0.67 is observed for mango samples, while the model achieves an accuracy of 81% and carbide class recall of 0.74 for banana. This instrumentation and data-driven approach demonstrates the effectiveness of the proposed non-invasive framework.

0.04

X-LIBS: Interpretable Soil Classification Using Explainable AI and Laser-Induced Breakdown Spectroscopy

eess.SP ·2026-09-19 ·Yingchao Huang, Xin Wang
similarity 0.53
Abstract

Machine learning (ML) has emerged as a powerful tool for soil analysis using Laser-Induced Breakdown Spectroscopy (LIBS). However, traditional black-box models often lack interpretability, limiting their effectiveness in decision-making processes. This study introduced explainable AI (XAI) techniques to enhance both the interpretability and classification performance of Partial Least Squares Discriminant Analysis (PLS-DA) models for soil classification with LIBS. Local Interpretable Model-agnostic Explanations (LIME) was employed to identify the local spectral features associated with soil elements, providing explanations for their contributions to classification outcomes. To improve classification performance on unlabeled spectra, prediction uncertainty was quantified by sequentially removing the top local spectral features identified by LIME as critical to the classification. Higher uncertainty was associated with a smaller number of feature removals needed to change the label. Spectra for which a large number of features had to be removed before the label changed were treated as high-confidence predictions and admitted to a co-training process. Thresholds on this flip count were defined separately for spectrally ambiguous and stable classes to manage uncertainty identification effectively. To address the sensitivity of PLS-DA to class imbalances, equal proportions of pseudo-labels from each class were included in co-training. The proposed method was evaluated on the publicly available EMSLIBS dataset, achieving a test accuracy of 92.69\%, competitive with the best-performing methods in the literature. The XAI results provided insights into the causes of misclassifications and identified the dominant spectral features critical for accurate predictions, advancing interpretable AI solutions for LIBS-based soil analysis.

0.23

Sharpness-Aware Minimization (SAM) Improves Classification Accuracy of Bacterial Raman Spectral Data Enabling Portable Diagnostics

cs.LG q-bio.QMstat.ML ·2026-09-16 ·Kaitlin Zareno, Jarett Dewbury, Siamak K. Sorooshyari, Hossein Mobahi, Loza F. Tadesse
published similarity 0.50
Abstract · Accepted for oral presentation at the ICLR 2024 Workshop on Practical ML for Low Resource Settings (PML4LRS)

Antimicrobial resistance is expected to claim 10 million lives per year by 2050, and resource-limited regions are most affected. Raman spectroscopy is a novel pathogen diagnostic approach promising rapid and portable antibiotic resistance testing within a few hours, compared to days when using gold standard methods. However, current algorithms for Raman spectra analysis 1) are unable to generalize well on limited datasets across diverse patient populations and 2) require increased complexity due to the necessity of non-trivial pre-processing steps, such as feature extraction, which are essential to mitigate the low-quality nature of Raman spectral data. In this work, we address these limitations using Sharpness-Aware Minimization (SAM) to enhance model generalization across a diverse array of hyperparameters in clinical bacterial isolate classification tasks. We demonstrate that SAM achieves accuracy improvements of up to 10.5% on a single split, and an increase in average accuracy of 2.7% across all splits in spectral classification tasks over the traditional optimizer, Adam. These results display the capability of SAM to advance the clinical application of AI-powered Raman spectroscopy tools.

0.63

Generative AI enables human-centered design of sustainable plant-based foods

cs.CE ·2026-10-11 ·Vahidullah Tac, Ellen Kuhl
benchmark similarity 0.48
Abstract · 25 pages, 4 figures, 7 supplementary figures

Dietary transitions away from animal-based meat could reduce food-related environmental burdens, but plant-based alternatives must compete on flavor, texture, and overall liking. Here we extend a generative AI framework with 469 plant-based burger recipes and use it to create six formulations across five primary ingredients: bean, chickpea, lentil, mushroom, and oat. An executive chef translates the AI-generated formulations into standardized preparation protocols and refines the ingredient quantities based on culinary expertise. The integration of generative modeling and culinary expertise defines a human-centered generative AI framework for food design. We evaluate the six burgers in a blinded sensory survey with 101 participants in an operating restaurant and quantify their land use, greenhouse gas emissions, eutrophication potential, and scarcity-weighted water use. We use Big Mac scores from a previous survey as an iconic commercial benchmark. The mushroom burger achieves mean flavor, texture, and overall liking scores similar to the Big Mac, with less than one-third of its estimated environmental impact. The other formulations reduce the estimated impact further, in several cases to near one-tenth of the Big Mac value, but receive lower liking scores. Mixed-effects models quantify associations between sensory attributes and human liking and retain predictive accuracy on independent survey data, with mean absolute errors no greater than 0.52 points on a seven-point scale. Together, these results demonstrate how generative design, culinary expertise, human sensory response, and environmental assessment can converge to create sustainable foods that people want to eat.

0.24

Physics-Aware Self-Supervised Pretraining on Multi-Domain Raman Spectra

cs.LG cs.CVeess.IV ·2026-10-09 ·Charalampos Davalas, Georgios Levantinos, Anastasios Dimitriou, Nikolaos Papanikolaou, Georgios Th. Papadopoulos +1 more
similarity 0.48
Abstract

Raman spectroscopy generates large volumes of unlabeled data that are difficult to exploit with conventional supervised learning. This work introduces a multi-domain self-supervised learning framework based on a masked autoencoder (MAE) for learning transferable Raman spectral representations from heterogeneous biological, chemical, forensic, and materials datasets. The proposed pretraining strategy incorporates physics-aware objectives by combining masked intensity reconstruction with a sparse Voigt-profile decoder that models spectral peak structure through differentiable peak centers, widths, and amplitudes. A denoising objective is further included to improve robustness to spectral corruption. The learned encoder is evaluated on substance classification, component identification, concentration estimation, and spectral denoising under linear probing, attention-based probing, end-to-end fine-tuning, and training from scratch. Experimental results show that self-supervised pretraining is most beneficial for challenging tasks with limited labeled data. Attention-based probing also reveals substantially more useful information in the frozen representation than linear probing, indicating that conventional linear evaluation may underestimate representation quality. In addition, the benefits of pretraining become more pronounced with increasing encoder capacity. Overall, the proposed framework demonstrates that physics-aware, multi-domain self-supervised pretraining can improve label efficiency, robustness, and transferability across diverse Raman spectroscopy tasks.

0.20

Mathematical Formulation and Comparative Performance Evaluation of Machine Learning Algorithms for Maize Land Suitability Prediction

cs.LG cs.AI ·2026-10-31 ·Haimanot Bitew, Ayisheshim Almaw, Habtamu Zegeye, Demeke Alene
similarity 0.47
Abstract

Addressing the food needs of a growing population is one of the major challenges of developing countries like Ethiopia. Various policies aimed at increasing food production have been enacted by governments and development partners. Although efforts in this regard have been made, there is still inadequate emphasis on increasing food production through the use of high technology practices. Precision agriculture using technology has been utilized to increase crop yield. Precision agriculture also relies on identifying land for a crop, which is a key factor that affects crop yield. Traditional methods of assessing land suitability for crop production are time-consuming, costly and unreliable. Against this background, the aim of this study was to assess the potential of machine learning (ML) in improving the speed and accuracy of assessing land suitability for maize, a staple crop in Ethiopia, as compared to traditional methods. The study is investigated in three areas (Burie, Shindi and Tilili) in the Amhara region. Data collection was done through the local agriculture offices and survey teams. The data were coded, scaled and balanced. Various feature extraction techniques, which included Univariate Feature Selection(UFS), Recursive Feature Elimination with Cross-Validation(RFECV) and Sequential Feature Selection(SFS), and various classifiers, which were K-nearest neighbor (KNN), gradient boosting (GB),random forest (RF) with mathematical formulations were employed. The best models were constructed through combining GBOOST and SFS and achieved an accuracy of 99.41% and 99.35% for both precision and recall. Our results showed that using machine learning is a reliable method of assessing land suitability for maize in Ethiopia. Keywords: Maize, Gradient boosting,Land suitability,Machine learning, Mathematical formulations

0.29

Automated feature-region selection for soft-sensor development from spectral-like measurements

eess.SP ·2026-09-22 ·Sebastián Espinel-Ríos, Wenchao Duan
similarity 0.47
Abstract

Sustainable production increasingly relies on process analytical chemistry and process analytical technology to support monitoring, control, and automation. Techniques used in these contexts, including Raman spectroscopy, infrared spectroscopy, and electrochemical voltammetry, generate high-dimensional signals ordered along physical measurement axes, referred to here as spectral-like measurements. These signals can contain redundant, weakly informative, and noisy regions, complicating the development of data-driven soft sensors to map them to process variables. Selecting informative regions is nontrivial, as visually prominent regions are not necessarily the most predictive, while synergistic effects among regions cannot be readily inferred. Here, we introduce an automated feature-region selection framework that identifies a parsimonious set of contiguous regions while preserving channel ordering. The framework combines channel-level target correlation and a signal-to-noise indicator into a latent information fingerprint. Variable-width candidate intervals are derived from peaks in this fingerprint, and their combinations are ranked using held-out validation data. Final selection favours models using fewer channels among candidates with comparable predictive performance. The framework is demonstrated using cyclic voltammetric measurements of glucose acquired with a gold electrode sensor across four progressively broader nominal concentration ranges up to 350 g/L. Gaussian process regression is used within the framework to accommodate possible nonlinear relationships, account for observation noise, and quantify epistemic uncertainty. The selected models retained only 11-42 of the original 400 channels and reduced held-out test root mean squared error by 88.3-94.6% relative to full-feature Gaussian process regression benchmarks.

0.24