CS Paper Radar

Automated feature-region selection for soft-sensor development from spectral-like measurements

Sebastián Espinel-Ríos, Wenchao Duan

eess.SP ·submitted 2026-09-22 21:30 UTC · v1

Abstract

Sustainable production increasingly relies on process analytical chemistry and process analytical technology to support monitoring, control, and automation. Techniques used in these contexts, including Raman spectroscopy, infrared spectroscopy, and electrochemical voltammetry, generate high-dimensional signals ordered along physical measurement axes, referred to here as spectral-like measurements. These signals can contain redundant, weakly informative, and noisy regions, complicating the development of data-driven soft sensors to map them to process variables. Selecting informative regions is nontrivial, as visually prominent regions are not necessarily the most predictive, while synergistic effects among regions cannot be readily inferred. Here, we introduce an automated feature-region selection framework that identifies a parsimonious set of contiguous regions while preserving channel ordering. The framework combines channel-level target correlation and a signal-to-noise indicator into a latent information fingerprint. Variable-width candidate intervals are derived from peaks in this fingerprint, and their combinations are ranked using held-out validation data. Final selection favours models using fewer channels among candidates with comparable predictive performance. The framework is demonstrated using cyclic voltammetric measurements of glucose acquired with a gold electrode sensor across four progressively broader nominal concentration ranges up to 350 g/L. Gaussian process regression is used within the framework to accommodate possible nonlinear relationships, account for observation noise, and quantify epistemic uncertainty. The selected models retained only 11-42 of the original 400 channels and reduced held-out test root mean squared error by 88.3-94.6% relative to full-feature Gaussian process regression benchmarks.

Closest papers

Nearest neighbours by meaning across the whole index.

Multi-output LSTM soft sensors for industrial anaerobic co-digestion using LSTM-beta-VAE generative data augmentation

cs.LG cs.AIeess.SY ·2026-10-29 ·Rohit Murali, Benaissa Dekhici, Tao Chen, Dongda Zhang, Michael Short
similarity 0.52
Abstract · 33 pages

Anaerobic digestion (AD) requires close monitoring of key process variables, including pH, the ratio of volatile organic acids to alkaline buffer capacity and biogas production, to maintain biological stability and prevent process failure. While mechanistic frameworks such as the Anaerobic Digestion Model No. 1 are highly parameterised, computationally expensive, and difficult to calibrate for real-time applications, data-driven Long Short-Term Memory (LSTM) networks offer a potentially more adaptable alternative. However, current data-driven approaches in AD are predominantly limited to single-output architectures that focus solely on production yields, as opposed to simultaneous prediction of vital stability indicators. Furthermore, industrial AD datasets are typically sparse and skewed toward steady-state operations. Baseline evaluations demonstrated this scarcity prevents standard algorithms (Random Forest, XGBoost) and unaugmented LSTMs from recognising the transition to unstable operations, resulting in poor estimation of stability indicators. To overcome these challenges, this study proposes a novel generative data augmentation framework using an LSTM-beta-Variational Autoencoder coupled with a multi-output LSTM (MO-LSTM) soft sensor. By synthesising physically valid sequences of these transitions to unstable operations from one year of full-scale plant data, the method safely populates sparse regions of the feature space. Trained on this augmented dataset, the MO-LSTM achieved robust simultaneous estimation across all targets. This approach mitigates data sparsity, providing a basis for hybrid mechanistic-data-driven modelling and early-warning soft sensors in industrial bioprocesses.

0.29

IPM-FM: A Foundation Model with Consensus Feature Selection for Industrial Process Monitoring

cs.LG cs.AI ·2026-09-08 ·Liang Cao, Weide Liu, Yan Qin, Jun Cheng, Weisi Lin +1 more
published similarity 0.52
Abstract

Industrial process monitoring is fundamental to the safety and economic performance of modern process plants. Current practice remains a one-task-one-model paradigm that is label-inefficient and prone to degradation under operating drift. Foundation models have reshaped language, vision, and generic time-series forecasting, but it has not been adapted to industrial process monitoring. This setting poses domain-specific challenges, including safety-critical decisions and asymmetric sampling between process variables and laboratory measurements. We propose the industrial process monitoring foundation model (IPM-FM). It first learns general-purpose representations from unlabeled industrial process data through self-supervised pretraining, then adapts to specific monitoring tasks using a small amount of task-labeled data, and finally produces calibrated predictions through an uncertainty-aware prediction head. IPM-FM integrates a self-supervised Informer backbone with a multi-criteria consensus feature selector, a recursive lag-feature regression head, and a calibrated Monte Carlo dropout uncertainty module. On a seven-year hydrotreater dataset for diesel flash-point soft sensing, IPM-FM attains an RMSE of 2.99, $R^2$ of 0.50, and 97\% coverage of its 95\% predictive interval, outperforming the strongest classical and from-scratch sequence baselines by 8.3\% and 14.6\% in RMSE respectively, supporting the viability of a unified pretraining--adaptation framework for industrial process monitoring.

0.40

BAARC: Uncertainty-Driven Adaptive Partial Spectral Measurement to Full Reconstruction for Material Classification

cs.LG ·2026-10-23 ·Adithya Ashok Chalain Valapil, Aishwarya Venkataramanan, Joachim Denzler
similarity 0.52
Abstract

Spectroscopic instruments with limited wavenumber coverage require accurate scan positioning or multiple measurements to complete the material analysis. This often requires prerequisite knowledge about the material under diagnosis to measure the spectral regions with distinguishing peaks. In our study, we simulate a Bayesian Adaptive Acquisition with Reconstruction-driven Classification (BAARC) framework for Raman spectral measurements, using masked training to learn spectral features that dynamically drive laser channel selection until the material is identified. We present a jointly trained two-level framework that takes progressive partial measurements of small wavenumber patches across the complete spectral range and, at each step, first attempts to reconstruct the full spectra until the model uncertainty is low. Secondly, material classification is performed at each reconstruction step until stoppage. Uncertainty quantification during reconstruction steps helps determine the measurement position of our next patch, while combining it with classification uncertainty determines measurement termination. By closing the loop between hardware acquisition and deep probabilistic modeling, the proposed system minimizes physical measurement steps while maintaining both spectral fidelity and diagnostic accuracy. Experimental evaluations demonstrate that our framework achieves high-accuracy sample identification using only a fraction of full-spectrum channels, offering a scalable solution for real-time, high-throughput spectroscopic instruments.

0.24

Self-Supervised Attention-Based Virtual Metrology for CMP MRR Prediction

cs.LG cs.AI ·2026-11-12 ·Jonathan Adam Rico, Nagarajan Raghavan, Senthilnath Jayavelu
similarity 0.51
Abstract · Submitted to the IEEE International Symposium on Semiconductor Manufacturing (ISSM 2026)

Chemical mechanical planarization (CMP) is a critical semiconductor manufacturing process where material removal rate (MRR) is a key metric for process monitoring and advanced process control (APC). Virtual metrology enables MRR estimation from process time series signals, supporting run-to-run(R2R) control and process optimization while reducing reliance on physical metrology. Existing approaches typically rely on simplified linear assumptions or require handcrafted feature engineering. In this paper, we propose Global Regression Pretraining(GREP), a self-supervised, attention-based framework for CMP MRR prediction. GREP learns temporal representations from unlabeled sensor signals through global proxy-target regression, followed by supervised fine-tuning for MRR estimation. The framework is evaluated against a feature-engineered supervised baseline under three conditions: limited labeled data, sensor noise, and temporal process drift. Experiments on the PHM 2016 CMP dataset demonstrate competitive performance under limited labeled-data conditions, with improvements in selected cases and performance largely comparable to the baseline across different labeled-data fractions. Both models exhibit relatively small changes in prediction error with increasing noise, while GREP achieves a 17.0% RMSE reduction in the final temporal interval.

0.18

Domain-Aware Lightweight Spectral-Grouped Convolutions for Hyperspectral Fish Freshness Classification

eess.IV cs.AIcs.CVeess.SP ·2026-08-12 ·Kazi Nabiul Alam, Pooneh Bagheri Zadeh, Akbar Sheikh-Akbari
published similarity 0.50
Abstract · Accepted at BMVC'2026

Hyperspectral imaging (HSI) offers nondestructive assessment of fish freshness by detecting biochemical alterations across spectral bands. However, conventional deep learning approaches do not fully address the particular characteristics of HSI data, such as spectral dominance over spatial textures, ordinal label structure, and a small number of training samples. We propose SGNet (Spectral-Grouped Network), a lightweight architecture that separates spectral and spatial feature extraction using grouped convolutions and a depthwise spatial pathway. A dual attention mechanism that couples channel-wise squeeze-and-excitation with spatial gating adaptively highlights informative features. SGNet achieves 97.8% classification accuracy and 0.64 days mean absolute error (MAE) with just 4.75M parameters when tested on our newly developed 16-day refrigerator-stored salmon fillet dataset. Ablation studies validate the contribution of each component, while comparisons demonstrate a five- to eighteen-fold parameter reduction relative to ResNet-50 and Vision Transformers. Our findings indicate that domain-aware design supports precise, real-time freshness prediction for industrial implementation.

0.27

Sharpness-Aware Minimization (SAM) Improves Classification Accuracy of Bacterial Raman Spectral Data Enabling Portable Diagnostics

cs.LG q-bio.QMstat.ML ·2026-09-16 ·Kaitlin Zareno, Jarett Dewbury, Siamak K. Sorooshyari, Hossein Mobahi, Loza F. Tadesse
published similarity 0.49
Abstract · Accepted for oral presentation at the ICLR 2024 Workshop on Practical ML for Low Resource Settings (PML4LRS)

Antimicrobial resistance is expected to claim 10 million lives per year by 2050, and resource-limited regions are most affected. Raman spectroscopy is a novel pathogen diagnostic approach promising rapid and portable antibiotic resistance testing within a few hours, compared to days when using gold standard methods. However, current algorithms for Raman spectra analysis 1) are unable to generalize well on limited datasets across diverse patient populations and 2) require increased complexity due to the necessity of non-trivial pre-processing steps, such as feature extraction, which are essential to mitigate the low-quality nature of Raman spectral data. In this work, we address these limitations using Sharpness-Aware Minimization (SAM) to enhance model generalization across a diverse array of hyperparameters in clinical bacterial isolate classification tasks. We demonstrate that SAM achieves accuracy improvements of up to 10.5% on a single split, and an increase in average accuracy of 2.7% across all splits in spectral classification tasks over the traditional optimizer, Adam. These results display the capability of SAM to advance the clinical application of AI-powered Raman spectroscopy tools.

0.63

Wavenumber-Aware Deep Learning for Robust Analysis of Raman Spectra

cs.LG physics.chem-phphysics.optics ·2026-10-22 ·Jihwan Kim, Jaeseong Heo, Yujin Kim, Sang Bin Yoon, Chanjoong Kim +5 more
benchmark similarity 0.48
Abstract · 29 pages, 5 figures, 6 tables; Supplementary Information (15 pages) included

Machine-learning models for spectroscopy usually treat a spectrum as a fixed-grid intensity vector, leaving the physical coordinate implicit in the array index. Such models are tied to a single sampling grid, spectral range and resolution, which limits their use when measurement conditions change. Here we represent each spectral point as a pair of intensity and wavenumber and compute Transformer positional encodings from the wavenumber itself. On Raman spectra of three bacterial species and their synthetic mixtures, this representation remained robust to noise, sparser sampling and partial spectral coverage across convolutional, residual and Transformer networks. In controlled comparisons, wavenumber-based encoding outperformed index-based and learned encodings under partial observation and retained its performance on sampling grids never seen during training, where index-based encoding degraded. These findings were reproduced on a public 30-isolate bacterial benchmark. Explicit physical coordinates offer a simple route to robust spectral analysis under variable measurement conditions.

0.19

Hybrid Machine Learning-Assisted Raman Spectroscopy with Generative Feature Augmentation for Pharmaceutical Identification

cs.LG cond-mat.mtrl-sci ·2026-09-18 ·Quach Thi Thai Binh, Ton Nu Quynh Trang, Thang B. Phan, Vu Thi Hanh Thu, Nguyen Tuan Hung
similarity 0.48
Abstract · 12 pages, 7 figures, 2 tables

Rapid and reliable identification of pharmaceutical residues is important for safeguarding public health, ensuring food safety, and enabling practical Raman-based screening. In this study, we propose HyMLRaman, a hybrid Raman spectroscopy framework that combines deep spectral feature extraction, generative models, and classical machine-learning classifiers to identify six pharmaceutical compounds, including amoxicillin, chloramphenicol, ciprofloxacin, tetracycline, ibuprofen, and paracetamol. Raman spectra are converted into spectral images and encoded with several deep neural-network backbones, among which EfficientNet-B3 yields the most effective representation. The resulting 1536-dimensional embeddings are then used to train downstream classifiers, including SVM, KNN, logistic regression, random forest, XGBoost, and ANN, using stratified 10-fold cross-validation. The hybrid EfficientNet-B3--SVM configuration achieves the strongest baseline performance, reaching 96.31% accuracy and a macro-F1 score of 96.36%, outperforming the standalone CNN baseline. To address limited-data conditions, a generative model, a DDPM-based feature augmentation, is introduced in a PCA-reduced EfficientNet-B3 latent space. The low-data ablation results show that DDPM augmentation provides selective benefits, particularly for KNN with reduced training fractions, and that its effect remains classifier-dependent. Finally, an application-level Raman Pharmaceutical Analyzer demonstrates the feasibility of embedding the trained model into an interactive Raman analysis workflow. These results suggest that HyMLRaman provides a practical and interpretable route for rapid Raman-based pharmaceutical screening.

0.19