CS Paper Radar

Adaptive Sequential Test Planning for Multi-Mechanism Reliability Qualification via Bayesian Monte Carlo Tree Search

Youssef A. Elhagrasy, Ian Hill, André Ivanov

cs.AI eess.SY ·submitted 2026-08-10 14:04 UTC · v1
top venue

Abstract

Reliability qualification of advanced semiconductor devices requires sequential stress decisions that balance characterization objectives against multiple competing failure mechanisms. Current practice relies on static test plans derived from population-level acceleration models, which cannot adapt to per-unit variability or real-time degradation observations. This paper presents a closed-loop adaptive test planning framework that formulates reliability qualification as a partially observable sequential decision problem and solves it using Monte Carlo tree search for seed-action simulators (MCTS-SA) coupled with extended Kalman filter (EKF) belief-state estimation. The framework models stochastic, per-device variability in bias temperature instability (BTI), electromigration (EM), and time-dependent dielectric breakdown (TDDB), and treats stress selection as a constrained sequential optimization, i.e., to maximize the probability of successful degradation characterization while respecting catastrophic failure constraints. Under the experimental assumptions used here (discrete stress actions, proxy damage observability, and cumulative degradation without recovery), we believe this to be a novel application of tree-search-based adaptive test planning to multi-mechanism reliability qualification. Across 5,000 planning iterations, the characterization yield (CY) improves from 20% in the first 500 iterations to over 54% in the final 500, with 39% cumulative success, while the best successful test sequence terminates with EM and TDDB damage fractions DEM=0.564 and DTDDB=0.537, well within safety margins. These results demonstrate that sequential Bayesian planning can synthesize damage-aware test policies that significantly outperform non-adaptive strategies for reliability qualification under competing failure modes.

Comment
Accepted to IEEE Transactions on Reliability
Journal ref
IEEE Transactions on Reliability, 2026
DOI
10.1109/TR.2026.3722801

Closest papers

Nearest neighbours by meaning across the whole index.

Decision-Gated Surrogate-Assisted Stochastic Optimization with Independent High-Fidelity Certification for Photovoltaic Hosting-Capacity Planning

eess.SY ·2026-09-25 ·Ali Abubakar, Samuel Essamuah Assabil, Akhtar Hussain, Van-Hai Bui
similarity 0.56
Abstract · 17 pages

High photovoltaic (PV) penetration planning requires repeated nonlinear PV and power-flow evaluations under uncertain irradiance and demand, particularly when two competing objectives, penetration and total electrical loss, are optimized simultaneously subject to reliability constraints. This paper develops a decision-focused, surrogate-assisted stochastic multiobjective framework in which a calibrated PV model coupled with a distribution-network simulator provides the high-fidelity reference, while matched data-only and physics-informed surrogates accelerate optimization and are evaluated empirically for decision reliability across the loss-penetration tradeoff. Although the two surrogates exhibit nearly identical held-out errors, optimizer-realistic screening yields markedly different operational validity rates of 44.4% and 93.4%, respectively, motivating selection of the physics-informed model on decision performance rather than test accuracy. Surrogate inference cuts the cost of a 60-scenario design evaluation from 286.0 to 0.46 ms, an approximately 620 time speedup. A decision-gated enrichment strategy further targets Pareto-critical, constraint boundary, and surrogate-disagreement regions, reducing prediction error by 39.1%. Independent 500 scenario certification verifies all 80 screened candidates and identifies 46 non-dominated designs; the selected compromise attains 70.74% expected penetration with 297.9 kW expected total electrical loss. Cross-feeder transfer eliminates baseline voltage violations on the 85- and 69-bus systems, but produces overvoltage and a 62.7% increase in feeder-network loss on the 33-bus system, demonstrating that certified penetration is topology-specific and demands decision-level auditing, independent certification, and feeder-specific validation.

0.24

Uncertainty and Business-Aware Remaining Useful Life Estimation for Semiconductor Manufacturing

cs.LG ·2026-08-26 ·Davide Frizzo, Francesco Borsatti, Gian Antonio Susto
similarity 0.54
Abstract · Submitted to IEEE Transactions on Semiconductor Manufacturing

Remaining Useful Life (RUL) estimates guide maintenance in semiconductor manufacturing, where a late intervention can disrupt production but an early one discards usable equipment life. A single prediction does not express the uncertainty needed to choose between these outcomes. We combine Deep Learning (DL) sequence models with Simoultaneous Quantile Regression (SQR) to estimate RUL at selectable quantile levels, and evaluate maintenance decisions using Unexpected Breaks (UB), Unexploited Lifetime (UL), and a cost-weighted objective. On the $F_1$ fault mode of the 2018 PHM Data Challenge (PHM18) ion-milling dataset, we compare recurrent, Transformer, and State Space Models (SSM) architectures. Diagonal State Spaced (S4D) gives the strongest overall RUL accuracy across the evaluated quantiles. Varying the quantile and maintenance window exposes the trade-off between failure risk and early intervention; under the examined cost ratios, the resulting decisions have lower cost than the Preventive Maintenance (PvM) baselines.

0.22

Enabling risk and reliability analysis in next-generation computational tools via multifidelity methods

cs.CE math.OCstat.CO ·2026-11-03 ·Anirban Chaudhuri, Karen Willcox
similarity 0.54
Abstract · Review article

Risk and reliability analysis are fundamental to the design, assessment, and operation of safety-critical complex systems; however, their integration into next-generation computational tools is constrained by the cost of uncertainty quantification with expensive computational models. The computational challenge is particularly prohibitive for tail-sensitive quantities, such as probabilities of failure, conditional values-at-risk, and buffered probabilities of failure, where accurate estimation can require a large number of model evaluations. Multifidelity methods provide a framework for addressing this computational bottleneck by combining information from models of varying accuracy and cost while retaining the predictive accuracy of the high-fidelity model. This review summarizes the state of the art in methods that enable scalable risk and reliability analysis using multifidelity control variates, multifidelity importance sampling, and multifidelity active learning.

0.31

From Winding-Fault Geometry to Reliability: Estimation and Prognosis of Stator Inter-Turn Faults

eess.SY eess.SP ·2026-09-11 ·Bambang L. Widjiantoro, Syahrul Munir, Katherin Indriawati, Moh Kamalul Wafi
benchmark similarity 0.54
Abstract

This paper develops an integrated framework for estimation, prognosis, and reliability assessment of stator inter-turn faults in induction motors. The fault is characterized by its severity, defined as the fraction of short-circuited turns, and its spatial orientation. A geometric fault model shows that the resulting output signature is affine in the fault severity and exhibits a fundamental spatial periodicity. Exploiting this structure, an augmented-state particle filter jointly estimates the nonlinear electromechanical state and the unknown fault severity while quantifying posterior uncertainty. The estimated degradation is then propagated using four prognostic models: linear trend, Holt exponential smoothing, Bayesian degradation, and particle-based forecasting. Their predictions are connected to threshold-crossing remaining useful life (RUL), first-passage reliability, degradation-dependent hazard reliability, and a Weibull lifetime benchmark, thereby providing both deterministic and probabilistic health assessments. Numerical results demonstrate accurate online fault estimation and output reconstruction, characterize the effects of degradation pattern and prediction horizon on prognosis, and show consistent reliability and threshold-crossing predictions. Moreover, estimation accuracy remains comparable across the distinct fault orientations induced by the spatial periodicity. The resulting framework provides a unified connection from physics-based inter-turn fault modeling to online diagnosis, degradation prognosis, and reliability assessment.

0.25

CORE-RL: Confidence-Oriented Reliability Evaluation of Black-Box Reinforcement Learning Policies

cs.AI ·2026-10-03 ·Santhosh GS, Ananya Ravi, Devika Jay, Abhishek Sarkar, Perepu Satheesh Kumar +3 more
theory similarity 0.52
Abstract

The deployment of Reinforcement Learning (RL) agents in critical domains must be preceded with a pipeline to evaluate the alignment of the RL agent with complex multi-objective specifications and robustness under real-world environmental drift. However, to protect intellectual property, the RL agent may be delivered for evaluation as opaque executable or remote API, which makes traditional evaluation techniques based on the internals of the policies infeasible. To address this gap, CORE-RL: Confidence-Oriented Reliability Evaluation of black box RL policy is proposed in this paper. The CORE-RL pipeline introduces a Unified Reliability Metric that formally integrates early task termination and safety constraint violations, preventing unsafe policies from masking failures through premature episode halts. By subjecting the policy to a noise certification envelope of perceptual noise, actuation noise and change in environment dynamics, the pipeline computes the finite-sample Clopper-Pearson bounds on unified reliability metric and Hoeffdings' lower bound on reward and safety cost. The pipeline then defines safe operational design domain to report high-confidence certificates for safety and expected performance. Experiments on continuous control tasks demonstrate the CORE-RL pipeline's ability to automatically reject non-compliant policies and map the safe Operational Design Domain (ODD) of safety-aware policies. Thus CORE-RL provides an evaluation framework towards a quantitative, transparent and reproducible, statistical rationale necessary to safely evaluate, compare, and deploy black box RL solutions.

0.08

GlitchLab: A Hardware-in-the-Loop Optimizer for Physical Fault Injection

cs.CR ·2026-09-01 ·Tanvir Hossain, Abhinav Mahadevan, Jasper Van Woudenberg, Rajesh Velegalati, Arindam Bhattacharyya
similarity 0.52
Abstract

Physical fault injection can turn brief hardware disturbances into security failures such as key recovery, authentication bypass, and unintended control flow. Finding effective faults is difficult because many interacting parameters create a large search space, successful settings are sparse and target-dependent, and each hardware attempt provides limited feedback. Under fixed testing time, efficient search is therefore critical for assessing fault sensitivity. We present GlitchLab, an online hardware-in-the-loop platform that treats delay as a timing gate, voltage and pulse duration as severity controls, and hardware outcomes as structured feedback. It implements RL-Q (Q-learning-based reinforcement learning), a structured bandit for discovery, and Structured-Outcome-Based Adaptive Search (SOBAS), a model-based policy for fault reproduction. Both policies find a target fault in every AES, password, and control-flow campaign. On AES and control flow, they require 2-85x fewer attempts and 26-1,237x less time than the baselines; on password, both succeed while the baselines fail within 5,000 attempts. After discovery, SOBAS reproduces faults 7.3-21x more often, while RL-Q identifies 30% more distinct AES settings.

0.20

Reliability Engineering for AI Systems: Challenges, Methods, and Directions

cs.AI stat.AP ·2026-09-28 ·Rong Pan, Yili Hong, Min Xie
benchmark similarity 0.51
Abstract

AI reliability concerns whether an AI system performs its intended function dependably over a stated period and under stated operating conditions, with clear evidence. As these systems become more autonomous, this function should include more than only a correct output. Retrieval, memory, tool use, permissions, human oversight, and interactions among systems must operate consistently and safely, and, for a generative AI, so must the reasoning process that produces the output. Average benchmark accuracy only measures system capability; it does not quantify this broader reliability claim. This paper adapts established reliability engineering methods, from failure definitions and operational envelopes to FMEA, accelerated testing, field monitoring, and reliability growth, to AI systems. A four-level diagnostic framework classifies failures as component, operational-loop, agentic-conduct, or network and governance failures. Test, evaluation, verification, and validation (TEVV), sequential monitoring, and FRACAS create and refresh evidence. The SMART framework provides statistical guidance for measurement, analysis, assessment, and test planning, and the NIST's AI risk management framework provides organizational guidance for governance, evaluation, monitoring, and mitigation. Three cases are discussed to illustrate these programs. It is shown that while the established reliability engineering principles can still provide a usable foundation, new measurements and safety guardrails are urgently needed as these systems are self-evolving at a fast pace.

0.14

From Laboratory Aging Studies to Field Predictions: Quantifying Uncertainty in Battery Storage Lifetime Predictions

eess.SY ·2026-09-09 ·Melina Graner, Jan Figgener, Andreas Jossen, Holger Hesse
benchmarkcode/data similarity 0.50
Abstract

Predicting how long a battery energy storage system will last is critical for warranty design, maintenance planning and investment decisions, yet degradation models are mostly deterministic and rarely validated against real field data. We apply an open-source probabilistic degradation framework, combined with a cell-to-system approximation, to bridge the gap between cell-level laboratory aging models and system-level field predictions for residential battery energy storage systems with quantified uncertainty. The framework predicts cell-level state-of-health to within 0.4 % mean absolute error, roughly half the error of prior models for this dataset. When applied to field operation data, the framework's predictions are consistent with all three available system-level capacity measurements - a benchmark rarely available for open probabilistic degradation models. Cell-level heterogeneity is approximated by two bounding stress scenarios differing only slightly (a 5 % spread in temperature and a 9 % spread in current). The mean degradation trajectories of the two scenarios reach end-of-life 10 months apart, while the full predicted end-of-life range across both scenarios spans approximately three years, about a third of the expected system lifetime. We link this uncertainty to two drivers. One is a systematic mismatch between laboratory test conditions and field-representative operating stress. The other is variability in the training data itself. These insights translate into concrete, resource-efficient recommendations for future aging study design, supporting more confident predictions of battery lifetime under real-world conditions.

0.17