CS Paper Radar

Regime-Dependent Value of CVaR in Preventive Maintenance Scheduling under RUL Uncertainty

Jerzy Baranowski, Waldemar Bauer

eess.SY ·submitted 2026-09-27 22:43 UTC · v1

Abstract

We study preventive-maintenance scheduling for a small fleet when several assets compete for a limited number of maintenance slots and their remaining useful lives (RULs) are uncertain. The planning horizon is divided into discrete periods; each asset may be maintained at most once, and at most $K$ assets may be maintained in any one period. Future usage and RUL errors are represented by scenarios. We compare a risk-neutral policy that minimizes expected cost with a risk-aware policy that minimizes expected cost plus conditional value-at-risk (CVaR), where $\operatorname{CVaR}_{0.90}$ is the mean cost among the worst 10\% of scenarios. Both policies are solved exactly by enumerating all capacity-feasible schedules. A $3\times5$ experiment combines capacities $K=1,2,3$ with five increasing levels of RUL uncertainty, with ten paired replications for each combination. The risk-aware policy provides its largest benefit when RUL uncertainty is low-to-moderate and more than one maintenance action can be executed per period. In the best observed case, it reduces CVaR by 13.4\% with an expected-cost increase of only 0.2 relative cost units. At high uncertainty, the benefit becomes negligible and the two policies can select identical schedules. The results show that risk-aware scheduling creates operational value only when prognostic information is sufficiently informative and the maintenance system has enough flexibility to act on it.

Comment
This work has been submitted to the IEEE for possible publication

Closest papers

Nearest neighbours by meaning across the whole index.

Planning or Learning: Reliability and Cost in Multi-Asset Maintenance

cs.AI cs.LG ·2026-09-11 ·Xian Yeow Lee, Chandrasekar Venkatraman, Ahmed Farahat
publishedbenchmark similarity 0.69
Abstract

Industrial maintenance systems involve multiple interacting assets and shared resources, making it challenging to balance reliability and operational cost using a single decision framework. While recent work has focused on reinforcement learning (RL) for maintenance scheduling, direct comparisons with planning approaches under identical settings remain limited. In this work, we empirically compare planning and RL for multi-asset bearing maintenance using run-to-failure data. We examine how these methods behave when balancing preventive maintenance against tolerable failures across a range of failure penalty scenarios. We observed a consistent behavioral difference driven by objective formulation. Planning enforces reliability as a hard constraint and produces zero-failure policies whose total cost is largely insensitive to the magnitude of failure penalties. RL agents optimize expected cost and often trade off preventive maintenance against occasional failures as penalties vary, resulting in lower costs under low-penalty regimes but persistent non-zero failures even when penalties are high. We also investigate lightweight constraint mechanisms, including reward shaping and action masking, to encourage RL's reliability. From a practical perspective, planning may be more suitable when strict reliability is required and deployment horizons are short, whereas RL may provide cost-efficient policies when limited failures are acceptable and long-run operational efficiency is prioritized. Overall, this study clarifies the trade-offs between reliability and cost in multi-asset maintenance and suggests that planning and RL are complementary approaches. Beyond these findings, the controlled benchmark protocol itself that unifies environment, cost model, and evaluation across paradigms, offers a reusable template for comparing decision-making approaches in other maintenance settings.

0.32

Condition-Based Maintenance of Degrading Assets underIntermittent Accessibility

eess.SY ·2026-09-29 ·Muhammet Ceyhan Sahin, Murat Yildirim, Onur A. Kilic
similarity 0.66
Abstract

Many maintenance models implicitly assume that maintenance can be performed whenever intervention is warranted. In practice, however, environmental uncertainty, such as weather and sea conditions, can make maintenance opportunities intermittent and dynamically evolving. We consider a degrading asset for which preventive maintenance may be performed before failure, but intervention is possible only when the asset is accessible. Accessibility evolves stochastically over time and therefore affects not only whether maintenance can be performed now, but also the value of waiting for future opportunities. We formulate this setting as a finite-state Markov decision process under a long-run average cost criterion and investigate the structure of the optimal maintenance policy. Under monotone degradation and cost conditions, we show that an optimal policy retains a threshold form in asset condition, but unlike a single threshold, the optimal threshold varies with the accessibility state. Thus, intervention depends jointly on the asset condition and the expected evolution of future maintenance opportunities. Through a numerical study motivated by offshore wind turbine maintenance, we examine how accessibility dynamics, degradation characteristics, and economic parameters shape the optimal thresholds and compare the optimal policy with constant-threshold and age-based maintenance policies. In a representative setting, adapting the condition threshold to accessibility reduces long-run average cost by 4.31% relative to an optimized condition-based maintenance policy. Relative to an optimized age-based policy, the optimal policy reduces long-run average cost by 33.95%. The results show that maintenance thresholds are not universal: they should adapt to the degradation and accessibility characteristics of the system, and failing to account for these conditions can lead to substantial cost increases.

0.20

Integrating Prognostics, Maintenance, and Tail Assignment under Remaining Useful Life Uncertainty: A Stochastic Optimisation Approach for Airline Reliability

eess.SY ·2026-08-23 ·Benno Käslin, Marta Ribeiro, Dimitrios Zarouchas, Manuel Arias Chao
similarity 0.64
Abstract

Ensuring reliability, safety, and economic efficiency in airline operations requires maintenance and fleet scheduling strategies that explicitly account for uncertainty in Remaining Useful Life (RUL) predictions. However, the integration of prognostic uncertainty into operational decision-making remains a major challenge. In practice, tail assignment (TA) and maintenance scheduling (MS) are typically optimized separately or sequentially, thereby limiting the effective use of predictive health information despite their strong interdependencies. This paper proposes a unified optimisation framework that jointly integrates TA, MS, and predictive maintenance (PdM) under RUL with confidence intervals. The problem is formulated as a stochastic mixed-integer linear program, and a scalable solution approach is developed by embedding a neural network surrogate to approximate expected disruption costs resulting from RUL uncertainty. The proposed framework is evaluated using operational scenarios derived from real-world airline data. Results show that explicitly incorporating prognostic uncertainty in a joint planning model reduces operational risk, i.e., downstream disruption costs and flight cancellations, compared to deterministic and sequential approaches, at the expense of moderate increases in planning cost. These findings highlight the value of tightly coupling predictive maintenance with operational planning and demonstrate the potential of surrogate-assisted stochastic optimisation for scalable, uncertainty-aware airline decision-making.

0.27

A 5/3 Guarantee for Echelon Stock (R,nQ) Policies in Two-Stage Stochastic Serial Systems

cs.DS math.OC ·2026-09-06 ·Ming Hu
benchmarktheory similarity 0.59
Abstract · 32 pages of main text and references, plus a 32-page online appendix; 6 figures

Fixed shipment costs encourage large orders, while inventory and customer backlog costs favor frequent replenishment. In a serial system, the stages must also coordinate their lot sizes and material availability. We study the classical echelon stock $(R,nQ)$ policy: the downstream stage requests a fixed lot, the upstream stage orders an integer multiple of that lot, and transfers contain complete lots. For unit Poisson demand, deterministic lead times, setup and holding costs at both stages, and full backlogging, we prove that the optimized cost in this class is at most $5/3\approx1.667$ of the optimal admissible system cost, uniformly over all nonnegative cost rates, demand rates, and lead times. The guarantee holds even when the selected policy pays a setup charge for every lot while the optimal benchmark pays only once per aggregate shipment. To obtain the guarantee, we use a common inventory calculation that allows independently chosen replenishment frequencies while respecting upstream material availability. We compare its optimized value, an upper bound on the best integer-ratio policy cost, with a novel lower bound on the optimal system cost that combines allocated single-stage costs with the minimum inventory cost when setup costs are zero. We also show that no uniform factor below $(1+\sqrt{3})/2\approx1.366$ is possible for the classical class. Existing numerical experiments place best-found classical policies within $22.7\%$ of an evaluated lower bound across three broad grids. The results quantify both the reliability and the limits of a simple operating rule and explain how shipment consolidation, replenishment timing, and flexibility affect its value.

0.26

Online Resource Allocation with Replenishable Budgets

cs.GT ·2026-09-28 ·Eleonora Fidelia Chiefari, Francesco Emanuele Stradi, Alberto Marchesi
similarity 0.59
Abstract

Online Resource Allocation (ORA) is a fundamental framework for sequential decision-making problems under budget constraints. Classical ORA models typically assume that resources are monotonic, meaning that selecting actions can only decrease the available budget. In this work, we study a more general setting with replenishable budgets, in which actions may either consume or replenish resources over time. This extension is necessary to capture scenarios such as inventory systems or energy markets in which capacity can be actively recovered. We develop a dual-based algorithm that recovers best-of-both-worlds guarantees for standard ORA when the replenishment factor $β= 0$, and improves them when $β> 0$. In particular, our algorithm attains $\widetilde{\mathcal O}(\sqrt{T})$ regret in the stochastic setting and $\widetilde{\mathcal O}(\sqrt{T})$ $α$-regret in the adversarial setting, where $α$ depends on the per-round budget and on the replenishment factor of the void action. Moreover, the algorithm ensures strict satisfaction of the budget constraints.

0.12

Chance-constrained selection of sequential intervention strategies from counterfactual estimates

cs.LG stat.MEstat.ML ·2026-08-13 ·Minkyoung Kim, Beakcheol Jang
code/data similarity 0.58
Abstract · 46 pages, 10 figures, 20 tables. Includes supplementary material as an appendix

Many operational decisions are sequences of interventions under a cumulative resource limit, such as a maintenance schedule within a crew-hour budget. Choosing among them calls for the outcome and the cumulative cost each would produce, counterfactual quantities identified from observational data. Two strategies with the same expected cost can exceed the budget at very different rates, so constraining the mean does not bound how often an overrun occurs. Prior two-step architectures, recently extended to continuous doses, constrain the mean cost rather than its tail and allocate at a single decision point. Methods that do bound a cost tail take its distribution from a specified model rather than identifying it from data. We present a predict-then-optimize framework. In the prediction step, any estimator returning an outcome value and a cost distribution supplies what the decision rule consumes, so the predictor is interchangeable. In the optimization step, a chance-constrained selection over a finite candidate set bounds the probability that the cumulative cost exceeds the budget. That tail does not decompose across stages, so each strategy is scored whole. Sweeping the tolerated violation probability traces a safety-utility frontier, and distribution-free finite-sample bounds cover violation and outcome shortfall. Four of five environments, spanning clinical treatment and equipment maintenance, supply exact counterfactual ground truth; the fifth carries real outcomes from a digital-health micro-randomized trial. Across them, the rule holds the budget where a point-estimate rule overruns it, at an outcome cost the frontier makes explicit. All code is available at https://github.com/mfriendly/counterfactual-chance-selection

0.30

ERRAND: Budgeted Maintenance of Agent Memory

cs.AI ·2026-09-02 ·Beining Wu, Zihao Ding, Jun Huang
similarity 0.58
Abstract

Deployed agents run on handed-over knowledge: a frozen policy consults a briefing of consolidated items written before the stream begins. The world then moves while the store stands still: paths close, flags change, price bands move; every item was true at handover, and the failure is staleness, not ignorance. We introduce ERRAND, which treats revalidation as a priced errand: a recheck competes with the task it protects for the same scarce actions, funded only when the value per action of resolving a doubt clears a running wage. The errand index is single-peaked, vanishing at both ends of belief, so certainty in either direction costs nothing; free en-route receipts maintain on-path knowledge, and repair writes a version, never a deletion. Under equal action budgets in two drifting tool-use worlds, ERRAND clears every non-oracle policy on the preregistered calibers, primary in every setting and conditional at every binding budget, leading eager revalidation by 10.0pp at the base cap. Restraint wins: given no cap, ERRAND stops on its own, spending 11.0% of steps, while uncapped eager revalidation spends 70.7% and still finishes 4.5pp behind capped ERRAND. The margin sits where the briefing's coverage is thinnest, the shadow price of long-tail knowledge: a small budget, well priced, beats a bigger store that never rechecks.

0.51

Clean Sheets and Checkpoints: Evidence Complexity for Certifying Sequential Agent Risk

cs.LG cs.AI ·2026-10-29 ·Rohith Yanambaka Venkata, Don McBride, Tiago Sequeira, Md. Al Amin
similarity 0.58
Abstract · 26 pages, 3 figures, 3 tables

Dangerous-capability evaluations often test an AI agent from prepared states at ordered milestones. A clean sheet records no successes. What it certifies about a campaign of $B$ attempts depends on what a failed attempt erases. We model the task as a chain of $k$ milestones divided into checkpoint segments and ask how many zero audit responses certify, at level $α$, a completion probability of at most $ε$. For segments chosen before the audit, counting possible completion windows gives a certificate for any specified budget. The bound also covers adaptive deployment processes that follow the chain's transitions, provided their success probabilities after every complete history are capped by the corresponding audit success probabilities. The audit does not test this transport assumption. In rare-risk phase interiors, each segment is either rarely completed within the budget (active) or nearly always completed (free). The minimum expected number of zero responses is asymptotic to $\log(1/α)\,(B^a/(a!\,ε))^{1/K_A}$, where the $a$ active segments contain $K_A$ milestones and are those at least as long as a budget-dependent threshold. The certificate attains this constant. Every asymptotically optimal evaluator must divide its expected response count equally among active milestones in the limit, with a vanishing share elsewhere. Where a single segment passes from active to free, each of its milestones receives a smaller limiting share than an active milestone; a crossover-aware certificate attains the optimal constant. For selected segments with known or unqueried prefix steps, counting failed cycles can sharpen the certificate.

0.29