CS Paper Radar

Regret-Based Max-Pressure Traffic Signal Control under Uncertain Traffic States

Chaopeng Tan, Qiongdan Hu, Meng Wang

eess.SY math.OC ·submitted 2026-10-23 07:49 UTC · v1

Abstract

Max-pressure (MP) traffic signal control selects phases using pressure scores computed from estimated traffic states, but these states are uncertain and their consequences depend on whether they alter phase ranking and how much pressure is lost. This paper develops a decision-oriented Regret-Based Max-Pressure framework that represents uncertainty through phase-selection regret, defined as the pressure loss of a candidate phase relative to the pressure-maximizing phase under each plausible latent state. We propose Stochastic Regret MP, which minimizes expected regret under a calibrated residual distribution, and Distributionally Robust (DR) Regret MP, which minimizes worst-case expected regret over a Wasserstein ambiguity set. Robustifying regret rather than absolute pressure makes the formulation invariant to state-dependent pressure components shared by all candidate phases, thereby focusing robustness on relative phase quality. We further derive an explicit queue-linear pressure-loss bound and establish strong queue stability when the net-service reserve exceeds the resulting loss coefficient. Numerical experiments show that both methods reduce normalized true-state pressure regret by about 70% relative to Point-estimate MP, while DR Regret MP yields lower network queues than direct robustification of absolute pressure. In microscopic SUMO experiments on a 28-intersection real-world network, Stochastic Regret MP and DR Regret MP reduce mean delay by 18.9% and 14.9%, respectively, and retain benefits under detector undercount and failure. The results show that representing uncertainty through its decision consequences can improve reliable traffic control under imperfect state information.

Comment
29 pages, 7 figures

Closest papers

Nearest neighbours by meaning across the whole index.

Decision Timescales in Max-Pressure Traffic Signal Control: Theory, Methodology, and Validation

eess.SY ·2026-10-23 ·Chaopeng Tan
benchmark similarity 0.61
Abstract · 31 pages, 11 figures

Max-pressure (MP) control adapts signal phases to prevailing traffic states, but its decision timescale is typically fixed a priori. This paper treats the decision timescale as an explicit dimension of MP control. We first characterize the trade-off between responsiveness and switching efficiency by quantifying how an equivalent switching loss reduces service capacity over a finite decision interval. This yields a load-dependent critical timescale determined by switching loss and normalized traffic load, together with a performance-oriented operating range above the stability boundary. Building on this result, we propose Variable-Timescale Max-Pressure (VT-MP), in which each intersection selects its decision interval according to local operating conditions, allowing the control timescale to vary across time and space. We establish strong stability of the resulting asynchronous heterogeneous controller under uniformly admissible local loads and bounded decision intervals, and introduce a downstream receiving-supply correction for finite-storage implementation. Three experiments provide mechanism validation and network-level evaluation. A single-intersection experiment confirms that the preferred decision interval increases systematically with traffic load and follows the derived characteristic timescales. In a store-and-forward network, heterogeneous VT-MP reduces total queueing time by 31.0% relative to the best fixed-interval benchmark. In a microscopic 5x5 SUMO network, it reduces mean trip delay by 24.3%, from 213.3 s to 161.5 s, and peak network accumulation by 12.3%. These findings show that the MP decision timescale should be treated as a traffic-state-dependent control variable rather than a fixed implementation parameter.

0.30

Stability-Preserving Reinforcement Learning for Heterogeneity-Aware Composite Max-Pressure Traffic Signal Control

eess.SY ·2026-10-22 ·Jichen Zhu, Chaopeng Tan
similarity 0.58
Abstract

Reinforcement learning (RL) provides a flexible mechanism for adapting traffic signal control to heterogeneous traffic and sensing conditions, but directly learned signal actions do not automatically inherit the analytical properties of structured traffic-control methods. This paper proposes Com-MP, a theory-guided RL framework that learns a context-dependent composition of multiple max-pressure (MP) control preferences while retaining decentralized MP phase selection. The learned policy adapts the relative influence of constituent MP formulations according to local traffic and sensing conditions, allowing data-driven adaptation to operate within a structured traffic-control framework. We show that such intersection-specific and time-varying composition preserves strong queue stability for every demand in the strictly stabilizable region under any admissible non-anticipative composition policy, thereby separating the performance-adaptation role of learning from the stability property of the underlying controller. In a representative implementation combining detector-supported queue-based MP and connected-vehicle-supported travel-time MP, experiments on a real-world 45-intersection network show that Com-MP reduces average delay by 15.6\% and 8.6\% relative to the two constituent controllers, respectively, and by about 7.0\% relative to the best fixed composition. The learned composition responds systematically to local traffic and sensing conditions, remains effective under heterogeneous and degraded sensing, and can be transferred without retraining to an unseen network with an average delay only 2.4\% higher than that of a policy trained directly on the target network. These results show how learning-based adaptation can be introduced within a stability-preserving traffic-control structure, providing a theory-guided pathway toward trustworthy learning-enabled traffic signal control.

0.46

Beyond Prediction Residuals: Conformal Regret Calibration for Robust Contextual Linear Optimization

cs.LG stat.ML ·2026-11-09 ·Lingjie Zhao, Hansheng Jiang, Wei Qi
theory similarity 0.53
Abstract

Predict-then-optimize systems convert contextual forecasts into decisions, yet conformal robust optimization typically calibrates prediction residuals rather than downstream loss. For linear optimization, this parameter-space geometry can be badly misaligned with decision risk: large objective perturbations may preserve the optimizer, while small boundary-crossing perturbations may cause substantial regret. We introduce Conformal Regret Sets, a post-hoc, model-agnostic framework that conformalizes an optimization-derived regret surrogate and uses its calibrated level set for minimax-regret refinement. We first show that directly conformalizing exact regret, although sufficient to certify the nominal predict-then-optimize decision, yields a degenerate robust problem: absent an exogenous bounded support, every alternative decision has unbounded worst-case regret. We therefore use SPO+, a pointwise upper bound on exact regret, as the conformal score, obtaining distribution-free finite-sample marginal regret guarantees under exchangeability. For contextual linear programs, the resulting set decomposes into polyhedral pieces aligned with the normal fan of the feasible polytope. A vertex is active if and only if its predicted suboptimality gap is at most half the calibrated threshold $η$, enabling local, output-sensitive generation of all relevant pieces. Moreover, if $Γ$ is the predicted gap to the closest competing vertex, the nominal and refined decisions admit the sharper worst-case-regret certificate $(η-2Γ)_+$, with an exact early exit when $η\leq 2Γ$. Experiments on contextual fractional knapsack validate the geometry and certificates: continuous refinement reduces the $0.95$-quantile and $\operatorname{CVaR}_{0.95}$ of regret by $9.1\%$ and $13.1\%$ relative to nominal PTO, while vertex-restricted refinement changes only $10.0\%$ of nominal decisions.

0.10

Decision Aware Origin-Destination Demand Estimation with Structurally Constrained Data

cs.LG ·2026-11-09 ·Xianzhe Wang, Yueyue Fan, Johannes Royset
position similarity 0.53
Abstract

Origin-destination (OD) demand plays an important role in transportation system design and management applications. Conventional OD estimation methods typically judge estimation quality based on how estimated demand aligns with observed traffic data and historical demand patterns. We argue that data alignment alone is insufficient; how errors in OD estimates influence downstream decision quality should also be considered. This paper develops a decision aware OD demand estimation framework that leverages structurally constrained traffic data to characterize an admissible demand region, within which we identify OD estimates that would lead to least regret in the downstream decision. Therefore, our OD estimates are both data-consistent and decision-relevant. Methodologically, we approximate the admissible demand region induced by physical network constraints through a geometric representation, which regularizes the search over feasible OD estimates. Within this regularized region, we use a convex surrogate of downstream regret to obtain a tractable decision aware optimization problem. Numerical experiments show that the proposed framework consistently reduces decision regret relative to conventional estimation benchmarks, demonstrating the value of aligning OD demand estimation with downstream decision quality.

0.32

Toward Optimal Regret in Adversarial MDPs with Stochastic Hard Constraints

cs.LG ·2026-10-08 ·Qian Zuo, Francesco Emanuele Stradi
theory similarity 0.53
Abstract

We study episodic constrained Markov decision processes with adversarial losses under stochastic hard constraints. Specifically, starting from a known strictly feasible policy with margin $d$, we seek to obtain optimal regret while satisfying the expected cost constraints in every episode. In this setting, Stradi et al. (2025) show that a carefully designed mixing rule attains regret of order $\widetilde{\mathcal{O}}(\sqrt{T}/\min\{d,d^2\})$. Interestingly, they also provide a lower bound of order $Ω(\sqrt{T}/ρ)$ for the same setting, where $ρ$ is the Slater margin of the offline problem and can be much larger than $d$. In this work, we build on their approach to obtain optimal regret dependence on these margins. Specifically, we propose MA-OPS, an algorithm that combines an optimistic search for the Slater margin with a pessimistic evaluation of the selected policies to safely learn a policy with a large feasibility margin. This policy is then used to minimize regret while satisfying the constraints at every episode. In particular, we show that MA-OPS attains regret $\widetilde{\mathcal{O}}(\sqrt{T}/ρ+ 1/(dρ))$. Finally, we provide a matching lower bound, showing that the dependence on $T$, $d$, $ρ$ in the regret bound is optimal up to logarithmic factors.

0.20

Risk-Averse Decision-Focused Learning: Minimizing CVaR of Regret

cs.LG cs.AI ·2026-11-14 ·Jayanta Mandi, Senne Berden, Victor Bucarey, Concepcion Dominguez, Tias Guns
similarity 0.53
Abstract

Many combinatorial optimization (CO) problems involve parameters that are uncertain when the problem must be solved. In such settings, the parameters have to be predicted from correlated contextual information before a solution can be computed. \emph{Decision-focused learning} (DFL) addresses this by training the predictive model to produce predictions that optimize downstream decision quality. Most existing DFL methods are risk-neutral and minimize the expected regret. In high-stakes applications this can lead to undesirable outcomes, because decision-makers must also account for the tail risk of decision quality. Prior risk-sensitive approaches typically model uncertainty explicitly and solve a stochastic or robust optimization problem at inference time, which increases computational complexity. We instead propose a DFL framework that achieves risk-sensitive behavior while retaining point predictions and deterministic optimization at inference time. Starting from the dual representation of the Conditional Value-at-Risk (CVaR) and adding entropy regularization, we derive a smooth surrogate for the CVaR of regret. Its gradient induces an instance-dependent reweighting within each minibatch that emphasizes high-risk outcomes, so the approach can turn existing surrogate-loss DFL methods, including the SPO+ loss, into risk-sensitive variants. When instantiated with SPO+, the resulting objective admits a generalization bound on the CVaR of the true regret. Experiments on knapsack, portfolio, shortest-path, and energy-aware scheduling problems show substantial reductions in tail regret when the uncertain parameters exhibit heterogeneous tail behavior.

0.12

A Rollout-Based Approach to Real-Time Topology and Dispatch Control in the AI4RealNet L2RPN Benchmark

eess.SY math.OC ·2026-11-16 ·David Krame Kadurha, Robbert van der Burg, Alessandro Zocca, Sandjai Bhulai
benchmarkcode/data similarity 0.52
Abstract

Operating transmission networks under uncertain outages requires coordinating discrete network topology actions with continuous adjustments to generation and storage, while respecting operational constraints and real-time computational limits. We present a rollout-based controller that combines discrete and continuous decisions under the uncertain contingency policy of the L2RPN AI4RealNet 2026 challenge. Power-flow approximations and convex optimization identify the most promising actions, followed by short-horizon simulations to predict their effect on congestion, renewable curtailment, and redispatching costs. A further policy exploits the benchmark's specific attack protocol: keeping selected lines disconnected prevents some adversarial outages from being initiated. On the benchmark's $118$-bus network, the controller completed $189$ of $208$ final-test scenarios (score $64.39$) and achieved the second-best ratio of score to computation time among the five top-ranked entries, behind one that scored lower. Our results show that combining structured optimization with simulation-based action selection is effective even without a learned decision rule, and fast enough for real-time control. Code and reproduction material: https://github.com/DavidKrame/RAD_agent__AI4RealNet_competition.

0.55

Regret-Optimal Linear-Quadratic Control under Distributional Drift

eess.SY math.OC ·2026-10-06 ·Lukas-Benedikt Fiechtner, Jose Blanchet
similarity 0.52
Abstract · 16 pages, 2 figures, 1 table. Submitted to the 2027 American Control Conference (ACC); under review

We study finite-horizon LQR with independent disturbances whose laws may drift over time. We address uncertainty in this evolution through ex-ante distributionally robust regret optimization (DRRO), which minimizes worst-case excess expected cost relative to the optimal causal controller that knows the law sequence. To specify the admissible law sequences, we introduce a temporally coupled moment ambiguity set with a Gelbrich kinetic-energy budget and a second budget limiting departures from reference moments and persistent cumulative mismatch. Despite the coupling of moments across time, affine disturbance-feedback synthesis reduces exactly to a semidefinite program. An optimal policy uses past disturbances to predict the correction to nominal LQR determined by current and future disturbance means. The SDP solution also yields worst-case moment paths and corresponding laws. For standard distributionally robust optimization (DRO), the analogous SDP relaxation can have a duality gap. Portfolio liquidation experiments show substantially lower worst-case regret over the drifting ambiguity set than common-law DRRO and nominal control.

0.29