CS Paper Radar

Online Learning-Based Adaptive Hybrid Benders Decomposition for Risk-Averse Optimal Sizing

Saif Ahmad, Seifeddine Benelghali, Hafiz Ahmed

eess.SY ·submitted 2026-09-22 13:06 UTC · v1

Abstract

Optimal sizing problem (OSP) for battery energy storage system (BESS) under uncertain inputs is often formulated as a two-stage stochastic program (2SP), which typically introduces computational and RAM (memory) bottlenecks for large scenario sets. Benders Decomposition (BD) is a popular approach for tackling this problem, but it suffers from slow convergence to the exact solution. To address this problem, we propose an accelerated online learning-based adaptive hybrid BD algorithm for a risk-averse 2SP formulation. The proposed method avoids getting stuck in the infeasible region during early iterations by explicitly embedding a carefully selected scenario in the master problem, while a tail-relevant scenario selector based on online learning helps to avoid solving the entire scenario set at every iteration. The OSP is formulated to select a behind-the-meter BESS in a multi-site energy community with existing renewables. The use case explores an interesting middle-ground between deterministic acceleration methods and training-heavy ML models, showcasing the potential of ML-assisted decision-making. Compared with vanilla BD, OLAH-BD reduces subproblem evaluations and total wall time by up to 80\% under the same tolerance settings.

Closest papers

Nearest neighbours by meaning across the whole index.

Decision-Focused Learning via Neural Optimization Layers for Battery-Assisted Grid-Import Smoothing in AI Data Centers

eess.SY cs.LGmath.OC ·2026-11-10 ·Xinda Zheng, Canchen Jiang, Frits de Nijs, Edward Lam, Markus Wagner
similarity 0.67
Abstract

Rapid AI data-center power fluctuations challenge grid integration. Sustained grid-import smoothing requires allocating limited battery power and energy under uncertain demand. We formulate risk-aware BESS scheduling that coordinates advance reserve commitments and demand-responsive dispatch, accounting for operating costs, grid-ramp penalties, and their conditional value-at-risk. We develop battery scheduling decision-focused learning (BS-DFL) with a constraint-aware neural optimization layer trained directly from this objective without optimal-solution labels. The trained layer is then frozen to guide demand-predictor learning through scheduling costs and ramping risk, enabling solver-free rolling-horizon scheduling. In a 10,000-minute simulation using loads derived from measured AI workloads, BS-DFL reduces mean absolute minute-to-minute grid-import changes by 71.70% and total scheduling cost by 18.01% relative to an MSE-trained predictor coupled with a mixed-integer linear programming solver, with an average decision time of 18.77 ms.

0.20

Learning Control Policies from Heterogeneous Multi-Horizon Time Series in Battery Energy Management Systems

eess.SY ·2026-09-18 ·Sheng Yin, Vivek Teja Tanjavooru, Holger Hesse, Christoph Goebel
published similarity 0.66
Abstract

This paper introduces Representation-to-Decision (R2D), an end-to-end imitation learning framework that maps heterogeneous multi-horizon time-series inputs directly to battery control decisions through modular Temporal Feature Extractors (TFEs) and a shared latent representation, without an explicit load and PV forecasting step. While accurate forecasting improves prediction quality, optimal control performance remains unguaranteed in prediction-then-optimization pipelines; standard Reinforcement Learning (RL) lacks the long-horizon temporal awareness due to short-window observations, even when forecast signals are available as additional inputs. R2D offers a different perspective: rather than forecasting first and deciding second, it learns to decide directly from raw temporal inputs, with control optimality anchored by an aging-aware Mixed-Integer Linear Programming (MILP) expert through Behavior Cloning (BC). Benchmarked against six controllers on a high-fidelity electro-thermal battery simulation across five industrial sites, R2D achieves 62--77\% of the global clairvoyant optimum, outperforms the tested Model Predictive Control (MPC) and RL benchmarks, and yields battery degradation nearly identical to its MILP teacher across all five sites. Comprehensive ablation studies over temporal backbone, model size, expert formulation, aging-cost weighting, and horizon configuration confirm that an LSTM encoder with a 15-minute single-step control horizon provides the most robust and deployment-ready configuration, and cross-site and single-factor out-of-distribution tests show that generalization to unseen profiles is profile-dependent, with policies trained on high-activity sites transferring most reliably.

0.26

Safe Receding Horizon Mixed-Integer Differentiable Predictive Control for Degradation-Aware Battery Dispatch

eess.SY ·2026-09-23 ·Eshagh Safarzadeh Ravajiri, Jan Drgona, Benjamin F. Hobbs
publishedbenchmark similarity 0.65
Abstract · 6 pages, accepted to the 65th IEEE Conference on Decision and Control (CDC 2026)

We present a safe receding-horizon mixed-integer differentiable predictive control methodology for residential battery energy storage dispatch that combines neural-network speed with recursive feasibility guarantees. Unlike open-loop learning-to-optimize methods, it incorporates real-time state-of-charge feedback and sinusoidal time-of-day conditioning, enabling closed-loop re-planning at every timestep without re-solving a mixed-integer program. A differentiable rainflow cycle-counting layer enables self-supervised training of the mixed-integer policy on exact degradation physics. The controller is a hybrid closed-loop system pairing a neural mode-selection and continuous-action policy with a quadratic-programming safety filter that guarantees recursive feasibility independent of network weights or mode optimality. We establish mode-conditioned Lipschitz continuity and a conditional regret decomposition into training-quality, mode-mismatch, and forecast-error terms. On a 7-day net-metering evaluation, the method attains a 6.9% cost gap versus the closed-loop mixed-integer MPC benchmark with a 25x speedup (0.11 s vs 2.7 s per step), while average regret rises by under 4% across 0-30% forecast noise. The learned and benchmark modes agree at every step, so the bound reduces to its training-quality and forecast-error terms, both empirically validated.

0.19

Decision-Focused Learning for Optimal Battery Scheduling Under Load and Photovoltaic Power Uncertainty in Microgrids

eess.SY ·2026-10-10 ·Marios Saleptsis, Antoine Lesage-Landry, Marco Mussetta, Sonia Leva
similarity 0.65
Abstract · 20 pages, 13 figures, submitted to Sustainable Energy, Grids and Networks

The increasing penetration of renewable energy sources in microgrids demands accurate day-ahead forecasting to support optimal battery energy storage system (BESS) scheduling. Yet the conventional predict-then-optimize paradigm trains forecasters on statistical accuracy metrics that are agnostic to the asymmetric and time-varying cost impacts of forecast errors. This work proposes a decision-focused learning (DFL) framework that trains gated recurrent unit forecasters for both load demand and photovoltaic generation directly on the downstream operational cost of a two-stage energy management system, where day-ahead BESS commitments are fixed prior to real-time balancing. Gradients are backpropagated from the real-time operational cost through both optimization stages to the forecaster weights via implicit differentiation, enabling the forecasters to internalize the penalty structure of the scheduling problem. The framework is validated on the MG2Lab experimental microgrid testbed at Politecnico di Milano across two operational scenarios of increasing grid constraint and eight forecasting configurations comprising single-source and combined-forecaster settings. Results illustrate that the DFL-trained pipeline reduces operational cost by 3.78% under normal grid conditions and by 30.60% under grid-constrained conditions relative to the accuracy- optimized baseline, while nearly eliminating load shedding events. Notably, the DFL forecasters exhibit higher statistical errors than their accuracy-trained counterparts yet achieve consistently lower operational costs, confirming that forecast accuracy and decision quality do not share a monotonic relationship in constrained microgrid scheduling.

0.12

Comparative Evaluation of MILP, MPC, and Reinforcement Learning for Commercial Battery Dispatch Under Time-of-Use Tariffs

eess.SY ·2026-09-13 ·Hafiz Majid Hussain, Wajiha Samar, Lurian Klein, Pedro Nardelli
benchmark similarity 0.64
Abstract

Battery energy storage systems (BESS) paired with rooftop photovoltaics (PVs) can deliver measurable cost savings under time-of-use (TOU) electricity tariffs; however, the relative performance of model-based and model-free dispatch strategies remains insufficiently benchmarked on full-year, real-world commercial datasets. This paper presents a full-year (2023) comparative evaluation of three BESS dispatch approaches using data from a commercial PV installation operating under a TOU tariff. The examined strategies include: (i) a mixed-integer linear programming (MILP) formulation with perfect foresight, providing an oracle performance benchmark under the assumed model; (ii) a model predictive control (MPC) scheme based on a day-ahead persistence forecast, representing a low-complexity deployable approach; and (iii) a soft actor-critic (SAC) deep reinforcement learning agent trained under causal information constraints. The MILP benchmark achieves an annual cost reduction of 24.6\% relative to a no-storage baseline. The persistence-based MPC approach recovers 99.2\% of this benchmark using only prior-day data. In contrast, the evaluated SAC agent yields an annual cost higher than the no-storage baseline. This outcome is analyzed in the context of known challenges in reinforcement learning for energy systems, including limited observability and reward design. Overall, the results indicate that, for the studied dataset and tariff structure, persistence-based MPC captures nearly all achievable economic benefits under practical deployment constraints, whereas the considered RL configuration does not yield competitive performance under the same information limitations.

0.21

Cost-Informed Learning for Aggregating Building HVAC Flexibility

eess.SY ·2026-09-22 ·Jingguan Liu, Cong Chen, Xiaomeng Ai, Jiakun Fang, Jinsong Wang +1 more
benchmark similarity 0.63
Abstract · 11 pages, 14 figures

This paper develops a cost-informed aggregation framework that learns an aggregate flexibility set of building heating, ventilation, and air-conditioning (HVAC) loads to minimize the aggregator's dispatch cost. Existing aggregation methods mainly use volume-oriented objectives and treat flexibility aggregation and downstream utilization as separate stages. Consequently, the resulting aggregate set may fail to preserve the flexibility most valuable for reducing downstream dispatch costs. To address this limitation, we represent aggregate HVAC flexibility using a parameterized storage-form surrogate and jointly learn the surrogate parameters and the inner-approximation objective from downstream dispatch-cost feedback. This cost-informed feedback allocates the surrogate's limited representation capacity to cost-relevant regions of the aggregate flexibility set. To account for electricity-price uncertainty, we formulate a distributionally robust conditional value-at-risk (DR-CVaR) downstream problem that captures both distributional ambiguity and tail risk. For efficient learning, we reformulate the DR-CVaR problem as a convex second-order cone program. We estimate cost gradients using randomized smoothing and a score-function estimator, avoiding differentiation through large-scale building-level optimization problems. Case studies using NYISO price data show that the proposed framework reduces dispatch costs relative to a volume-oriented aggregation benchmark and that suitable risk and ambiguity settings can lower the out-of-sample CVaR of dispatch costs.

0.22

Hierarchical Control via MPC-RL for Multi-Timescale Battery Systems

eess.SY ·2026-10-02 ·Rasa Pourjam, Ehecatl Antonio del Río Chanona, Paulina Quintanilla
similarity 0.63
Abstract

Multi-timescale systems present a fundamental challenge, where fast operational decisions must coexist with long-horizon sustainability targets. In this work, we propose a new hierarchical control framework via Model Predictive Control (MPC) and Reinforcement Learning (RL) to separate decision-making on two distinct timescales. The high-level MPC optimizes long-horizon setpoints at the slow dynamic and on a fast timescale, a low-level pretrained RL agent tracks these setpoints in real time to maximize short-term objectives. RL is introduced to learn nonlinear control policies, without relying on model linearizations or requiring the heavy online computation from solving repeated optimal control problems. The framework is applied to a Battery Energy Storage System (BESS) operating in frequency regulation markets to balance fast profit opportunities (seconds) and slow battery degradation (weeks to months). The design employs a degradation-aware RL agent trained offline to generate safe long-horizon setpoints, and a degradation-unaware agent fine-tuned from it for fast runtime setpoint tracking. Compared to MPC baselines, the proposed approach successfully extends battery lifetime by 84% and increases operational profit by 34%.

0.17

A Stochastic Mean-CVaR Framework for BESS Multi-Market Bidding Strategies

eess.SY ·2026-09-16 ·Younes Zahraoui, Jun Cao, Samir Kouro, Pedro Rodriguez Cortes
published similarity 0.63
Abstract · The paper has been accepted in IECON26 without any comments

Battery Energy Storage Systems (BESS) operators face significant challenges when participating in multiple electricity markets due to the complex coupling of price volatility and stochastic reserve activation. Traditional deterministic dispatch models neglect the "tail risks" associated with extreme market realizations, potentially leading to technical infeasibility or severe economic losses. This paper proposes a risk-aware stochastic optimization framework for the co-optimization of BESS participation in the Day-Ahead (DA) energy market and the manual Frequency Restoration Reserve (mFRR) market. The model explicitly captures multi-dimensional uncertainties by utilizing non-parametric Kernel Density Estimation (KDE) to generate joint price scenarios that preserve the empirical characteristics of European balancing markets. A two-stage stochastic programming approach is employed.To manage the financial exposure to high-impact price events, the Conditional Value-at-Risk (CVaR) metric is integrated into a Mean-CVaR objective function. This allows decision-makers to tune their risk-aversion levels and identify an efficient frontier between profitability and robustness. Simulation results demonstrate that the proposed joint CVaR approach significantly enhances revenue stability compared to deterministic benchmarks.

0.30