CS Paper Radar

Adaptive Calibration of Day-Ahead Flexibility Reserve Requirements Under Distribution Shift

Napoleon Costilla-Enriquez, Yang Weng, Miguel A. Ortega-Vazquez

eess.SY ·submitted 2026-10-12 02:31 UTC · v1
theory

Abstract

The increasing integration of variable renewable generation introduces weather-driven variability and uncertainty into power-system operations. System operators manage the resulting deviations between day-ahead forecasts and real-time net load by scheduling upward and downward flexibility reserves. These requirements have traditionally been set using simple deterministic rules. Newer data-driven methods tailor reserves to forecasts and operating conditions. However, their reliability may deteriorate when conditions depart from the historical data. We address this limitation with a sequential framework that updates day-ahead reserve requirements as operating outcomes become available. Within this framework, Adaptive Conformal Inference targets the frequency of insufficient reserve, whereas Rolling Risk Control targets expected uncovered deviation, the mean residual beyond the scheduled reserve. We prove finite-horizon bounds on realized miscoverage and capped uncovered-deviation loss. We test the framework on real ERCOT data in a chronological deployment simulation that respects operational timing: outcomes from one day first affect the reserve schedule two days later. Training and validation use 2022--2023 data; the uninterrupted test covers 2024--2025. Coverage calibration achieves approximately 90% coverage, with upward and downward miscoverage near 5%. Risk calibration brings expected uncovered deviations close to their budgets while using 5.3% less reserve than the uncalibrated requirements. The framework thus produces adaptive reserve requirements that provably control the selected reliability metrics over finite horizons without assuming stationarity or exchangeability.

Closest papers

Nearest neighbours by meaning across the whole index.

StreamLTT: Risk Certification for Policy Selection under Stream Dependence

cs.LG math.STstat.ML ·2026-11-02 ·Jinwen Xu, Qin Lu
similarity 0.64
Abstract

Learn-then-Test (LTT) provides a general framework for certifying deployment policies against a prescribed risk target, but its standard formulation targets a fixed population risk estimated from calibration losses. In sequential deployment, losses may instead be dependent and nonstationary, so the risk of a fixed policy can evolve with the observed history. We introduce StreamLTT, which replaces this fixed population risk with average predictable risk, defined by conditioning each decision's loss on the information available before its outcome is revealed. Conditional centering turns empirical deviations from this target into a martingale sum, enabling both a test that adapts to predictable variance and a finite-sample Hoeffding alternative. Combined with family-wise error rate control, StreamLTT yields a simultaneously certified policy region that supports subsequent deployment selection. Across seven forecasting datasets and seven deployment risks, StreamLTT places the certified frontier substantially closer to the prescribed risk target than IID, robust-variance, block-bootstrap, and concentration-based alternatives, while empirical family-wise error closely follows the prescribed level. A finite-sample ablation further shows that the predictable-risk formulation drives the tighter risk frontier, while adaptation to predictable variance makes more effective use of the available family-wise error budget. StreamLTT therefore extends risk-certified policy selection to dependent deployment streams by addressing both what risk should be certified and how it should be tested.

0.29

Adaptive Residual Modeling for Scenario Learning in Probabilistic Load Forecasting

eess.SY ·2026-11-02 ·Jinbao Wang, Jun Liu, Shiliang Zhang, Xuehui Ma, Yushuai Li +1 more
similarity 0.64
Abstract

Uncertainties in weather, user behavior, and distributed energy production introduce significant variability into feeder power. Effective power system operations require both multi-horizon load forecasts and well-calibrated extreme quantiles for the forecast. Nevertheless, standard objectives that fit the full forecast distribution often underemphasize rare observations and extremes. Conversely, applying heavy tail-weighting in the distribution to capture these extremes can distort the underlying probability distribution. To address this issue, this paper proposes adaptive residual modeling for scenario learning (ARMSL), a two-stage framework. Particularly, Stage I in our framework sequentially models environmental response, history-dependent load patterns, persistent residual deviations, and the remaining innovations. Upon the modeling, we then generate joint active- and reactive-power scenarios with state-dependent dispersion. Stage II keeps the scenario model fixed and calibrates extreme marginal quantiles using a simple, channel-specific reference forecast (an anchor). Only outward deviations from this anchor are admitted, with their contribution determined by local calibration history and the current operating state. From our numerical simulations on FeederBW dataset, Stage I outperforms diffusion baselines in energy and variogram scores. Our complete framework achieves an active-power 0.99-quantile pinball loss of 0.1932 (a 30.08% to 85.33% reduction relative to three baselines) with 1.054% exceedance rate against a nominal 1%. From simulations on the Rolle dataset, we observe decreased losses by 5.39%--14.40% compared to the active-power-only anchor. Furthermore, the unchanged Stage I scenarios in the simulation yield a correlation of 0.953 between predicted and observed feeder event rates, with 90.0% of feeder errors falling within two percentage points.

0.23

Multi-Day Stochastic Dispatch for Power Systems With Long-Duration Storage Using Diffusion-Generated Weather Forecasts

eess.SY ·2026-10-12 ·Leonard Göke
benchmark similarity 0.64
Abstract

As power systems shift toward high shares of wind and solar, long-duration storage becomes pivotal for balancing multi-day deficits and surpluses of uncertain supply and demand. Current dispatch strategies for long-duration storage either assign a fixed value to stored energy or extend the modeled horizon using a single forecast. Stochastic system dispatch with a multi-day horizon for long-duration storage remains unexplored, and existing stochastic dispatch only considers day-ahead uncertainty or Markovian uncertainty beyond one week of perfect foresight. Therefore, we benchmark stochastic multi-day dispatch against deterministic alternatives in a rolling-horizon setup. To emulate probabilistic multi-day forecasts, we combine diffusion with a semi-Markov model of weather regimes and a logistic growth model for meteorological forecast errors. At high renewable shares, stochastic operation reduces thermal backup generation and consistently eliminates loss of load. The benefits decrease with smaller shares of renewables, less long-duration storage, or higher forecast skill. Overall, our results suggest that systems with high shares of variable renewables can substantially benefit from probabilistic multi-day forecasts and stochastic dispatch.

0.17

Dynamic Operational Reserve Margin Assessment from Risk-Constrained Unit Commitment States

eess.SY stat.AP ·2026-09-02 ·Pratishtha Shukla, Shaked Regev, Evan J. R. Brody, Charles Foltz, Teja Kuruganti
similarity 0.63
Abstract

We propose Dynamic Reserve Margin (DRM) as a time-varying operational adequacy metric derived from risk-constrained unit commitment (RCUC) states. DRM quantifies reserve adequacy using the additional generation capacity that committed generators can provide within a 5-minute response window relative to uncertainty and contingency reserve requirements. We introduce a complementary Reserve Risk Envelope (RRE) metric to quantify operational reserve headroom in directly interpretable MW terms. A low-margin duration metric is further developed to quantify the persistence of reserve stress over an operating horizon. We use an IEEE 14-bus example to illustrate these concepts, followed by large-scale RCUC case studies under multiple operating scenarios. Results demonstrate that reserve requirements and ramp-accessible reserve capability can vary substantially across operating conditions, and that commitment decisions adapt to maintain reserve adequacy under changing system conditions. The proposed DRM and RRE metrics provide an interpretable operational characterization of reserve adequacy, reveal reserve accessibility and stress persistence that are not captured by conventional reserve margin metrics.

0.25

The Price of Hard Coverage Constraints in Online Conformal Prediction

cs.LG math.STstat.ML ·2026-11-17 ·Mingrui Liu
similarity 0.62
Abstract

Conformal prediction provides distribution-free uncertainty quantification, but in sequential deployment, standard coverage guarantees can still allow substantial fluctuations in the number of miscoverages over time. We study an online setting in which prediction sets are produced one round at a time and the cumulative number of miscoverages must stay within a prescribed budget throughout deployment.Such a hard coverage guarantee can be enforced by enlarging prediction sets, but how much additional prediction-set size is fundamentally necessary remains unclear. We characterize this unavoidable efficiency cost over $T$ prediction rounds. Remarkably, the cost persists even with i.i.d.\ data, a known score distribution, and perfect knowledge of the population-optimal prediction set. Under suitable regularity conditions relating coverage and prediction-set size, we determine the minimum cumulative excess prediction-set size required by any online method satisfying the hard coverage constraint. This minimum cost is $Θ(\log T)$ for expected cost at a fixed time known in advance, $Θ(T^{1/3})$ for the largest expected cost over all fixed times up to $T$, and $Θ(\sqrt{T})$ for the expected worst realized cost when the evaluation time is chosen in hindsight. We further show that these rates can be attained using past scores, without knowing the score distribution. Thus, even perfect statistical knowledge does not make sequential reliability free.

0.20

Safety Screening for Voltage Control in Active Distribution Grids via Distributionally Robust Conformal Screening

eess.SY cs.AIcs.LG ·2026-08-31 ·Sarra Bouchkati, Petros Ellinas, Adriana Geisler, Steffen Kortmann, Johanna Vorwerk +2 more
similarity 0.62
Abstract · Sarra Bouchkati, Petros Ellinas, and Adriana Geisler contributed equally to this work

Deploying a new control policy for voltage control in active distribution grids requires evidence that physical limits will be satisfied before the policy is tested on the physical grid. This assessment is difficult for two reasons. First, simulations cannot capture every disturbance, modeling error, and device interaction present in the real grid. Second, historical measurements reflect operation under existing control policies, whereas a new policy may drive the grid into different operating conditions. To address these challenges, we propose Distributionally Robust Conformal Safety Screening (DR-CSS), a policy-agnostic framework for pre-deployment, scenario-by-scenario screening of a new control policy using historical data and a nominal simulator. For each new scenario, the simulator predicts a future voltage trajectory for the whole grid; DR-CSS then constructs a conformal safety interval around this prediction using historical simulation-to-reality errors. The interval is further enlarged to account for closed-loop changes induced by the deployment of the new policy and its interactions with the remaining controllers. To the best of our knowledge, DR-CSS is the first framework in power systems to combine historical data from an existing control policy with an imperfect simulator for pre-deployment safety screening of a new policy. Experiments on the IEEE 33-bus and IEEE 141-bus systems evaluate the deployment of learning-based voltage control policies and show that DR-CSS identifies all unsafe test scenarios. To reduce unnecessary warnings on safe scenarios, we adapt the safety intervals to different operating conditions and gradually introduce new policies with recalibration after each stage. These extensions increase the informational value of the safety screening and support safer deployment decisions in active distribution grids.

0.21

Risk Assessment of Fair Multi-Period Dynamic Operating Envelopes under Uncertainty

eess.SY cs.CE ·2026-10-30 ·Pedro Salomão Quessongo, Daniel Gebbran, Wilhiam de Carvalho, Clodomiro Unsihuay-Vila
published similarity 0.62
Abstract

Dynamic operating envelopes (DOEs) can allocate time-varying export capacity to distributed energy resources (DERs), and while they are not intended to make operations immune to voltage violations, they should guide operations to mostly remain inside expected values under changing regimes and residual forecast errors. However, although recent literature proposed many different techniques for implementing DOEs, there is sparse discussion of analyzing and quantifying the risk of using more or less conservative DOEs under uncertain operating regimes. Having this gap in mind, this paper develops a risk-oriented extension of a previously established fair distributed multi-period optimal power flow (OPF) framework, where fair or technical DOEs are fixed as first-stage decisions and the OPF leverages battery energy storage and renewable curtailment as recourse under regime uncertainties. An independent nonlinear AC power flow then computes a resulting ensemble, which is summarized by (i) voltage-violation probability, severity, and a persistence metric for consecutive out-of-band hours, (ii) curtailment and Jain and Gini indices, and (iii) model deviations. Different probability situations are assessed, ranging from uniform, sunny-heavy, night-peak-heavy, and adversarial, which separate the envelope design from the assumed operating distribution. An optional outer loop allows for fine-tuning a fairness--efficiency parameter under explicit violation and persistence budgets. The combination of the outer loop and the overall framework, which quantifies how often and how severely operating limits are exceeded, creates an auditable methodology mixing equitable export allocation, distributed recourse, and AC risk assessment for active distribution network operators, and this framework is assessed using up to 1000 Monte Carlo scenarios per mixture and DOE design.

0.35

Scarcity Pricing for State-of-Charge Management in Real-Time Markets Under Intra-Day Uncertainty

eess.SY ·2026-11-09 ·Shailesh Wasti, Aravind Retna Kumar, Sushant Varghese, Anthony Giacomoni, Parviz Alivand +2 more
similarity 0.61
Abstract

The growth in renewable resources will increase net load variability and forecast error. Energy storage resources can provide flexibility when ramp capability is limited and contribute to load leveling over the day. The challenge for system operators is how to balance these two functions in real time, when updated net load forecasts are available for a limited lookahead horizon. U.S. electricity markets are seeking ways to manage state-of-charge (SoC) within their energy markets to more efficiently utilize these resources. We propose a method to manage energy storage SoC in a real-time market by extending Hogan's (2013) scarcity pricing framework. A day-ahead SoC schedule is modified using existing multi-interval real-time unit commitment engines as net load forecasts change. To address 30-minute-ahead forecast errors, an updated 5-minute SoC target and a dynamically updated shortage price for violating the constraint are provided to each economic dispatch. We simulate PJM's energy markets for 365 days and demonstrate reliability improvements relative to a strategy that enforces the day-ahead schedule. We show cost reductions and improved price formation relative to a strategy that updates target quantities but uses an administratively chosen shortage penalty.

0.30