CS Paper Radar

Tail reliability in probabilistic electricity price forecasts: comparing model combination and conformal prediction in the GB day-ahead market

Anirudh Agrawal, Aidan O'Sullivan

cs.LG stat.AP ·submitted 2026-09-22 11:34 UTC · v1
benchmark

Abstract

Probabilistic forecasts of day-ahead electricity prices are increasingly used to manage price risk, yet competing models are usually ranked on aggregate scores that average over the price regimes in which uncertainty matters most. This study evaluates probabilistic forecasts of hourly EPEX SPOT GB day-ahead prices over a full held-out calendar year, applying a common pre-auction information boundary and rolling-origin design to linear quantile regression, a quantile regression forest (QRF), a LEAR-QRA benchmark and an encoder-decoder quantile long short-term memory (LSTM) network. Two routes to more reliable intervals are then compared: conformal recalibration and Quantile Regression Averaging (QRA). Aggregate scores separate the LSTM and QRF only weakly, with a non-significant 4.4% difference in continuous ranked probability score (CRPS), but their conditional behaviour differs sharply. Above 200 GBP/MWh the LSTM covered 0.12 of outcomes and QRF 0.71, consistent with the forest retaining realised spikes in its leaf distributions while the network learned a smooth upper tail. Conformal recalibration corrected marginal coverage but did not improve the interval score or materially repair spike coverage. QRA combining the LSTM, QRF and LEAR-QRA forecasts reduced CRPS to 5.14 GBP/MWh and raised coverage above 200 GBP/MWh to 0.65 at unchanged interval width. Recalibration and combination therefore address different failures and are not substitutes.

Closest papers

Nearest neighbours by meaning across the whole index.

Cap-Aware Boosting for Green Day-Ahead Electricity Price Forecasting

cs.LG ·2026-11-16 ·Shubham Pratap
similarity 0.72
Abstract · 19 pages, 7 figures. LightGBM forecasts of 15-minute IEX Green Day-Ahead prices, compared with Chronos-2

Accurate forecasting of Green Day-Ahead Market (GDAM) electricity prices is essential for market participants in the Indian power sector. We present a LightGBM-based forecasting framework for Indian Energy Exchange GDAM prices, which clear in 96 fifteen-minute intervals per day. The proposed system explicitly models price-cap behavior by separating capped-price events from normal market conditions. A classification head estimates the probability of the regulatory price cap (Rs 10,000/MWh), while a regression head predicts uncapped prices in logarithmic space. Final forecasts are obtained through probabilistic blending of these components and are accompanied by nine quantile forecasts for uncertainty estimation. Evaluated on 257 trading days between 1 January and 14 September 2026, the model achieves a mean absolute error (MAE) of 397.9 Rs/MWh and a mean absolute percentage error (MAPE) of 9.57%, substantially outperforming a Chronos-2 baseline (583.3 MAE) and a persistence baseline using the previous day's profile (589.1 MAE). We further introduce leak-safe variants that incorporate real-time market signals, unmatched sell volumes, and solar generation proxies. In a recent out-of-sample evaluation, the quantile-clock variant achieved the best short-term performance with an MAE of 789 Rs/MWh during 25-28 October, while the enhanced capped-price model achieved an MAE of 716 Rs/MWh across 21 evaluation days through 16 November. These results demonstrate the effectiveness of regime-aware probabilistic forecasting for high-volatility electricity markets.

0.23

Quantile-Guided Diffusion for Probabilistic Time-Series Forecasting

cs.LG ·2026-10-14 ·Shadi Omari, Bashar Khoury, Assaf Schuster
similarity 0.63
Abstract · 33 pages, 10 figures, 20 tables

Quantile forecasts summarize uncertainty at each future time step, while diffusion forecasters represent it through sampled future trajectories. We study how predicted quantiles can serve as distributional controls for diffusion forecasting. Specifically, we investigate how the mechanism of quantile integration affects its effectiveness in guiding a pretrained diffusion forecaster. We find that residual control throughout the denoising network yields the most consistent improvements. We instantiate this approach as Control-TS, which learns a quantile-control pathway while keeping the pretrained backbone frozen. Across eight benchmarks, Control-TS consistently improves the backbone's CRPS, achieves competitive performance against state-of-the-art forecasting models, and retains its gains in capacity-matched comparisons. Further analyses examine how these gains depend on quantile granularity, predictor choice, and forecast quality. Finally, we introduce the Conditional Linear Predictive Score (CLPS), which complements distributional metrics by evaluating the downstream forecasting utility of generated futures. Together, these findings support predicted quantiles as an effective interface between explicit uncertainty estimates and diffusion-based trajectory generation.

0.23

Foundation models for electricity price forecasting and battery arbitrage: Can they replace market-specific forecasting models?

cs.LG econ.EM ·2026-08-31 ·Arkadiusz Lipiecki, Rafał Weron
benchmark similarity 0.62
Abstract

Foundation models promise accurate forecasts with little or no task-specific training, but whether they can replace models designed specifically for electricity price forecasting remains unclear. We compare nine variants from five foundation model families, evaluated in zero-shot mode, with two state-of-the-art electricity price forecasting benchmarks in Germany, Poland, and Spain over 2021-2025. Their performance is assessed in terms of point and probabilistic forecasting accuracy, as well as economic value in battery energy storage arbitrage. Only the TabPFN models consistently and significantly outperform the benchmarks across all three markets and all statistical measures. However, this statistical dominance does not translate directly into economic dominance: TabPFN performs best under unlimited bids and riskier quantile-based strategies, whereas the Distributional Deep Neural Network benchmark is more profitable when risk tolerance is lower. Thus, foundation models cannot universally replace market-specific models, and their value depends on both model architecture and the decision problem.

0.27

FARCH: A Functional ARCH Model for Calibrated Prediction Bands

cs.LG stat.MEstat.ML ·2026-11-16 ·Mohamed Chaouch
similarity 0.62
Abstract

Forecasting a curve, rather than a handful of scalar summaries of it, requires a notion of uncertainty that is itself functional. We propose FARCH, a functional nonlinear autoregressive model with conditional heteroscedasticity, in which the conditional mean and the conditional volatility of the next curve are forecasted jointly and nonparametrically, by reusing a single kernel weighting scheme --- built on a wavelet semi-metric between curves --- first on the curves themselves and then on their squared residuals. From this pair of estimators we derive two constructions of prediction bands: a pointwise band, obtained from marginal scenario quantiles, and a uniform, sup-norm band, calibrated for decisions that concern the entire forecasted path rather than any single instant. Applied to day-ahead forecasting of half-hourly French national electricity demand (1996--2009), and compared, under an identical protocol, against four existing prediction-interval constructions that do not model the conditional variance explicitly, the uniform FARCH band attains pointwise coverage statistically indistinguishable from its nominal target at the 80%, 90% and 95% levels, and a curve-wise coverage of 90.1%, significantly above the 70.8% reached by the best competing method, at the cost of a wider interval. Pointwise bands, in contrast, undercover regardless of whether the variance is modelled explicitly, indicating that state-dependent volatility and simultaneous calibration are two distinct ingredients that a trustworthy prediction band must combine.

0.27

Transfer Learning with Conformalized Quantile Regression for Solar PV Forecasting Under Load-Shedding-Driven Data Scarcity

cs.LG ·2026-09-22 ·Rakib Abdullah, K. M. Tahlil Mahfuz Faruk
code/data similarity 0.62
Abstract · 6 pages, 4 figures, 1st International Conference on Next-Generation Electrical & Electronics, Computer Systems, and Technologies (iCONEECT 2…

Solar photovoltaic (PV) forecasting in regions affected by load shedding is challenging because reliable historical observations are scarce. This study proposes a transfer learning framework combined with Conformalized Quantile Regression (CQR) to improve PV power forecasting and provide reliable uncertainty estimates under severe data scarcity. A source-domain PV dataset from Alice Springs, Australia, is used to pretrain a temporal forecasting model, which is then adapted to simulated Bangladesh PV data representing different levels of historical availability. Experimental results show that transfer learning reduces RMSE by up to 23.7% when only one month of target-domain data is available and by 13.7% with three months of data. The proposed Transfer Learning plus CQR framework achieves 94.3% empirical coverage with three months of target data while producing prediction intervals that are 14% narrower than those obtained without transfer learning. These results demonstrate that combining transfer learning with conformal uncertainty quantification can improve both point forecasting accuracy and uncertainty reliability when target-domain PV data are severely limited.

0.40

Stealing profits: Spread-based temporal hierarchy forecasting for day-ahead electricity markets

cs.LG q-fin.STecon.EM ·2026-09-19 ·Arkadiusz Lipiecki, Nikolaos Kourentzes, Rafal Weron
similarity 0.62
Abstract

Day-ahead electricity price forecasts support trading and storage decisions, but for battery arbitrage predicting intraday price spreads is more relevant than predicting individual hourly prices. Here we show that a temporal hierarchy forecasting (THieF) framework that jointly reconciles forecasts of hourly electricity prices and all intraday price spreads consistently improves performance across two major European electricity markets and three different forecasting architectures. Using five years of out-of-sample data from Germany and Spain, we obtain accuracy improvements of up to 19.7% and profit gains of up to 10.4% relative to unreconciled hourly price forecasts. The gains persist even for a highly accurate pretrained TabPFN foundation model. Our results demonstrate that exploiting coherent relationships between economically relevant forecasting targets can improve both predictive accuracy and decision value, and that better statistical forecasts do not necessarily imply better economic decisions.

0.10

On BESS-Backed Trading on the Continuous Intraday Electricity Market

eess.SY ·2026-10-02 ·Leo Semmelmann, Runyao Yu, Joseph Cary, Derek Bunn
benchmark similarity 0.61
Abstract

Battery energy storage systems (BESS) on the continuous intraday market (IDC) often trade according to a rolling intrinsic algorithm, a myopic strategy which repeatedly opens and unwinds positions according to current prices throughout the trading session, before dispatching as delivery approaches. This paper introduces a novel trading strategy for storage, in which forecast-driven round trip trading takes priority and the BESS supplies a second route for closing out positions that the market would otherwise close at a distressed price. The agent uses price quantile forecasts to open positions on the IDC, and closes these positions closer to delivery. The market can move against these trades, and the BESS intervenes only when a position would have to be settled at a price that the forecast predicts to be highly improbable, absorbing or serving that volume physically and restoring its state of charge at ordinary prices afterwards. The position itself remains loss-making; what the asset changes is the price at which it is closed, by transferring the terminal settlement price through time. Four quantile forecasting models of increasing complexity supply the thresholds, and all strategies are backtested on realised EPEX SPOT transactions for the German market area in 2024. A 40 MWh BESS in this role earns EUR 2.06m against EUR 1.77m for a rolling intrinsic benchmark and EUR 1.37m for a perfect-foresight day-ahead benchmark, while consuming 167 instead of 365 available equivalent full cycles. Hence, the novel backstop strategy yields higher profits, while using the underlying BESS less, leaving capacity for other trading opportunities.

0.17

Probabilistic electrical power demand forecasting with uncertainty quantification

cs.LG cs.AI ·2026-09-28 ·Mahesh Neupane, Pragya Dhungana, Pradip Khatri, Swechhya Baskota, Hariom Dhungana
similarity 0.61
Abstract

The majority of research on electricity consumption forecasting has focused on deterministic approaches, which generate a single point estimate for each time step in the forecasting horizon. However, the increasing penetration of renewable energy sources and the growing complexity of modern smart grids have introduced greater variability and uncertainty into power-system demand and operation. Consequently, probabilistic forecasting, which quantifies the uncertainty and variability associated with future electricity demand, is becoming increasingly important for reliable power-system planning and operation. This study presents an empirical comparison of four contemporary probabilistic forecasting models for electricity consumption, highlighting their respective strengths and limitations. We have performed comparision on real-world power systems related datasets. Across all power-consumption zones, NGBoost demonstrates superior probabilistic forecasting performance, achieving the lowest MAE and RMSE while providing well-calibrated uncertainty estimates with high prediction-interval coverage and reasonably narrow intervals. These results indicate that NGBoost offers a more accurate and reliable forecasting framework than Bayesian, Monte Carlo (MC) Dropout, and Gaussian Process Regression (GPR) models for the considered electricity consumption data.

0.16