CS Paper Radar

FARCH: A Functional ARCH Model for Calibrated Prediction Bands

Mohamed Chaouch

cs.LG stat.MEstat.ML ·submitted 2026-11-16 12:09 UTC · v1

Abstract

Forecasting a curve, rather than a handful of scalar summaries of it, requires a notion of uncertainty that is itself functional. We propose FARCH, a functional nonlinear autoregressive model with conditional heteroscedasticity, in which the conditional mean and the conditional volatility of the next curve are forecasted jointly and nonparametrically, by reusing a single kernel weighting scheme --- built on a wavelet semi-metric between curves --- first on the curves themselves and then on their squared residuals. From this pair of estimators we derive two constructions of prediction bands: a pointwise band, obtained from marginal scenario quantiles, and a uniform, sup-norm band, calibrated for decisions that concern the entire forecasted path rather than any single instant. Applied to day-ahead forecasting of half-hourly French national electricity demand (1996--2009), and compared, under an identical protocol, against four existing prediction-interval constructions that do not model the conditional variance explicitly, the uniform FARCH band attains pointwise coverage statistically indistinguishable from its nominal target at the 80%, 90% and 95% levels, and a curve-wise coverage of 90.1%, significantly above the 70.8% reached by the best competing method, at the cost of a wider interval. Pointwise bands, in contrast, undercover regardless of whether the variance is modelled explicitly, indicating that state-dependent volatility and simultaneous calibration are two distinct ingredients that a trustworthy prediction band must combine.

Closest papers

Nearest neighbours by meaning across the whole index.

Nearest Neighbor Functional Curve Completion for Intraday Probabilistic Revisions of Renewable Generation Forecasts

cs.LG ·2026-10-12 ·Guillermo Terrén-Serrano, Michael Ludkovski
similarity 0.63
Abstract

We propose a nonparametric approach that fuses deterministic initial forecasts and a partial realization into a probabilistic forecast using the framework of functional curve completion. Our motivation is to construct intra-day forecasts for renewable energy generation, which is a key operational task in modern power grids. The aim is to combine the day-ahead (DA) forecast and the morning realized generation profile to create trajectories for the rest of the day, quantifying operational uncertainty. Starting with a large database of complete forecast-actual pairs across many assets, we adopt a functional point of view and construct a weighted neighborhood based on similarity metrics for the observed partial curve, the DA forecast, the day, and the geographical location. The selected complete nearest-neighbor curves provide a full predictive distribution, including functional focal envelopes and predictive bands based on functional depth. The hyperparameters governing neighborhood size, distances, and fusion rates are tuned across forecast update times and directly target probabilistic calibration in terms of the predictive probability integral transform. Three case studies using synthetic wind and solar assets, as well as real-life regional wind generation, showcase that our algorithm is able to achieve excellent calibration.

0.17

Tail reliability in probabilistic electricity price forecasts: comparing model combination and conformal prediction in the GB day-ahead market

cs.LG stat.AP ·2026-09-22 ·Anirudh Agrawal, Aidan O'Sullivan
benchmark similarity 0.62
Abstract

Probabilistic forecasts of day-ahead electricity prices are increasingly used to manage price risk, yet competing models are usually ranked on aggregate scores that average over the price regimes in which uncertainty matters most. This study evaluates probabilistic forecasts of hourly EPEX SPOT GB day-ahead prices over a full held-out calendar year, applying a common pre-auction information boundary and rolling-origin design to linear quantile regression, a quantile regression forest (QRF), a LEAR-QRA benchmark and an encoder-decoder quantile long short-term memory (LSTM) network. Two routes to more reliable intervals are then compared: conformal recalibration and Quantile Regression Averaging (QRA). Aggregate scores separate the LSTM and QRF only weakly, with a non-significant 4.4% difference in continuous ranked probability score (CRPS), but their conditional behaviour differs sharply. Above 200 GBP/MWh the LSTM covered 0.12 of outcomes and QRF 0.71, consistent with the forest retaining realised spikes in its leaf distributions while the network learned a smooth upper tail. Conformal recalibration corrected marginal coverage but did not improve the interval score or materially repair spike coverage. QRA combining the LSTM, QRF and LEAR-QRA forecasts reduced CRPS to 5.14 GBP/MWh and raised coverage above 200 GBP/MWh to 0.65 at unchanged interval width. Recalibration and combination therefore address different failures and are not substitutes.

0.29

Quantile-Guided Diffusion for Probabilistic Time-Series Forecasting

cs.LG ·2026-10-14 ·Shadi Omari, Bashar Khoury, Assaf Schuster
similarity 0.61
Abstract · 33 pages, 10 figures, 20 tables

Quantile forecasts summarize uncertainty at each future time step, while diffusion forecasters represent it through sampled future trajectories. We study how predicted quantiles can serve as distributional controls for diffusion forecasting. Specifically, we investigate how the mechanism of quantile integration affects its effectiveness in guiding a pretrained diffusion forecaster. We find that residual control throughout the denoising network yields the most consistent improvements. We instantiate this approach as Control-TS, which learns a quantile-control pathway while keeping the pretrained backbone frozen. Across eight benchmarks, Control-TS consistently improves the backbone's CRPS, achieves competitive performance against state-of-the-art forecasting models, and retains its gains in capacity-matched comparisons. Further analyses examine how these gains depend on quantile granularity, predictor choice, and forecast quality. Finally, we introduce the Conditional Linear Predictive Score (CLPS), which complements distributional metrics by evaluating the downstream forecasting utility of generated futures. Together, these findings support predicted quantiles as an effective interface between explicit uncertainty estimates and diffusion-based trajectory generation.

0.23

Medium-Term Multi-Resolution Electric Load Forecasting using Economic Data and Foundation Model

cs.LG ·2026-09-25 ·Lindas Eloi, Goude Yannig, Ciais Philippe
similarity 0.61
Abstract

Accurate medium-term, from a few months to a few years, electricity load forecasts are crucial for informed decision-making in power plant maintenance scheduling, load dispatch and price settlement. Being comprised between Long-Term Load Forecasting (LTLF) which uses mostly economic projections and appliances development scenarios, and Short-Term Load Forecasting (STLF) driven by weather, calendar and autoregressive patterns, Medium-Term Load Forecasting (MTLF) requires both extrapolation capabilities and variability modeling. Yet, it remains unclear if MTLF can benefit from economic indicators, and especially at which forecast horizon and resolution. To address these challenges we investigated the impact of socioeconomic data on predictions issued 1 month and up to 48 months in advance for France at monthly and daily resolution using a tabular Foundation Model (FM). A dataset covering 20 years of observations of electricity load, weather variables and economic features such as consumer price and production indices, electric vehicle counts or employment is created for the study. To avoid noisy data, we used a new feature selection pipeline, creating ensemble of expert models with diverse feature subsets, to demonstrate that selected economic covariates improve forecast skill by 20% over 2015-2025. This enhancement is steady across lead times and resolutions limiting the Mean Absolute Percentage Error to 4% for monthly granularity and 5% for daily granularity. Explainability of the models is investigated through feature and context importance. Results showed that the FM is limited in the context it leverages pointing towards potential computational savings with a reduced context, while feature importance of economic predictors grows with the forecast horizon. This suggests that including economic data in MTLF could bridge the gap with LTLF leading to seamless forecasts.

0.18

Cap-Aware Boosting for Green Day-Ahead Electricity Price Forecasting

cs.LG ·2026-11-16 ·Shubham Pratap
similarity 0.61
Abstract · 19 pages, 7 figures. LightGBM forecasts of 15-minute IEX Green Day-Ahead prices, compared with Chronos-2

Accurate forecasting of Green Day-Ahead Market (GDAM) electricity prices is essential for market participants in the Indian power sector. We present a LightGBM-based forecasting framework for Indian Energy Exchange GDAM prices, which clear in 96 fifteen-minute intervals per day. The proposed system explicitly models price-cap behavior by separating capped-price events from normal market conditions. A classification head estimates the probability of the regulatory price cap (Rs 10,000/MWh), while a regression head predicts uncapped prices in logarithmic space. Final forecasts are obtained through probabilistic blending of these components and are accompanied by nine quantile forecasts for uncertainty estimation. Evaluated on 257 trading days between 1 January and 14 September 2026, the model achieves a mean absolute error (MAE) of 397.9 Rs/MWh and a mean absolute percentage error (MAPE) of 9.57%, substantially outperforming a Chronos-2 baseline (583.3 MAE) and a persistence baseline using the previous day's profile (589.1 MAE). We further introduce leak-safe variants that incorporate real-time market signals, unmatched sell volumes, and solar generation proxies. In a recent out-of-sample evaluation, the quantile-clock variant achieved the best short-term performance with an MAE of 789 Rs/MWh during 25-28 October, while the enhanced capped-price model achieved an MAE of 716 Rs/MWh across 21 evaluation days through 16 November. These results demonstrate the effectiveness of regime-aware probabilistic forecasting for high-volatility electricity markets.

0.24

Dynamic Regime-Aware Conformal Calibration for Reliable Economic Forecast Intervals under Multiple Distribution Shifts

cs.LG ·2026-08-17 ·Bogdan Oancea
similarity 0.60
Abstract

Conformal prediction provides distribution-free prediction intervals but relies on exchangeability, an assumption often violated in economic forecasting because of covariate shift, concept drift, local heterogeneity and latent regimes. We propose Dynamic Regime-Aware Conformal Prediction (DRACP), which combines density-ratio, localized kernel and probabilistic regime-aware weighting with a self-tuning online significance controller in a unified weighted conformal calibration framework. We distinguish three theoretical results: finite-sample validity under oracle importance weights, a coverage-gap bound for estimated weights with rates in effective sample size, and deterministic or regret guarantees for the online controller. We evaluate DRACP against six baselines on 48 real forecasting series covering euro-area and EU-27 HICP inflation, US macroeconomic and energy indicators, and daily financial series. Recent online methods (FACI, strongly-adaptive online conformal prediction and conformal PID) were verified against the authors' implementations. DRACP is not the most efficient method: strongly-adaptive online conformal prediction achieves the best interval score and intervals about 20% narrower. Instead, DRACP provides the most reliable calibration, achieving coverage closest to the nominal 0.90 (0.890), never falling below 0.80 on any series, maintaining the best coverage at all forecast horizons, and performing best during the 2021-2023 inflation surge. The strongly-adaptive method undercovers on 20 of 48 series versus 10 for DRACP. DRACP therefore offers a principled trade-off between calibration and efficiency, favoring reliable coverage when prediction intervals must satisfy coverage standards. An ablation study shows that the online controller and conditional-scale normalization provide most of the performance gain, whereas the weighting components make a smaller contribution.

0.30

Robust Aggregation of Quantile Statistics: from Median to Interval

cs.GT ·2026-11-03 ·Mingyu Song, Yizhou Wang, Yuqing Kong
similarity 0.60
Abstract · 24 pages, 5 figures

Quantile-based summaries, such as prediction intervals and medians, are commonly used in economic forecasting, climate science, and public health. For highly skewed samples, experimental evidence suggests that estimates of the mean can be biased toward the median, whereas estimates of the median are relatively accurate. This motivates aggregating explicitly elicited quantiles rather than reported means. We study robust aggregation of quantile reports for bounded outcomes under squared loss, minimizing worst-case regret relative to an omniscient Bayesian aggregator who knows the information structure and observes all private signals. Without restrictions on the information structure, no rule improves on the constant forecast at the range midpoint in worst-case regret. We therefore consider weak substitutes, a diminishing-returns condition on the value of information, and characterize optimal aggregation rules under this condition. For central prediction intervals with common nominal coverage $α$, the optimal rule, which we call regularized simple average for prediction intervals, shrinks the average reported interval midpoint toward the range midpoint, with a weight determined by $α$ and the number $n$ of experts. This optimal rule strictly improves on the constant baseline in worst-case regret when $α<1/\sqrt{n}$; at or above this threshold, the constant rule is optimal. The optimal worst-case regret is minimized at a unique interior coverage level, revealing a nonmonotonic relationship between coverage and aggregation performance. For median reports, regularized simple average for medians similarly shrinks the average reported median toward the range midpoint, assigning weight $1/n$ to the reported average and strictly improving on the constant baseline in worst-case regret for every finite $n\ge2$.

0.14

Probabilistic electrical power demand forecasting with uncertainty quantification

cs.LG cs.AI ·2026-09-28 ·Mahesh Neupane, Pragya Dhungana, Pradip Khatri, Swechhya Baskota, Hariom Dhungana
similarity 0.60
Abstract

The majority of research on electricity consumption forecasting has focused on deterministic approaches, which generate a single point estimate for each time step in the forecasting horizon. However, the increasing penetration of renewable energy sources and the growing complexity of modern smart grids have introduced greater variability and uncertainty into power-system demand and operation. Consequently, probabilistic forecasting, which quantifies the uncertainty and variability associated with future electricity demand, is becoming increasingly important for reliable power-system planning and operation. This study presents an empirical comparison of four contemporary probabilistic forecasting models for electricity consumption, highlighting their respective strengths and limitations. We have performed comparision on real-world power systems related datasets. Across all power-consumption zones, NGBoost demonstrates superior probabilistic forecasting performance, achieving the lowest MAE and RMSE while providing well-calibrated uncertainty estimates with high prediction-interval coverage and reasonably narrow intervals. These results indicate that NGBoost offers a more accurate and reliable forecasting framework than Bayesian, Monte Carlo (MC) Dropout, and Gaussian Process Regression (GPR) models for the considered electricity consumption data.

0.16