CS Paper Radar

Transfer Learning with Conformalized Quantile Regression for Solar PV Forecasting Under Load-Shedding-Driven Data Scarcity

Rakib Abdullah, K. M. Tahlil Mahfuz Faruk

cs.LG ·submitted 2026-09-22 18:49 UTC · v2
code/data

Abstract

Solar photovoltaic (PV) forecasting in regions affected by load shedding is challenging because reliable historical observations are scarce. This study proposes a transfer learning framework combined with Conformalized Quantile Regression (CQR) to improve PV power forecasting and provide reliable uncertainty estimates under severe data scarcity. A source-domain PV dataset from Alice Springs, Australia, is used to pretrain a temporal forecasting model, which is then adapted to simulated Bangladesh PV data representing different levels of historical availability. Experimental results show that transfer learning reduces RMSE by up to 23.7% when only one month of target-domain data is available and by 13.7% with three months of data. The proposed Transfer Learning plus CQR framework achieves 94.3% empirical coverage with three months of target data while producing prediction intervals that are 14% narrower than those obtained without transfer learning. These results demonstrate that combining transfer learning with conformal uncertainty quantification can improve both point forecasting accuracy and uncertainty reliability when target-domain PV data are severely limited.

Comment
6 pages, 4 figures, 1st International Conference on Next-Generation Electrical & Electronics, Computer Systems, and Technologies (iCONEECT 2026)

Closest papers

Nearest neighbours by meaning across the whole index.

IMPACT: Inverter-Informed Multimodal Learning for Photovoltaic Generation Forecasting

cs.LG cs.AI ·2026-10-29 ·Anushka Katiyar, Cong Feng, Jing Wang, Tristan Liu, Simon Julien +1 more
similarity 0.69
Abstract

This work develops a physics-informed multimodal deep learning framework for 10- to 110-minute-ahead probabilistic photovoltaic power forecasting. The forecasting model is built on a four-branch architecture that separately encodes plant-level temporal history and inverter-level spatial cloud dynamics through a graph attention encoder with a learned adjacency, known-future solar geometry, and the current meteorological state, fused through gated cross-attention. The geometry branch adds two forward-looking physical signals, spatial cloud heterogeneity and inverter ramp-down activity, each empirically weighted toward the horizon where it is most predictive. The decoder anchors its prediction to a smart persistence baseline, learning a horizon-conditioned correction, and the resulting quantile forecasts are calibrated online through a kernel-weighted adaptive conformal calibration step. The proposed model outperforms all 14 baselines, achieving a forecast skill score (FSS) of 0.2950, 0.099 above the next-best model. A branch-composition ablation shows that every branch contributes positively and the model retains substantial skill in challenging overcast and variable sky conditions (FSS 0.198 and 0.255).

0.10

Foundation-Style Pretraining for Scalable and Transferable Distributed PV Forecasting

cs.LG ·2026-10-20 ·Dayin Chen, Xiaodan Shi, Xin Xu, Zhongyue Su, Shibo Zhu +4 more
similarity 0.68
Abstract

The rapid growth of distributed photovoltaic (PV) generation is increasing the demand for accurate forecasting across large numbers of geographically dispersed stations. Existing approaches are commonly developed for individual sites or specific forecasting horizons, requiring repeated training and maintenance as new stations are integrated and limiting direct reuse at previously unseen sites. To address this scalability gap, this paper presents a domain-specific foundation-style pretraining framework that learns a shared forecasting model from heterogeneous multi-site and multi-horizon PV data. NWP-assisted forecasting is formulated as a sequence-completion problem that unifies historical PV power, meteorological observations, future numerical weather prediction (NWP) forecasts, and time encodings. Three pretraining objectives are designed and systematically evaluated, including forecast-aligned reconstruction, generic reconstruction, and mixed reconstruction. The mixed objective combines the operational structure of PV forecasting with random sequence reconstruction and provides the most balanced performance across forecasting accuracy, degraded NWP conditions, and downstream adaptation. Experiments on 479 distributed PV stations use 340 stations for model development and 139 spatially held-out stations for zero-shot evaluation. Across horizons from 6 hours to 7 days, the multi-site pretrained MR model outperforms representative station-specific and shared baselines, as well as generalist time-series models, including a recent large-scale pretrained foundation model. The pretrained model can also be directly deployed at new PV stations and subsequently adapted to region-specific operational objectives when local data become available, providing a scalable forecasting paradigm for large distributed PV fleets.

0.18

The Utility of Physics-Informed Machine Learning in Solar Power Production Forecasting

cs.LG ·2026-10-28 ·Peter Pavlík, Franz M. Rohrhofer, Bernhard C. Geiger
similarity 0.66
Abstract · Submitted to Solar Energy

Physics-informed machine learning (PIML) and hybrid modeling have attracted significant attention as approaches for combining physical knowledge with the flexibility of deep learning. In this work, we investigate whether these approaches deliver their commonly claimed benefits for large-scale photovoltaic (PV) power forecasting. We develop two hybrid forecasting architectures that integrate the ADR physical PV efficiency model with the TSMixer neural forecasting architecture through feature augmentation and residual learning. The proposed models are evaluated on a dataset comprising over 3 million samples from 3,713 PV installations across 33 European countries. We assess convergence speed, forecasting accuracy, transferability across geographical regions, and data efficiency. Although the physics-informed models seem to exhibit slightly faster convergence during training, they do not achieve consistent improvements in test-set accuracy, generalization, or performance under limited training data compared to the purely data-driven baseline. These findings suggest that, for modern deep forecasting architectures trained on large datasets, explicitly incorporating the ADR physical model provides limited practical benefit for day-ahead PV forecasting.

0.20

Two-stage residual learning for calibrated uncertainty in solar irradiance forecasts

cs.LG eess.SY ·2026-11-05 ·RR Flanagan, E Kasha, PW Talbot, AS Epiny, MR Deinert
similarity 0.65
Abstract

Accurate forecasting of renewable generation requires not only point predictions but also reliable estimates of the uncertainty attached to them, particularly at extended horizons. Machine learning models are increasingly used to predict solar output, but they typically report a single value and capture the associated uncertainty poorly. The standard remedy is to train a model to predict the parameters of an assumed probability distribution directly. Here we develop an alternative two-stage method, motivated by synthetic solar signal generation, in which the forecast error is modeled separately from the expected irradiance. A first long short-term memory (LSTM) network predicts the expected global horizontal irradiance, and a second network models the distribution of the forecast error, which is added back to the mean to give both the forecast and its uncertainty. Using historical weather data from the National Solar Radiation Database and a probability integral transform evaluation, we show that explicitly modeling the error brings the predicted standard deviation markedly closer to the historical value, reducing the deviation between the two by 34.6 percent for a standalone LSTM and by 56.5 percent when the LSTM is coupled to Gaussian process regression, the most reliable of the configurations tested. Because the method models the total forecast error directly, it captures the full predictive uncertainty that matters for decisions, rather than only the model contribution that dropout-based approaches estimate.

0.07

Explainable AI for Solar PV Power Forecasting: From Model Selection to Trustworthy, Reproducible Deployment

cs.AI ·2026-11-19 ·Nuzhat Khan, Muhammad Paend Bakht, Ab Al-Hadi Ab Rahman, Fabiano Pallonetto, Amy Fahy +5 more
similarity 0.64
Abstract · 24 pages, 8 figures, 6 tables. Code and results available from the corresponding author on request

Machine learning (ML) is now a standard tool for forecasting the output of solar photovoltaic (PV) plants, yet published accuracy figures are often hard to compare and harder to trust. Many studies validate with random splits, report no reference forecast, and present feature attributions without saying what they can and cannot show. This paper reviews the main families of ML methods for PV power forecasting and resource assessment, from tree ensembles to deep and foundation models, and sets out a reproducible workflow that combines automated model search with explainable AI. The workflow is then tested on an openly available dataset: a 16.32 kWp plant in Porto, Portugal, forecast one day ahead from a 4 km numerical weather prediction grid. Over a full test year, the best models reach a normalised root mean square error (nRMSE) of 11.6% of installed capacity, about half the error of smart persistence. The choice of input features changed accuracy far more than the choice among strong algorithms, and shuffled cross-validation was mildly optimistic. After conformal calibration, the nominal 80% prediction intervals covered 81.7% of observations, against 64.5% before. SHAP rankings stayed stable when the model was retrained on different periods but shifted when correlated inputs were removed, so attributions should be read as properties of a model rather than of the plant. The paper closes with practical lessons and open problems, including deployment on edge hardware and the effect of a changing climate.

0.24

Federated versus Centralized PV Capacity-Factor Forecasting: A Non-Inferiority Study Across Seven Stations in North Macedonia

cs.LG ·2026-11-14 ·Amar Kumar Mandal, Yuvraj Chaudhary, Dimitar Kitanovski, Eftim Zdravevski
similarity 0.64
Abstract · Submitted to Energy, Sustainability and Society

Background: Photovoltaic (PV) forecasts inform energy commitments by PV operators and aggregators and guide charge-discharge scheduling in solar-plus-storage systems. Federated learning enables collaborative model training through model updates when local operators cannot pool raw operational data. This study evaluated whether federated training was non-inferior to centralized training for PV capacity-factor prediction across seven stations in North Macedonia. A common multilayer perceptron was used in an offline forecasting comparison with a 24-hour timestamp lag. Exploratory validation compared local, centralized, Federated Averaging, and Federated Proximal (FedProx) training. FedProx (E = 1, mu = 1) was selected for a confirmatory comparison under a protocol fixed before test evaluation. The comparison used past-only offline inputs, five paired training seeds, macro-averaged mean absolute error (MAE), a prespecified non-inferiority margin of 0.005, and a paired day bootstrap with 10,000 repetitions over 49 test dates. Results: FedProx achieved a macro-MAE of 0.128397, compared with 0.133405 for centralized training. The paired difference (FedProx minus centralized) was -0.005008 (95% confidence interval: [-0.009926, -0.000537]). The upper confidence bound was below the prespecified margin, satisfying the non-inferiority criterion. All five seed-specific differences favored FedProx, and its mean MAE was lower at six of the seven stations. Post hoc calendar sensitivity analyses did not change the conclusion. Conclusions: These findings support further evaluation of federated forecasting for collaboration under data-pooling constraints. The study demonstrates predictive non-inferiority within the evaluated setting. Benefits for energy commitments and battery scheduling remain potential applications requiring operational evaluation.

0.18

Adaptive Residual Modeling for Scenario Learning in Probabilistic Load Forecasting

eess.SY ·2026-11-02 ·Jinbao Wang, Jun Liu, Shiliang Zhang, Xuehui Ma, Yushuai Li +1 more
similarity 0.63
Abstract

Uncertainties in weather, user behavior, and distributed energy production introduce significant variability into feeder power. Effective power system operations require both multi-horizon load forecasts and well-calibrated extreme quantiles for the forecast. Nevertheless, standard objectives that fit the full forecast distribution often underemphasize rare observations and extremes. Conversely, applying heavy tail-weighting in the distribution to capture these extremes can distort the underlying probability distribution. To address this issue, this paper proposes adaptive residual modeling for scenario learning (ARMSL), a two-stage framework. Particularly, Stage I in our framework sequentially models environmental response, history-dependent load patterns, persistent residual deviations, and the remaining innovations. Upon the modeling, we then generate joint active- and reactive-power scenarios with state-dependent dispersion. Stage II keeps the scenario model fixed and calibrates extreme marginal quantiles using a simple, channel-specific reference forecast (an anchor). Only outward deviations from this anchor are admitted, with their contribution determined by local calibration history and the current operating state. From our numerical simulations on FeederBW dataset, Stage I outperforms diffusion baselines in energy and variogram scores. Our complete framework achieves an active-power 0.99-quantile pinball loss of 0.1932 (a 30.08% to 85.33% reduction relative to three baselines) with 1.054% exceedance rate against a nominal 1%. From simulations on the Rolle dataset, we observe decreased losses by 5.39%--14.40% compared to the active-power-only anchor. Furthermore, the unchanged Stage I scenarios in the simulation yield a correlation of 0.953 between predicted and observed feeder event rates, with 90.0% of feeder errors falling within two percentage points.

0.23

Behind-the-Meter Photovoltaic Visibility from Net Smart Meters: Deployment Regimes and Operational Insights

cs.LG ·2026-10-08 ·Jack Zheng, Hao Wang
publishedbenchmark similarity 0.63
Abstract · 6 pages, 5 figures, 6 tables. Accepted at the 10th IEEE Conference on Energy Internet and Energy System Integration (IEEE EI2 2026). IEEE Xp…

Distribution operators need visibility of behind-the-meter photovoltaic (PV) generation, yet most residential customers are observed only through net smart meters. Deep-learning-based PV disaggregation can restore this visibility, but its operational value depends on whether the model serves known customers, new customers, future periods, or new regions. We quantify this dependence using four deployment regimes that separate household transfer from temporal extrapolation, applied to Ausgrid smart-meter data with cross-dataset adaptation to the Pecan Street data. Using a fixed training protocol, we benchmark representative deep sequence architectures for PV disaggregation under regime-matched evaluation. At a fixed 48-hour context length, daylight mean absolute error (MAE) of the best model rises from 0.104~kW on seen households in the future test period to 0.185~kW on unseen households over the same period, and under a fixed training contract the deployment regime explains far more of the error variation than model choice. Under target-domain normalization, fine-tuning on five target-region households reduces source-model transfer error by 28\%--36\%. Long input windows help known-customer extrapolation, while their new-customer benefits vary by model. These findings suggest regime-matched error budgets, limited target supervision for model adaptation in new regions, and use-case-dependent context selection for energy data analytics.

0.23