CS Paper Radar

Edge-Adaptive Hiera-Seg Model for Building-Integrated Photovoltaic Power Forecasting

Na Yu

cs.CV cs.LG ·submitted 2026-11-15 06:53 UTC · v1

Abstract

Building integrated photovoltaic power forecasting is challenging because facade orientation, rooftop geometry, nearby buildings, vegetation, cloud movement, module temperature, inverter status and edge device reliability jointly affect power generation. This paper proposes an edge-adaptive HieraSeg model for short term BIPV power forecasting with multi-orientation visual-irradiance fusion. RGB facade images, optional thermal cues, irradiance measurements, module temperature, facade orientation, rooftop masks, shading labels, sky condition, historical power and edge device state are aligned into synchronous forecasting windows. HieraSeg extracts hierarchical regions from facade, rooftop, sky, shadow and background images, while the edge-adaptive module changes feature weights under missing frames, latency shifts and local shading changes. The segmentation branch identifies occluded module areas and separates facade, rooftop, sky and background evidence before the forecasting head estimates future BIPV output. Experiments are designed on a simulated multibuilding BIPV dataset with unseen building and unseen orientation tests. The model reports predicted power, confidence interval, dominant evidence, occlusion contribution, orientation contribution and energy-management review priority. This output is intended to show whether the forecast is driven by irradiance change, visible shading, orientation response, stale edge information or recent power history. The framework supports local forecasting at edge controllers with limited communication delay and computing resources, linking visual occlusion, irradiance dynamics and power history to traceable forecasting results for building energy management, microgrid scheduling and BIPV operation planning.

Comment
13 pages, 7 figures, 1 table

Closest papers

Nearest neighbours by meaning across the whole index.

Shading-Aware Rooftop PV Placement

cs.CE ·2026-09-19 ·Tobias von Arx, Srinivasan Keshav
code/data similarity 0.67
Abstract

Rooftop photovoltaic (PV) design requires careful panel placement to make effective use of potentially limited roof space and available sunlight. Existing simplified roof models can miss objects and superstructures that shade panels. We simulate rooftop irradiance using hourly weather and a terrain horizon, computing shadows from nearby buildings, trees, and roof superstructures rendered from the Sun's viewpoint. Our method (i) infers existing panel layouts from imagery and estimates their yield, (ii) relocates these panels to improve the yield, and (iii) generates shading-aware layouts for new installations. We compare modeled yield with production records from 11 Swiss installations and evaluate new layouts in simulation on 19 additional rural roofs. Without knowledge of any electrical or system specifications, we obtain a median daily correlation with measured production of 0.982. Absolute energy estimates remain sensitive to system specifications. Comparing new layouts with equal panel counts, accounting for neighborhood and roof-detail shading changes the position or orientation of an average of 38.9\% of panels per roof. These layouts increase modeled annual yield by up to 7.91\% compared with layouts designed without accounting for neighborhood and roof-detail shadows. We publicly release our tool for modeling and designing rooftop PV installations with terrain, neighborhood, and roof-detail shading at https://github.com/tobiasvonarx/shading-aware-pv.

0.40

Vision Transformers for Estimating Irradiance Using Data Scarce Sky Images

eess.IV cs.AIcs.CVcs.LG ·2026-10-22 ·David Hamlyn, Sunny Chaudhary, Tasmiat Rahman
publishedhighly cited similarity 0.64
Abstract

Accurate estimation of diffuse horizontal irradiance (DHI) is critical for optimising photovoltaic system performance and energy forecasting yet remains challenging in regions lacking comprehensive ground-based instrumentation. Recent advancements using Vision Transformers (ViTs) trained on extensive sky image datasets have shown promise in replacing costly irradiance measurement equipment, but the scarcity of long-term, high-quality sky imagery significantly restricts practical implementation. Addressing this critical gap, this study proposes a novel dual-framework approach designed for data-scarce scenarios. First, calculated atmospheric parameters, including extraterrestrial irradiance and cyclic time encodings, are integrated to represent sky conditions without utilising any instrumentation. Next, a sequential pipeline initially predicts synthetic global horizontal irradiance (GHI) and uses it as a feature, to refine DHI estimation. Finally, a dual-parallel architecture simultaneously processes raw and overlay-enhanced fisheye sky images. Overlays are generated through unsupervised, physics-informed cloud segmentation to highlight dynamic sky features. Empirical validation is performed using data from the Chilbolton Observatory, chosen for its temperate climate and frequent cloud variability. To simulate data-scarce conditions, models are trained on a single month (e.g., January) and evaluated across a temporally disjoint, full-year test set. Under this setup, the sequential and dual-parallel frameworks achieve RMSE values within 2-3 W/m^2 and 1-6 W/m^2, respectively, of a state-of-the-art ViT trained on the complete dataset. By combining physics-informed modelling with unsupervised segmentation, the proposed method provides a scalable and cost-effective solution for DHI estimation, advancing solar resource assessment in data-constrained environments.

0.56

Bidirectional Multimodal Fusion of Sky Images and Time-Series for Solar Forecasting with Large Language Models

cs.LG ·2026-09-10 ·Ken Chen, Maneesha Perera, Wei Wang, Sachith Seneviratne, Hansani Weeratunge +1 more
similarity 0.64
Abstract

Short-term photovoltaic (PV) power and global horizontal irradiance (GHI) forecasts are essential for effective dispatch, reserve scheduling, and grid operations. At these forecasting horizons, errors are predominantly driven by cloud induced ramps: relying solely on historical numerical data may struggle to anticipate an incoming cloud, making ground-based sky images a crucial complementary physical signal. Furthermore, forecast performance is highly sensitive to location and local observing conditions, creating a strong need for site-specific data that are often scarce. Recently, large language models (LLMs) have demonstrated competitive performance and high data efficiency in time-series forecasting. Despite their success, existing LLM-based forecasting methods remain predominantly unimodal, relying primarily on historical numerical time-series data. Effectively incorporating sky imagery into an LLM-based forecasting framework remains under-explored and an open challenge. In this paper, we propose SolCloudLLM, an LLM-based multimodal forecasting framework. SolCloudLLM aligns sky-image patches with time-series patches and fuses their corresponding representations through bidirectional multimodal fusion, yielding a unified representation that is subsequently mapped into the embedding space of an LLM. Extensive experiments on the SIRTA and SKIPP'D datasets demonstrate that SolCloudLLM consistently outperforms the best baseline methods in MSE across all forecasting horizons, achieving a maximum relative MSE reduction of 25.4%. Stratified analysis further indicates that the benefits of multimodal fusion are concentrated primarily under cloudy conditions. Notably, SolCloudLLM achieves the best performance in nearly all few-shot settings, whereas other deep learning baselines experience substantial performance degradation and are frequently outperformed by the non-learning physical method.

0.07

IMPACT: Inverter-Informed Multimodal Learning for Photovoltaic Generation Forecasting

cs.LG cs.AI ·2026-10-29 ·Anushka Katiyar, Cong Feng, Jing Wang, Tristan Liu, Simon Julien +1 more
similarity 0.60
Abstract

This work develops a physics-informed multimodal deep learning framework for 10- to 110-minute-ahead probabilistic photovoltaic power forecasting. The forecasting model is built on a four-branch architecture that separately encodes plant-level temporal history and inverter-level spatial cloud dynamics through a graph attention encoder with a learned adjacency, known-future solar geometry, and the current meteorological state, fused through gated cross-attention. The geometry branch adds two forward-looking physical signals, spatial cloud heterogeneity and inverter ramp-down activity, each empirically weighted toward the horizon where it is most predictive. The decoder anchors its prediction to a smart persistence baseline, learning a horizon-conditioned correction, and the resulting quantile forecasts are calibrated online through a kernel-weighted adaptive conformal calibration step. The proposed model outperforms all 14 baselines, achieving a forecast skill score (FSS) of 0.2950, 0.099 above the next-best model. A branch-composition ablation shows that every branch contributes positively and the model retains substantial skill in challenging overcast and variable sky conditions (FSS 0.198 and 0.255).

0.10

Segmentation-Guided Direct Capacity Estimation of Rooftop Photovoltaics from Aerial Imagery

cs.CV cs.AI ·2026-11-17 ·Guibin Chen, Emma Fan, Yuzhang Lin
similarity 0.60
Abstract

Distribution planners need installation-level inventories of rooftop photovoltaic (PV) capacity, but interconnection records may be incomplete or spatially aggregated. Conventional image-based estimators segment PV arrays, convert the mask to physical area, and multiply by an estimated power density, coupling capacity prediction to mask-derived area. We propose Direct Head, a segmentation-guided architecture that retains U-Net segmentation and soft-mask pooling while directly regressing nonnegative capacity from PV-region features and area descriptors. We evaluate three independent runs on 7,590 French rooftop installations under the original split and a department-based holdout. Relative to a parameter-matched area-density neural model, Direct Head reduces mean absolute error by 8.7% and 12.5%, and symmetric mean absolute percentage error by 14.0% and 20.7%, respectively. Comparisons with conventional estimators, controlled architecture variants, auxiliary-loss ablations, and representative cases show that segmentation provides useful spatial evidence without requiring capacity to be determined by an area-density product.

0.23

An Empirical Study on Learning Rooftop Solar Potential from Satellite Imagery Directly Without Explicit Geometry

cs.CV ·2026-10-30 ·Joshua Lee
code/data similarity 0.59
Abstract

Rooftop solar potential estimation often relies on LiDAR, digital surface models (DSMs), or pipelines that explicitly reconstruct roof geometry before estimating solar potential. We propose Direct Rooftop Solar Prediction (DRSP), an end-to-end formulation that maps satellite imagery and coarse regional sunlight information directly to application-level solar outputs. DRSP neither requires explicit geometric representations as input nor predicts roof orientation, slope, height, DSMs, or other geometric quantities as intermediate outputs, and therefore requires no geometric intermediate supervision. To enable large-scale study of this formulation, we develop a programmatic data-curation pipeline that converts per-panel information from the Google Solar API into usable-rooftop masks and spatial solar-energy targets, yielding two geographically distinct datasets containing approximately 60K rooftops from the U.S. Midwest and 87K from Texas. We demonstrate the feasibility of DRSP and systematically characterize the effects of geographic training distribution, model depth, image resolution, regional sunlight conditioning, and heatmap regression objectives. Overall, our results suggest that useful rooftop-scale solar information can be learned directly from 2D imagery without explicit geometric intermediate representations, offering a simpler path toward large-scale solar assessment. Our code and dataset are available at https://github.com/joshualee124/direct_rooftop_solar_prediction.

0.38

A 10K drone image dataset with component-level annotations for rooftop photovoltaic inspection

cs.CV ·2026-11-10 ·Penglei Zhang, Wan Zhang, Ruizhe Deng, Bo Chen, Wenhao Duan +6 more
datasethot direction similarity 0.57
Abstract · 14 pages, 4 figures. Supplementary information is included as an ancillary file

Component-level information supports rooftop photovoltaic (PV) inspection, but recognizing individual components across complex scenes remains challenging. We present PVIS-10K, a dataset of 10,065 drone images with component-level annotations covering 63,632 physical PV modules across 22 rooftop installations. The high-resolution red-green-blue (RGB) images were acquired by unmanned aerial vehicles (UAVs, also known as drones) in Ningbo, Shaoxing and Shenzhen, China. Multi-angle oblique observations capture installation-height and scale variation, dense arrangements, occlusion, shadows and reflections. Three-dimensional delineation, reprojection and image-by-image review produced 3,516,675 image-level polygon annotations, stored in Common Objects in Context (COCO) format. Station-disjoint partitions support evaluation on unseen stations within and across cities. Four supervised models and text-prompted zero-shot Segment Anything Model 3 (SAM 3) provide full-resolution benchmarks of instance matching and foreground coverage. PVIS-10K supports component localization, delineation and image-based counting for drone-based rooftop PV inspection research.

0.23

GateFormer: Forecast-Space Decomposition for Intra-Hour Solar Irradiance Prediction from Sky Images

eess.IV cs.AIcs.CVcs.LG ·2026-10-22 ·David Hamlyn, Sunny Chaudhary, Jonathon Hare, Tasmiat Rahman
publishedbenchmark similarity 0.56
Abstract

Sub-hourly dispatch, balancing, and storage control increasingly depend on forecasts that anticipate rapid variability in solar generation. Accurate sky-image-based irradiance forecasting requires a combination of visual cloud dynamics with recent irradiance state while adapting to different short-term irradiance-change regimes. To address this, we introduce GateFormer, a GHI-conditioned dual-decoder ViT for intra-hour global horizontal irradiance (GHI) forecasting through forecast-space decomposition. GateFormer embeds observed GHI into the visual token stream, allowing interaction with sky-image patch features through self-attention. From this shared representation, a Trajectory Head predicts future GHI sequence, while a Delta Head predicts final-horizon change from the latest observed GHI. The two final-horizon forecasts are adaptively weighted in prediction space, with magnitude- and direction-supervision targeting the remaining error. On the NREL-TSI benchmark, GateFormer attains 125.01 W/m^2 RMSE at +30 min, improving over a state-of-the-art transformer baseline by 9.6% under paired-timestamp evaluation. Across NREL-TSI, Chilbolton, and SIRTA, GateFormer achieves the lowest final-horizon RMSE among the evaluated baselines, with forecast skill of 22.97-28.86% relative to smart persistence. Component ablations show adaptive weighting outperforms both individual decoders and fixed averaging, distinguishing GateFormer from conventional forecast combination, while the supervised correction further reduces RMSE by 1.68 W/m^2 and MAE by 4.86 W/m^2. Ramp-regime diagnostics show larger gains during operationally important positive ramps, reducing RMSE by 26.27 W/m^2. These results identify forecast-space decomposition as an alternative forecasting formulation, with potential relevance to other multimodal short-horizon forecasting tasks and deployment using only sky images and measured GHI.

0.26