CS Paper Radar

Segmentation-Guided Direct Capacity Estimation of Rooftop Photovoltaics from Aerial Imagery

Guibin Chen, Emma Fan, Yuzhang Lin

cs.CV cs.AI ·submitted 2026-11-17 01:56 UTC · v1

Abstract

Distribution planners need installation-level inventories of rooftop photovoltaic (PV) capacity, but interconnection records may be incomplete or spatially aggregated. Conventional image-based estimators segment PV arrays, convert the mask to physical area, and multiply by an estimated power density, coupling capacity prediction to mask-derived area. We propose Direct Head, a segmentation-guided architecture that retains U-Net segmentation and soft-mask pooling while directly regressing nonnegative capacity from PV-region features and area descriptors. We evaluate three independent runs on 7,590 French rooftop installations under the original split and a department-based holdout. Relative to a parameter-matched area-density neural model, Direct Head reduces mean absolute error by 8.7% and 12.5%, and symmetric mean absolute percentage error by 14.0% and 20.7%, respectively. Comparisons with conventional estimators, controlled architecture variants, auxiliary-loss ablations, and representative cases show that segmentation provides useful spatial evidence without requiring capacity to be determined by an area-density product.

Closest papers

Nearest neighbours by meaning across the whole index.

An Empirical Study on Learning Rooftop Solar Potential from Satellite Imagery Directly Without Explicit Geometry

cs.CV ·2026-10-30 ·Joshua Lee
code/data similarity 0.65
Abstract

Rooftop solar potential estimation often relies on LiDAR, digital surface models (DSMs), or pipelines that explicitly reconstruct roof geometry before estimating solar potential. We propose Direct Rooftop Solar Prediction (DRSP), an end-to-end formulation that maps satellite imagery and coarse regional sunlight information directly to application-level solar outputs. DRSP neither requires explicit geometric representations as input nor predicts roof orientation, slope, height, DSMs, or other geometric quantities as intermediate outputs, and therefore requires no geometric intermediate supervision. To enable large-scale study of this formulation, we develop a programmatic data-curation pipeline that converts per-panel information from the Google Solar API into usable-rooftop masks and spatial solar-energy targets, yielding two geographically distinct datasets containing approximately 60K rooftops from the U.S. Midwest and 87K from Texas. We demonstrate the feasibility of DRSP and systematically characterize the effects of geographic training distribution, model depth, image resolution, regional sunlight conditioning, and heatmap regression objectives. Overall, our results suggest that useful rooftop-scale solar information can be learned directly from 2D imagery without explicit geometric intermediate representations, offering a simpler path toward large-scale solar assessment. Our code and dataset are available at https://github.com/joshualee124/direct_rooftop_solar_prediction.

0.38

Evaluating Semantic and Spatial Guidance for Foundation Model Segmentation of Small-Scale PV in Remote Sensing Imagery

cs.CV ·2026-08-11 ·Roni Blushtein-Livnon, Tal Svoray, Osher Rafaeli, Michael Dorman, Itay Fischhendler +2 more
similarity 0.61
Abstract

Spatio-temporal PV data are essential for understanding adoption processes in off-grid regions, yet such data remain largely unavailable. Automated segmentation of remote sensing (RS) imagery offers a promising solution; yet, residential PV systems remain challenging targets because of their small size and sparse distribution, resulting in severe target-background imbalance. Vision-language foundation models (FMs) provide a data-efficient paradigm through prompt-based semantic and spatial guidance, but the relative contribution of different prompt types remains unclear. We systematically evaluate SAM3 for small-scale PV segmentation in RS imagery by comparing textual, geometric, and hybrid prompting, under varying supervision levels, training strategies, spatial resolutions, and imaging conditions. Multi-temporal aerial imagery from a large off-grid rural region serves as a study site, with findings validated across three additional datasets. Prompting strategy emerged as the dominant factor governing model behavior. Textual prompting consistently produced the lowest performance and showed the greatest sensitivity to supervision and imaging conditions. In contrast, spatial guidance substantially improved both segmentation accuracy and robustness. Hybrid prompting achieved the highest accuracy and stability, indicating that semantic and spatial guidance provide complementary information. Most performance gains were achieved with only a few hundred annotated samples, demonstrating strong data efficiency. Transfer learning had limited overall impact, with only modest improvements observed for textual prompting under limited supervision. Overall, our findings establish prompting strategy as a key determinant of SAM3 adaptation, robustness, and generalization, highlighting the potential of promptable FMs for scalable PV mapping in data-constrained off-grid regions.

0.04

Edge-Adaptive Hiera-Seg Model for Building-Integrated Photovoltaic Power Forecasting

cs.CV cs.LG ·2026-11-15 ·Na Yu
similarity 0.60
Abstract · 13 pages, 7 figures, 1 table

Building integrated photovoltaic power forecasting is challenging because facade orientation, rooftop geometry, nearby buildings, vegetation, cloud movement, module temperature, inverter status and edge device reliability jointly affect power generation. This paper proposes an edge-adaptive HieraSeg model for short term BIPV power forecasting with multi-orientation visual-irradiance fusion. RGB facade images, optional thermal cues, irradiance measurements, module temperature, facade orientation, rooftop masks, shading labels, sky condition, historical power and edge device state are aligned into synchronous forecasting windows. HieraSeg extracts hierarchical regions from facade, rooftop, sky, shadow and background images, while the edge-adaptive module changes feature weights under missing frames, latency shifts and local shading changes. The segmentation branch identifies occluded module areas and separates facade, rooftop, sky and background evidence before the forecasting head estimates future BIPV output. Experiments are designed on a simulated multibuilding BIPV dataset with unseen building and unseen orientation tests. The model reports predicted power, confidence interval, dominant evidence, occlusion contribution, orientation contribution and energy-management review priority. This output is intended to show whether the forecast is driven by irradiance change, visible shading, orientation response, stale edge information or recent power history. The framework supports local forecasting at edge controllers with limited communication delay and computing resources, linking visual occlusion, irradiance dynamics and power history to traceable forecasting results for building energy management, microgrid scheduling and BIPV operation planning.

0.24

High-fidelity training-free photovoltaic module mapping from multi-view UAV imagery

cs.CV ·2026-11-03 ·WenHao Duan, Qi Chen, Penglei Zhang, Ruizhe Deng, Zhiling Guo +2 more
similarity 0.58
Abstract · 39 pages, 16 figures

High-fidelity photovoltaic (PV) module mapping requires complete instance recovery and accurate delineation. Vision foundation models offer zero-shot segmentation, but converting incomplete and inconsistent predictions across views into a complete, geometrically accurate map of individual modules remains challenging. We propose the Multi-View PV Module Mapper (MV-PVMapper), a training-free framework coupling vision foundation models with unmanned aerial vehicle (UAV) photogrammetry. First, Segment Anything Model 3 (SAM 3) generates candidates from original images using text prompts. Their contours are then transferred into object space through per-module slope correction to limit distortion from surface-model noise, and verified against representative module dimensions to guide cross-view instance selection. Finally, accepted instances return to all covering images as box prompts for SAM~3, supplementing text prompts with spatial cues for iterative segmentation, verification and fusion. On five-direction surveys of three operational rooftop PV plants at approximately 1 cm nadir ground sampling distance, two feedback iterations recover 7,710 of 7,711 reference modules with no false positives at an intersection-over-union (IoU) matching threshold of 0.5. Macro-averaged area precision and recall reach 99.00 % and 98.52 %, respectively. Averaged across sites, the aggregated Jaccard index reaches 97.55 %, compared with 60.73 % and 41.24 % for orthomosaic segmentation and multi-view pixel-voting baselines, respectively; average precision at the stricter IoU threshold of 0.95 reaches 95.67 %. Ablation studies show that module-size constraints are critical for instance separation, while slope correction and feedback to all covering views improve boundary accuracy. These results are achieved without task-specific image annotation or segmentation-model weight updates.

0.30

Nationally Consistent, Locally Incomplete: A Bayesian Remote-Sensing Audit of Rooftop Photovoltaic Registries

cs.LG stat.AP ·2026-09-14 ·Gabriel Kasmi, Yves-Marie Saint-Drenan, Laurent Dubus, Philippe Blanc
similarity 0.57
Abstract · 47 pages, 5 tables, 15 figures

Tracking the energy transition requires reliable statistics on renewable deployment. Rooftop photovoltaics (PV) are especially hard to track, owing to their decentralised nature, and the resulting inaccuracies in official statistics are known but not quantified. Remote sensing offers an independent way to identify rooftop PV systems. We introduce a Bayesian framework to estimate the ground-truth rooftop PV capacity from remote sensing detections, turning an imperfect detector into an uncertainty-aware measurement instrument. Applied to France, the corrected detections estimate a capacity of 4.03 GWp [3.96--4.11] (99% credible interval) of rooftop PV below 36 kWp, matching the transmission system operator's connection data within 3.3% nationally, while identifying local under-reports of up to 61% of local capacity. We also document and quantify a significant truncation bias in French rooftop PV open data. Beyond France, the approach paves the way for more reliable estimates of rooftop PV capacity worldwide.

0.36

Shading-Aware Rooftop PV Placement

cs.CE ·2026-09-19 ·Tobias von Arx, Srinivasan Keshav
code/data similarity 0.56
Abstract

Rooftop photovoltaic (PV) design requires careful panel placement to make effective use of potentially limited roof space and available sunlight. Existing simplified roof models can miss objects and superstructures that shade panels. We simulate rooftop irradiance using hourly weather and a terrain horizon, computing shadows from nearby buildings, trees, and roof superstructures rendered from the Sun's viewpoint. Our method (i) infers existing panel layouts from imagery and estimates their yield, (ii) relocates these panels to improve the yield, and (iii) generates shading-aware layouts for new installations. We compare modeled yield with production records from 11 Swiss installations and evaluate new layouts in simulation on 19 additional rural roofs. Without knowledge of any electrical or system specifications, we obtain a median daily correlation with measured production of 0.982. Absolute energy estimates remain sensitive to system specifications. Comparing new layouts with equal panel counts, accounting for neighborhood and roof-detail shading changes the position or orientation of an average of 38.9\% of panels per roof. These layouts increase modeled annual yield by up to 7.91\% compared with layouts designed without accounting for neighborhood and roof-detail shadows. We publicly release our tool for modeling and designing rooftop PV installations with terrain, neighborhood, and roof-detail shading at https://github.com/tobiasvonarx/shading-aware-pv.

0.40

Spatio-Temporal Detection of Photovoltaic Systems on Industrial Building Rooftops Using Satellite Imagery and Machine Learning

cs.CV cs.LG ·2026-10-12 ·Frederick Bruch, Christian Knoth, Florian Detsch, Edzer Pebesma, Hanna Meyer
code/data similarity 0.55
Abstract

The global transition toward carbon-neutral energy systems is heavily dependent on the rapid deployment of solar photovoltaic (PV) infrastructure, yet the speed of this expansion has outpaced the ability of administrative registries to maintain accurate records. While high-resolution commercial imagery is often used for monitoring, its high cost and infrequent updates can create an information gap for grid operators, energy infrastructure developers and policymakers. This study addresses the lack of scalable monitoring for industrial-scale rooftop PV systems by developing a machine learning framework that utilizes open-access, multispectral Sentinel-2 satellite imagery. By integrating building geometries from OpenStreetMap with Sentinel-2 reflectance data, a Random Forest model was trained to identify the specific spectral signatures of PV modules. Moving beyond theoretical modeling, this work emphasizes practical implementation through the development of an interactive web-based prototype for on-demand site monitoring. The application enables users to retrieve up-to-date satellite observations and assess the presence of PV systems on industrial building rooftops. The tool incorporates quality metrics that inform users whether a prediction is supported by sufficient training data density or requires manual verification. This end-to-end framework demonstrates that open-source medium-resolution data can effectively bridge this monitoring gap.

0.37

Vision Transformers for Estimating Irradiance Using Data Scarce Sky Images

eess.IV cs.AIcs.CVcs.LG ·2026-10-22 ·David Hamlyn, Sunny Chaudhary, Tasmiat Rahman
publishedhighly cited similarity 0.55
Abstract

Accurate estimation of diffuse horizontal irradiance (DHI) is critical for optimising photovoltaic system performance and energy forecasting yet remains challenging in regions lacking comprehensive ground-based instrumentation. Recent advancements using Vision Transformers (ViTs) trained on extensive sky image datasets have shown promise in replacing costly irradiance measurement equipment, but the scarcity of long-term, high-quality sky imagery significantly restricts practical implementation. Addressing this critical gap, this study proposes a novel dual-framework approach designed for data-scarce scenarios. First, calculated atmospheric parameters, including extraterrestrial irradiance and cyclic time encodings, are integrated to represent sky conditions without utilising any instrumentation. Next, a sequential pipeline initially predicts synthetic global horizontal irradiance (GHI) and uses it as a feature, to refine DHI estimation. Finally, a dual-parallel architecture simultaneously processes raw and overlay-enhanced fisheye sky images. Overlays are generated through unsupervised, physics-informed cloud segmentation to highlight dynamic sky features. Empirical validation is performed using data from the Chilbolton Observatory, chosen for its temperate climate and frequent cloud variability. To simulate data-scarce conditions, models are trained on a single month (e.g., January) and evaluated across a temporally disjoint, full-year test set. Under this setup, the sequential and dual-parallel frameworks achieve RMSE values within 2-3 W/m^2 and 1-6 W/m^2, respectively, of a state-of-the-art ViT trained on the complete dataset. By combining physics-informed modelling with unsupervised segmentation, the proposed method provides a scalable and cost-effective solution for DHI estimation, advancing solar resource assessment in data-constrained environments.

0.56