CS Paper Radar

Residential Electricity Consumption Dataset for Sri Lanka (RECON-SL)

Chanuka Algama, Merl Chandana, Isuruni Fernando, Dinithi Dissanayake, Amanda Ariyaratne, Nipuni Habaragamuwa, Pasindu Ranage, Jesús Ramos, Kasun Amarasinghe

cs.DL ·submitted 2026-09-23 21:02 UTC · v1
code/data

Abstract

This article describes the Residential Electricity Consumption Dataset for Sri Lanka (RECON-SL), a multi-source resource that integrates utility records, high-frequency smart meter data, and household surveys from the service area of Lanka Electricity Company (LECO) in Sri Lanka. The dataset captures electricity use for 4,063 households, collected over the period October 2022 to January 2025, with coverage at monthly, 6-hour, and 15-minute intervals. Monthly billing-cycle data provide complete coverage across all households, while smart meter data are available for a subsample of 1,438 households, offering both fine-grained 15-minute readings and coarser 6-hour records. Three survey waves complement these consumption measures, collecting information on demographics, housing, appliance ownership, and perceptions of energy security. Across its components, the dataset includes more than 50 million meter readings and detailed survey responses from over 11,000 household interviews. As the first dataset of its kind in Sri Lanka, and among the few worldwide to link smart meter records with longitudinal survey data at this scale, it provides a unique resource for energy, machine learning and policy research, with known gaps in smart meter coverage documented for users. The dataset can support diverse applications, including electricity load forecasting, socio-economic and behavioral energy research, distribution planning, and policy analysis in energy affordability and equity. Access is provided through an open repository, with accompanying documentation and scripts to facilitate reuse.

Closest papers

Nearest neighbours by meaning across the whole index.

Questionnaire-Guided Disaggregation of Energy Appliance Use for Domestic Smart Meter Data

cs.AI ·2026-10-01 ·Achal Nanjundamurthy, Rupam Misra, Suzanne Little, Alan F. Smeaton
similarity 0.67
Abstract

Ireland's smart metering programme records electricity use at 30-minute resolution, with smart meters installed in over 80\% of households as of late 2025. While this is useful for billing of smart, time-of-use tariffs, it is too coarse to capture use of domestic appliances. We present a label-free disaggregation system that breaks usage data into 9 appliance categories by combining event detection for high-power loads with questionnaire-guided estimation. Our evaluation draws on four datasets: a calibration household with a commercial comparator, two public benchmarks (UK-DALE and REFIT) with per-appliance sub-metering, and a smart meter dataset of more than 4,800 years of use from 2,968 Irish consumers. Compared against two independently developed disaggregation systems our hybrid method combining analysis of usage data with questionnaire results, achieves the lowest whole-decomposition error on all buildings across the datasets, with better month-level performance over 54 paired months ($p<0.001$, Holm-corrected). Our method provides useful advice on a household's energy consumption patterns and advice on how to reduce or shift usage on some appliances in order to reduce costs.

0.07

Uncovering Residential PV-EV Co-Adoption from Smart-Meter Data: Load Archetypes and Detection for Demand-Side Planning

cs.LG ·2026-09-23 ·Jack Zheng, Hao Wang
published similarity 0.65
Abstract

The increasing adoption of electric vehicles (EVs) and rooftop photovoltaic (PV) systems is reshaping residential electricity demand and creating new challenges for demand-side management (DSM), tariff design, and low-voltage network planning. Much of the existing literature examines EV charging or PV generation in isolation, leaving the behavioral dynamics of household co-adoption less understood. We develop an integrated, two-part workflow to analyze advanced metering infrastructure (AMI) data. A discovery component applies dynamic time warping (DTW) k-means with DTW barycenter averaging to cluster daily import or export profiles into interpretable behavioral archetypes, while a predictive component trains a bidirectional long short-term memory (BiLSTM) model on 21-day windows and benchmarks it against tabular baselines for PV/EV activity detection. The EV activity labels are inferred from charging-like load signatures because charger measurements are unavailable. Using half-hourly AusNet residential data from Victoria, Australia, the clustering uncovers distinct patterns across PV-only, EV-only, co-adoption, and neither cohorts; for co-adopters, a midday-centered weekday export archetype accounts for approximately 50% of days. At validation-tuned thresholds, both BiLSTM and XGBoost achieve strong discrimination. BiLSTM obtains 0.991 for the area under the receiver operating characteristic curve (AUROC), 0.906 for macro-F1, and the highest recall on the most difficult class (0.836 for EV-only recall). Tree-based baselines remain competitive. Performance remains stable across plausible labeling rules (macro-F1: 0.894--0.914) and strictly forward temporal splits (macro-F1: 0.894--0.906).

0.48

LoaDiff: Conditional Generation of Electricity Consumption Time Series for Energy Analytics

cs.LG cs.AIeess.SP ·2026-09-10 ·Mariia Baranova, Adrien Petralia, Etienne Le Naour, Nathan Etourneau, Guillaume Hofmann +1 more
top venue similarity 0.61
Abstract · 10 pages, 5 figures. This paper appeared in IEEE ICDM 2026

The energy transition is reshaping residential electricity consumption through the increasing adoption of distributed generation, electrified appliances, and demand-response programs. Understanding these evolving behaviors requires access to granular smart-meter data for applications such as load forecasting, appliance detection, and demand-side flexibility analysis. However, such data are subject to strict access restrictions and data-protection regulations. Thus, realistic synthetic alternatives are necessary. In this paper, we introduce LoaDiff, a diffusion-based generative model for year-long, sub-hourly smart-meter load curves. LoaDiff supports flexible conditioning on static household attributes, such as appliance ownership, and dynamic contextual variables, including calendar information and outdoor temperature. We evaluate the model against multiple generative baselines on three residential electricity-consumption datasets. Our experiments assess four complementary dimensions: fidelity and diversity, training-record memorization risk, downstream utility for load forecasting and appliance detection, and conditional controllability under alternative temperature conditions. The results show that LoaDiff generates realistic and diverse load profiles, achieves a favorable trade-off between generation quality and limited evidence of memorization, preserves information useful for downstream energy applications, and responds coherently to changes in conditioning variables.

0.44

Ask for Any Appliance: A Prompt-Programmable Foundation Model for Non-Intrusive Load Monitoring

cs.LG eess.SP ·2026-09-19 ·Xudong Wang, Jiacheng Cui, Junyu Xue, Tongxin Li, Guoming Tang
similarity 0.58
Abstract · Preprint

Non-intrusive load monitoring (NILM) estimates appliance-level consumption from a whole-home meter, but appliance-specific models and fixed output inventories make coverage costly to extend. We present FM4NILM (Foundation Model for NILM), a single prompt-programmable model that estimates a requested appliance's power trajectory from aggregate measurements, a natural-language description, and optional activation exemplars. A lightweight cadence-aware transformer is pretrained by masked reconstruction on 645k sequences from seven public corpora spanning 1-60 s sampling intervals, then aligned with appliance requests using observation-masked losses for partially labeled households. A Bernoulli-lognormal decoder separates activity detection from conditional power estimation. On held-out households and time periods from REDD, UK-DALE, and REFIT, one frozen text-prompted model serves twelve appliance-corpus requests, achieving 0.556 event F1, 0.625 AUPRC, and the lowest active-window MAE (251.8 W) among seven appliance-specific baselines. Streaming score aggregation raises event F1 to 0.582 with a 60 s aggregation delay. In a separate category-held-out evaluation, adding ten activation exemplars raises microwave AUPRC from 0.132 to 0.214 without parameter updates. Input-intervention ablations probe the model's dependence on appliance requests and aggregate measurements. These results demonstrate competitive disaggregation with one shared model and support extending appliance coverage through prompts and examples rather than additional specialist networks.

0.10

Non-intrusive appliance state detection in unseen homes using classical machine learning

cs.LG eess.SP ·2026-10-31 ·Zablon Ombiro
similarity 0.57
Abstract · 49 pages, 9 figures

Non-intrusive load monitoring (NILM) infers, from the aggregate signal of a single smart meter, when each appliance in a home is ON or OFF, offering significant potential to enhance energy efficiency. Classical machine-learning detectors report F1 scores (the harmonic mean of precision and recall) from 0.53 to 0.98, but the causes of this spread are unseparated, so it is unclear which design choices matter. Real-world deployments, however, require detectors that work in houses never seen during training, whereas most studies test on houses used for training. To address this challenge, we propose a factorial analysis of variance design that separates the effects of classifier, feature set and class-imbalance strategy across five appliances (270 configurations), and a leave-house-out protocol with house-grouped model selection. Unlike studies that vary one factor at a time or pool houses, the approach attributes performance to each factor and measures it on unseen homes. Extensive experiments on REFIT, a public dataset of 20 UK households, show that the appliance explains 38 percent of F1 variance, the feature set 13 percent, the classifier 8 percent and the imbalance strategy 2 percent. Pooled testing overstates support-weighted F1 (0.548 versus 0.447 in unseen houses), class weighting gains grow from 32 percent to 69 percent, and feature engineering gives the same 52 percent gain in both protocols. House-grouped selection raises F1 for three of five appliances, by up to 0.110, and a convolutional neural network scores 0.450 (0.496 calibrated) against 0.447 for classical models. The findings guide appliance-level monitoring in smart-metering and energy-management systems.

0.19

Data-driven estimation of design heating loads for HVAC equipment sizing

eess.SY ·2026-09-07 ·Alex H. Lee, Elias N. Pergantis, Kevin J. Kircher
similarity 0.56
Abstract

Oversized heating and cooling equipment can unnecessarily increase up-front costs, energy costs, pollutant emissions, and strain on electrical infrastructure. This paper develops two data-driven methods for estimating heating loads at design conditions to improve equipment sizing. One method uses smart thermostat data; the other uses utility bills. We test the methods on a dataset that we gathered from 74 detached single-family houses in five United States climate zones. The dataset includes smart thermostat time-series data, monthly utility bills, weather data, existing equipment specifications, and Manual J design load calculations (the United States industry standard) purchased from practitioners. The two methods have strong goodness-of-fit statistics individually and show fair agreement with each other. On average over the 74 houses, existing heating equipment is 2.75 (2.5th to 97.5th empirical percentile: 1.34-6.52) times larger than the thermostat-method estimate and 2.96 (1.36-7.76 times larger than the bill-method estimate. As implemented by practitioners, the Manual J estimate is 2.26 (0.87-5.21) times larger on average than the thermostat-method estimate and 2.35 (1.02-5.28) times larger than the bill-method estimate. We discuss prospects for implementing the data-driven methods at scale and for incorporating data-driven sizing into industry standards.

0.26

Full-Feature versus Limited-Input Machine Learning for Residential Energy Estimation: A Comparative Analysis of RECS and ResStock Under Realistic Input Constraints

cs.LG ·2026-08-10 ·Aditya Ramnarayan, Fatih Evren, Patti Gunderson, Samuel Rosenberg
code/data similarity 0.56
Abstract

Residential energy estimates are often needed before detailed envelope characteristics, equipment efficiencies, infiltration, sensor, or billing data are available. This study quantifies the trade-off between predictive accuracy and input accessibility using two nationally representative U.S. residential-energy datasets: the survey-based Residential Energy Consumption Survey (RECS) and the simulation-based ResStock dataset. Full-feature models were first used to establish dataset-specific performance benchmarks. For total-energy estimation, the models were subsequently restricted to ten low-burden variables obtainable from occupants, administrative records, or location-based weather data without an on-site energy audit. Among CatBoost, XGBoost, LightGBM, Random Forest, and Neural Networks, CatBoost consistently achieved the highest predictive performance for the full-feature analysis, reaching R2 = 0.90 for ResStock and R2 = 0.73 for RECS. When the feature set was restricted to ten homeowner-accessible inputs to simulate realistic deployment conditions, model performance converged to R2 = 0.61 for RECS and R2 = 0.62 for ResStock, showing that algorithmic complexity cannot fully compensate for missing physical and behavioral information. However, for a more homogeneous ResStock cohort consisting of single-family detached, natural-gas-heated homes in Climate Zone 6A constructed between 2000 and 2010, a reduced-input model improved accuracy to R2 = 0.85, demonstrating the value of targeted modeling for homogeneous populations. The results indicate that tree-based ensemble models can serve as high-fidelity emulators of national-scale residential energy datasets. However, careful consideration of feature availability, dataset origin (empirical vs. synthetic), and applicable use cases are also important.

0.20

Calendar-Structured Sparse Principal Component Analysis for Interpretable Multi-Periodic Electricity Consumption Profiles

cs.LG cs.AI ·2026-09-05 ·Carlos Quesada-Granja, Tony Castillo-Calzadilla, Carlos Rizo-Maestre
similarity 0.56
Abstract · 34 pages, 7 figures

Long-term electricity-consumption profiles exhibit several simultaneous periodic structures, including daily, weekly, and annual cycles. This work introduces Calendar-Structured Sparse Principal Component Analysis (Calendar-SPCA), a structured representation-learning method that incorporates this known multi-periodic geometry directly into a low-dimensional factorization. The method represents the feature domain as the Cartesian product of cyclic calendar axes and combines an L1 loading penalty with graph total variation, producing sparse, locally coherent, and directly interpretable latent factors. In this study, Calendar-SPCA is applied to the interpretable analysis of long-term electricity-consumption profiles and evaluated on two independent public smart-meter datasets, GoiEner and Low Carbon London, with different population sizes and temporal resolutions. A factorial experiment characterizes the effects of sparsity and calendar coherence and examines robustness across sample size, latent dimensionality, and repeated fits. At rank 15, Calendar-SPCA retains 96.92% and 82.90% of the explained variance of rank-matched principal component analysis (PCA) in GoiEner and Low Carbon London, respectively, with mean loading sparsities of 61.95% and 81.50%. Comparisons with classical sparse PCA and sparse PCA with total variation (SPCA-TV) show that Calendar-SPCA organizes latent factors into interpretable structures over the daily, weekly, and annual calendar axes while preserving substantial low-rank information.

0.30