CS Paper Radar

Questionnaire-Guided Disaggregation of Energy Appliance Use for Domestic Smart Meter Data

Achal Nanjundamurthy, Rupam Misra, Suzanne Little, Alan F. Smeaton

cs.AI ·submitted 2026-10-01 08:32 UTC · v1

Abstract

Ireland's smart metering programme records electricity use at 30-minute resolution, with smart meters installed in over 80\% of households as of late 2025. While this is useful for billing of smart, time-of-use tariffs, it is too coarse to capture use of domestic appliances. We present a label-free disaggregation system that breaks usage data into 9 appliance categories by combining event detection for high-power loads with questionnaire-guided estimation. Our evaluation draws on four datasets: a calibration household with a commercial comparator, two public benchmarks (UK-DALE and REFIT) with per-appliance sub-metering, and a smart meter dataset of more than 4,800 years of use from 2,968 Irish consumers. Compared against two independently developed disaggregation systems our hybrid method combining analysis of usage data with questionnaire results, achieves the lowest whole-decomposition error on all buildings across the datasets, with better month-level performance over 54 paired months ($p<0.001$, Holm-corrected). Our method provides useful advice on a household's energy consumption patterns and advice on how to reduce or shift usage on some appliances in order to reduce costs.

Closest papers

Nearest neighbours by meaning across the whole index.

Ask for Any Appliance: A Prompt-Programmable Foundation Model for Non-Intrusive Load Monitoring

cs.LG eess.SP ·2026-09-19 ·Xudong Wang, Jiacheng Cui, Junyu Xue, Tongxin Li, Guoming Tang
similarity 0.73
Abstract · Preprint

Non-intrusive load monitoring (NILM) estimates appliance-level consumption from a whole-home meter, but appliance-specific models and fixed output inventories make coverage costly to extend. We present FM4NILM (Foundation Model for NILM), a single prompt-programmable model that estimates a requested appliance's power trajectory from aggregate measurements, a natural-language description, and optional activation exemplars. A lightweight cadence-aware transformer is pretrained by masked reconstruction on 645k sequences from seven public corpora spanning 1-60 s sampling intervals, then aligned with appliance requests using observation-masked losses for partially labeled households. A Bernoulli-lognormal decoder separates activity detection from conditional power estimation. On held-out households and time periods from REDD, UK-DALE, and REFIT, one frozen text-prompted model serves twelve appliance-corpus requests, achieving 0.556 event F1, 0.625 AUPRC, and the lowest active-window MAE (251.8 W) among seven appliance-specific baselines. Streaming score aggregation raises event F1 to 0.582 with a 60 s aggregation delay. In a separate category-held-out evaluation, adding ten activation exemplars raises microwave AUPRC from 0.132 to 0.214 without parameter updates. Input-intervention ablations probe the model's dependence on appliance requests and aggregate measurements. These results demonstrate competitive disaggregation with one shared model and support extending appliance coverage through prompts and examples rather than additional specialist networks.

0.10

Non-intrusive appliance state detection in unseen homes using classical machine learning

cs.LG eess.SP ·2026-10-31 ·Zablon Ombiro
similarity 0.71
Abstract · 49 pages, 9 figures

Non-intrusive load monitoring (NILM) infers, from the aggregate signal of a single smart meter, when each appliance in a home is ON or OFF, offering significant potential to enhance energy efficiency. Classical machine-learning detectors report F1 scores (the harmonic mean of precision and recall) from 0.53 to 0.98, but the causes of this spread are unseparated, so it is unclear which design choices matter. Real-world deployments, however, require detectors that work in houses never seen during training, whereas most studies test on houses used for training. To address this challenge, we propose a factorial analysis of variance design that separates the effects of classifier, feature set and class-imbalance strategy across five appliances (270 configurations), and a leave-house-out protocol with house-grouped model selection. Unlike studies that vary one factor at a time or pool houses, the approach attributes performance to each factor and measures it on unseen homes. Extensive experiments on REFIT, a public dataset of 20 UK households, show that the appliance explains 38 percent of F1 variance, the feature set 13 percent, the classifier 8 percent and the imbalance strategy 2 percent. Pooled testing overstates support-weighted F1 (0.548 versus 0.447 in unseen houses), class weighting gains grow from 32 percent to 69 percent, and feature engineering gives the same 52 percent gain in both protocols. House-grouped selection raises F1 for three of five appliances, by up to 0.110, and a convolutional neural network scores 0.450 (0.496 calibrated) against 0.447 for classical models. The findings guide appliance-level monitoring in smart-metering and energy-management systems.

0.19

Multi-Appliance Non-Intrusive Load Monitoring via Label-Preserving Aggregate Recomposition and Prediction Consistency

cs.LG ·2026-09-16 ·Jiangfeng Liu, Yanfang Fan
similarity 0.71
Abstract

Non-intrusive load monitoring (NILM) estimates appliance power sequences from aggregate power, but models trained on source households commonly lose accuracy in unseen households. Aggregate power also contains loads from other appliances and measurement error, so predictions may depend on the residual background that co-occurs with source-household targets. Time-aligned submetered measurements and the additive decomposition of aggregate power expose a relation unused by window-wise supervision: an aggregate window can be recomposed by replacing only its residual background while preserving all modeled target-appliance power sequences pointwise. We combine label-preserving aggregate recomposition with prediction consistency. Both windows receive complete power and operating-state supervision. For each appliance, disagreement between the two power predictions is penalized only when both satisfy a fixed reliability criterion and only to the extent that it exceeds a fixed margin. The proposed method is implemented using a multi-appliance architecture with two-stage shared-to-specific mixture-of-experts routing. On REDD, UK-DALE, and REFIT, the proposed method lowers appliance-averaged mean absolute error relative to single-window training from 14.75 to 13.14 W, from 8.88 to 8.51 W, and from 15.83 to 14.55 W. Label-preserving aggregate recomposition and prediction consistency are used only during training, and add no inference-time module or parameter.

0.25

Residential Electricity Consumption Dataset for Sri Lanka (RECON-SL)

cs.DL ·2026-09-23 ·Chanuka Algama, Merl Chandana, Isuruni Fernando, Dinithi Dissanayake, Amanda Ariyaratne +4 more
code/data similarity 0.67
Abstract

This article describes the Residential Electricity Consumption Dataset for Sri Lanka (RECON-SL), a multi-source resource that integrates utility records, high-frequency smart meter data, and household surveys from the service area of Lanka Electricity Company (LECO) in Sri Lanka. The dataset captures electricity use for 4,063 households, collected over the period October 2022 to January 2025, with coverage at monthly, 6-hour, and 15-minute intervals. Monthly billing-cycle data provide complete coverage across all households, while smart meter data are available for a subsample of 1,438 households, offering both fine-grained 15-minute readings and coarser 6-hour records. Three survey waves complement these consumption measures, collecting information on demographics, housing, appliance ownership, and perceptions of energy security. Across its components, the dataset includes more than 50 million meter readings and detailed survey responses from over 11,000 household interviews. As the first dataset of its kind in Sri Lanka, and among the few worldwide to link smart meter records with longitudinal survey data at this scale, it provides a unique resource for energy, machine learning and policy research, with known gaps in smart meter coverage documented for users. The dataset can support diverse applications, including electricity load forecasting, socio-economic and behavioral energy research, distribution planning, and policy analysis in energy affordability and equity. Access is provided through an open repository, with accompanying documentation and scripts to facilitate reuse.

0.53

LoaDiff: Conditional Generation of Electricity Consumption Time Series for Energy Analytics

cs.LG cs.AIeess.SP ·2026-09-10 ·Mariia Baranova, Adrien Petralia, Etienne Le Naour, Nathan Etourneau, Guillaume Hofmann +1 more
top venue similarity 0.66
Abstract · 10 pages, 5 figures. This paper appeared in IEEE ICDM 2026

The energy transition is reshaping residential electricity consumption through the increasing adoption of distributed generation, electrified appliances, and demand-response programs. Understanding these evolving behaviors requires access to granular smart-meter data for applications such as load forecasting, appliance detection, and demand-side flexibility analysis. However, such data are subject to strict access restrictions and data-protection regulations. Thus, realistic synthetic alternatives are necessary. In this paper, we introduce LoaDiff, a diffusion-based generative model for year-long, sub-hourly smart-meter load curves. LoaDiff supports flexible conditioning on static household attributes, such as appliance ownership, and dynamic contextual variables, including calendar information and outdoor temperature. We evaluate the model against multiple generative baselines on three residential electricity-consumption datasets. Our experiments assess four complementary dimensions: fidelity and diversity, training-record memorization risk, downstream utility for load forecasting and appliance detection, and conditional controllability under alternative temperature conditions. The results show that LoaDiff generates realistic and diverse load profiles, achieves a favorable trade-off between generation quality and limited evidence of memorization, preserves information useful for downstream energy applications, and responds coherently to changes in conditioning variables.

0.44

Large-Scale Evaluation of Advanced Imputation Methods for Missing Values in Smart Meter Data

cs.LG ·2026-08-21 ·Daniela Stojcheska, Marija Markovska, Dimitar Taskovski, Branislav Gerazov, Boris Nikolov
published similarity 0.63
Abstract · 6 pages, 7 figures; presented at the 2026 IEEE International Conference on Environment and Electrical Engineering and 2026 IEEE Industrial a…

Accurate and reliable collection of electricity consumption data through Advanced Metering Infrastructure (AMI) is of great importance for the operation of smart grids, especially for the detection of non-technical losses (NTL). However, real-world datasets frequently suffer from missing values due to communication failures. This paper presents an empirical evaluation of three advanced algorithms for large-scale data imputation: the Optimally Weighted Average (OWA) method, Low-Rank Matrix Completion via SoftImpute, and a Shape-Modeling Autoencoder. Existing studies on missing value imputation in electricity consumption data often lack validation on larger datasets. Therefore, the goal of this paper is to validate the selected algorithms on a large-scale real-world electricity consumption dataset from North Macedonia that includes 17,428 commercial smart meters over two years. The robustness of each algorithm is evaluated by simulating continuous gaps in the data ranging from 1 to 168 hours. The results indicate that OWA provides the lowest overall reconstruction error across the evaluated gap sizes and strong stability in worst-case scenarios for gaps of up to one week. In contrast, the autoencoder exhibits higher variance, while SoftImpute has stable but inferior accuracy. These findings suggest that imputation methods should be selected based on the characteristics of load curve data and highlight the potential for hybrid algorithmic architectures in future grid management systems.

0.45

Uncovering Residential PV-EV Co-Adoption from Smart-Meter Data: Load Archetypes and Detection for Demand-Side Planning

cs.LG ·2026-09-23 ·Jack Zheng, Hao Wang
published similarity 0.63
Abstract

The increasing adoption of electric vehicles (EVs) and rooftop photovoltaic (PV) systems is reshaping residential electricity demand and creating new challenges for demand-side management (DSM), tariff design, and low-voltage network planning. Much of the existing literature examines EV charging or PV generation in isolation, leaving the behavioral dynamics of household co-adoption less understood. We develop an integrated, two-part workflow to analyze advanced metering infrastructure (AMI) data. A discovery component applies dynamic time warping (DTW) k-means with DTW barycenter averaging to cluster daily import or export profiles into interpretable behavioral archetypes, while a predictive component trains a bidirectional long short-term memory (BiLSTM) model on 21-day windows and benchmarks it against tabular baselines for PV/EV activity detection. The EV activity labels are inferred from charging-like load signatures because charger measurements are unavailable. Using half-hourly AusNet residential data from Victoria, Australia, the clustering uncovers distinct patterns across PV-only, EV-only, co-adoption, and neither cohorts; for co-adopters, a midday-centered weekday export archetype accounts for approximately 50% of days. At validation-tuned thresholds, both BiLSTM and XGBoost achieve strong discrimination. BiLSTM obtains 0.991 for the area under the receiver operating characteristic curve (AUROC), 0.906 for macro-F1, and the highest recall on the most difficult class (0.836 for EV-only recall). Tree-based baselines remain competitive. Performance remains stable across plausible labeling rules (macro-F1: 0.894--0.914) and strictly forward temporal splits (macro-F1: 0.894--0.906).

0.27

ReCo: When to Relocate Sensor Kits under Deployment Constraints -- A NILM Case Study

cs.LG ·2026-09-28 ·Haokun Chen, Yu Tong, Yehai Chen
similarity 0.62
Abstract · 8 pages, 3 figures, 6 tables

Many sensing tasks obtain training labels only by deploying instruments in the field. With a limited number of sensor kits, a collection deadline, and measurement downtime at every move, the collector must repeatedly decide whether to stay at the current site or relocate. We study this decision in non-intrusive load monitoring (NILM), which estimates the power drawn by individual appliances from a home's main meter and is trained on data from homes temporarily fitted with appliance-level sub-meters. In NILM, appliance usage varies with the appliance, season and climate, and the value of new data depends on how diverse the combinations of target operation and background load are. To address this, we propose a constraint-based relocation framework and instantiate it for NILM as ReCo (Relocation by Coverage gain). ReCo counts new operating regimes in a joint target-background feature space, forecasts each home's future gain from the data collected so far, and each night weighs the gain of staying against the gain of moving elsewhere after the downtime. In replayed deployments on the Plegma dataset under two kit counts and two downtime costs, ReCo outperforms fixed-dwell and count-based schedules and a threshold rule using the same metric in every setting. Its advantage is not explained by collecting more days alone and reflects allocating the days to more valuable homes and periods.

0.18