CS Paper Radar

Energy Measurement and Optimization of TinyML in Resource-Constrained Embedded Systems: A Systematic Mapping Study

Clariele Almeida, Renan Beserra, Rafael Moura, Danilo Araújo, Bruno Nogueira, Sérgio Chevtchenko, Ermeson Andrade

cs.LG cs.ARcs.ET ·submitted 2026-11-05 00:32 UTC · v1
survey

Abstract

The rapid expansion of the Internet of Things (IoT) has increased the volume of data generated at the network edge, where many devices operate under severe memory, processing, and energy constraints. In this context, Tiny Machine Learning (TinyML) enables machine learning (ML) tasks to be executed on microcontrollers, smart sensors, and other resource-constrained platforms. However, the literature remains heterogeneous regarding the algorithms evaluated, energy-measurement methods, reported metrics, influencing factors, and optimization strategies. This study presents a systematic mapping of energy-aware TinyML research. It identifies the main models and learning approaches, classifies energy-evaluation methodologies and metrics, examines the technical factors affecting energy consumption, and organizes the reported optimization techniques into a structured taxonomy. The findings highlight the frequent use of convolutional and lightweight architectures, direct measurements and analytical estimations, and factors related to model architecture, hardware, communication, numerical precision, and input characteristics. The optimization strategies were grouped into model compression, hardware-aware design, system and communication optimization, and data and processing optimization. The results also reveal limited standardization in experimental platforms, measurement procedures, and reporting practices, limiting reproducibility and direct comparison across studies. This mapping provides an updated overview of the field and guidance for developing and evaluating more energy-efficient TinyML solutions.

Comment
40 pages, 10 figures, 8 tables

Closest papers

Nearest neighbours by meaning across the whole index.

Power-Performance Characterization of TinyML Systems

cs.LG cs.AI ·2026-08-21 ·Yujie Zhang, Dhananjaya Wijerathne, Zhaoying Li, Tulika Mitra
publishedhighly cited similarity 0.73
Abstract · 7 pages, 9 figures. Published in Proceedings of the IEEE International Conference on Computer Design (ICCD), 2022

TinyML systems are enabling machine learning (ML) inference at the edge. However, there is little quantitative analysis of such systems. This paper presents a systematic performance and power characterization of diverse TinyML applications on microcontrollers (MCUs), spanning neural network models, software libraries, operating systems, and hardware architectures. We focus on the impact of the multiple layers of abstraction that provide higher programmability at the expense of performance and energy efficiency. We propose a model to estimate the costs of different abstraction layers and make recommendations for minimizing those costs. Our findings can help designers with Neural Architecture Search (NAS) and CNN inference optimization on edge devices.

0.54

Small Language Models for Smart Data Model Classification at the Edge: A Cost-Aware Hybrid Approach

cs.AI ·2026-10-05 ·Cristian Martella, Angelo Martella, Antonella Longo, Motaz Saad
code/datahot direction similarity 0.68
Abstract

The rapid proliferation of heterogeneous data sources within the Internet of Things (IoT) across domains such as smart cities, energy management, and environmental monitoring necessitates efficient and scalable data standardization methods. Effective classification of smart data models (SDMs) is essential for facilitating interoperability. However, existing approaches are often limited by high resource consumption and lack applicability in edge environments with constrained computational capabilities. Aiming to bridge this gap, the proposed study evaluates the performance of lightweight open-source language models (LMs) to resolve an input data entity against its corresponding best fitting SDM representation under resource-constrained conditions. It systematically benchmarks a diverse array of models, including general purpose (GP), reasoning-specialized (RS), and code-specialized (CS) architectures, across multiple domain-specific datasets. Addressing the current omission of lightweight, resource-efficient solutions in the literature, the investigation provides significant and valuable insights into model selection, task formulation, and deployment strategies that optimize accuracy and efficiency. A complementary experiment also compares the surveyed large language models (LLMs) against two near-zero-cost similarity baselines (Term Frequency-Inverse Document Frequency (TF-IDF) and a lightweight sentence encoder) on the same task, providing a strong reference point for interpreting the practical value of LLM-based classification on edge platforms.

0.41

TinyML Hits the Memory Wall: A Benchmark of Ten Sub-Watt Edge Devices

cs.AR ·2026-11-02 ·Pietro Bonazzi, Luigi Capogrosso, Ahmet Celik, Rosanna Manzo, Marco Giordano +3 more
benchmark similarity 0.63
Abstract

Neural network inference at the edge must fit tight energy budgets. Existing benchmarks compare few devices, do not report energy on a common basis, and omit the newest microcontrollers with an NPU or the 1 GHz Cortex-M85. Hardware-aware design also ranks networks by MAC count, yet no study has tested whether this proxy holds across accelerators. We benchmark sub-watt edge AI hardware by evaluating four CNNs (MobileNetV3, MCUNetV1, EfficientNet, SqueezeNet) and two tiny transformers (MobileViT-XXS, DeiT-tiny) on ten commercial devices: an in-sensor DSP (Sony IMX500), four MCUs with an NPU (STM32N6, Alif Ensemble E7/E8, GreenWaves GAP9), and five MCUs without an NPU (STM32U5, Apollo510B, ESP32-S3 Xtensa LX7, RA8M2, STM32V8). Four devices are novel (Alif E8, Apollo510B, RA8M2, STM32V8). Measured as energy above idle, the IMX500 (0.13-0.35 mJ) uses 1.3-3x less energy than the STM32N6 (0.31-1.05 mJ) on every model; the GAP9 uses the least on MobileNetV3 and the Alif E7 the least on MCUNetV1 and SqueezeNet. All four use 6-34x less energy than the STM32V8 (1.85-3.98 mJ), and the Alif E7 and IMX500 form the power-performance Pareto front. Latency on all four accelerators scales with memory traffic (bytes of weights and activations, r >= 0.98) and not with MACs, so they are memory-bound, while no MCU without an NPU is. The NPU advantage grows with intensity from 1.4x over a 1 GHz Cortex-M85 on MCUNetV1 to 8.2x on SqueezeNet. MAC count is therefore a misleading cost proxy for sub-watt accelerators.

0.05

Constrained Bayesian Optimization for Hierarchical Federated Learning in IoT Networks for Plant Disease Classification

cs.LG cs.DC ·2026-09-06 ·Athanasios Papanikolaou, Athanasios Tziouvaras, Apostolos Xenakis, Periklis Chatzimisios, Shameem A. Puthiya Parambath +4 more
published similarity 0.62
Abstract · Accepted for publication at Next Generation Communications (NextGCom) conference

The deployment of Hierarchical Federated Learning (HFL) in resource-constrained Internet of Things (IoT) environments requires careful configuration to balance predictive performance with energy consumption and execution time. This challenge is particularly relevant to smart agriculture, where distributed IoT devices can support automated plant disease classification while operating under limited computational and communication resources. This paper presents a constrained Bayesian Optimization framework for the efficient configuration of HFL deployments. The proposed approach jointly explores the deep learning backbone architecture, aggregation strategy, and number of communication rounds, while the federation size is determined according to the spatial coverage requirements of the agricultural deployment. A weighted objective function captures user-defined trade-offs among energy consumption, execution time, and predictive performance, while explicit constraints ensure compliance with deployment-specific resource and accuracy requirements. The framework is evaluated on an IoT-based plant disease classification task considering multiple deep learning architectures, federated aggregation strategies, and communication-round settings. Experimental results across 30 independent optimization runs show that the proposed approach explores only 11.11% of the search space, while consistently identifying solutions within 1% of the exhaustive-search optimum, with a mean optimality gap of only 0.056%.

0.42

Enabling Efficient Client Selection in FL-as-a-Service for Multi-Application based Society 5.0

cs.NI cs.DC ·2026-09-29 ·Prachi Nandi, Sonakshi Satpathy, Timam Ghosh, Arijit Roy
similarity 0.61
Abstract

The rapid development of the Internet of Things (IoT) has led to the generation of vast amounts of data from sensors, prompting the need for advanced learning models to analyze this data for personalized services. Federated learning (FL) emerges as a solution, offering decentralized learning that preserves user privacy by building models on local devices and sharing only aggregated insights. This paper explores FL-as-a-service (FLaaS) in IoT, highlighting its potential for collaborative learning across applications while addressing challenges like security, privacy, and optimizing hierarchical architectures for efficient model convergence and accuracy. To enhance the effectiveness of FL in IoT environments, this study focuses on selecting optimal nodes for model processing through the evaluation of parameters such as delay, energy consumption, and link status. The proposed method aims to identify suitable client nodes for model training. Performance evaluation is conducted using a Human Activity Recognition dataset under simulated IoT network conditions. The proposed approach is compared against randomized and Q-learning based client selection strategies. Experimental results shows improvements in delay and energy efficiency while maintaining communication performance. The findings highlight the potential of efficient client selection mechanisms for enhancing FLaaS in dynamic IoT ecosystems and supporting future intelligent services in Society 5.0.

0.20

Energy-Efficient Timely Relevant IoT Data Retrieval with Wireless Memory Approximation

cs.NI ·2026-10-21 ·Junya Shiraishi, Zihang Song, Morten Andersen, Petar Popovski
similarity 0.61
Abstract · Submitted for possible publication

Collecting relevant data from Internet of Things devices under freshness and energy constraints is a key challenge in 6G edge networks. A lightweight neural network on the device filters irrelevant observations, but storing it in dynamic random access memory consumes refresh energy during standby. This letter proposes a pull-based framework where an edge server remotely activates and approximates memory and jointly selects the activation timing, refresh period, model size, and transmission threshold. We derive the expected freshness and energy over erasure channels in closed form and show that the scheme consumes less energy than an always-on baseline under the same freshness constraint.

0.27

A Real-Time Tsetlin Machine-based Non-intrusive Load Monitoring System on MCUs

cs.LG ·2026-08-19 ·Han Wu, Tianhang Tan, Shengyu Duan, Alex Yakovlev, Rishad Shafik +1 more
published similarity 0.61
Abstract · Accepted by International Symposium on the Tsetlin Machine (ISTM 2026)

Non-Intrusive Load Monitoring (NILM) systems estimate individual appliance energy consumption from a single aggregate meter, without requiring separate sensors for each device. By installing a single meter that measures a building's total electricity consumption, NILM algorithms can determine the active status of each appliance. However, traditional NILM systems use computationally intensive optimization algorithms to process offline data, limiting their capability for on-device deployment, where sensitive household data must be processed locally. This paper proposes a Tsetlin Machine (TM)-based NILM framework, targeting real-time applications on resource-constrained microcontrollers (MCUs), enabling privacy-preserving edge deployment. The problem is reformulated as a classification task, and the proposed approach achieves an average precision of 90% and recall of 96% for two-appliance classification, and 77% precision and 80% recall for four appliances on the REDD dataset. The trained model occupies only 17 KB of flash memory and achieves an inference latency of 0.43 ms on an ESP32, demonstrating its suitability for NILM applications on MCUs.

0.33

Closing the Semantic-Edge Gap: Tiny Language Models for 6G Wireless Intelligence

eess.SP ·2026-09-03 ·Srikanth Kamath, Arnav Mathur, Joslyn Sajan George, Rahul Jashvantbhai Pandya
survey similarity 0.61
Abstract · 40 pages, 10 figures

Sixth-generation (6G) wireless networks are envisioned as AI-native systems in which semantic communication - transmitting task-relevant meaning rather than raw bits - moves beyond Shannon's classical bit-pipe model. Large language models (LLMs) dominate semantic encoding but are unsuitable for 6G user equipment and IoT devices, given prohibitive memory, energy, and latency costs. Tiny language models (TinyLMs) - compressed via TinyML techniques into kilobyte-to-megabyte memory and milliwatt power budgets - are the missing bridge between LLM-level semantic encoding and 6G edge hardware, yet no prior work systematically maps TinyML techniques onto semantic communication architectures for this purpose. This survey closes that gap through a two-axis taxonomy connecting six compression families (quantization, pruning, knowledge distillation, low-rank adaptation, neural architecture search, hybrid pipelines) to five semantic communication architectures (end-to-end joint source-channel coding, split learning, federated learning, knowledge-graph-assisted, and multi-task/cross-modal communication), synthesized with a quantitative meta-analysis of the model-size-versus-semantic-fidelity Pareto frontier. Representative results include a CNN-Transformer encoder achieving 22 dB PSNR at 33.33% semantic-representation size reduction; a symbolic protocol machine reducing a neural MAC protocol from 4.55 MB to 1 KB (99.98% smaller) with zero performance loss; federated bidirectional knowledge distillation converging under joint model-and-data heterogeneity where FedAvg-style averaging underperforms; and knowledge-graph-assisted probability graphs cutting transmission energy by 65%. The survey identifies nine open research challenges for TinyLM-enabled 6G semantic communication, including two not previously articulated in the literature.

0.35