CS Paper Radar

Memento: Communicating Sensor Observations Through Shared Memory

Chae Young Lee, Lan Mei, Yifan Yang, Sara Achour, Zerina Kapetanovic

cs.NI ·submitted 2026-10-13 21:44 UTC · v1

Abstract

Wireless sensing systems often transmit highly redundant observations, making communication a bottleneck for low-power devices. We present Memento, a communication system that exploits recurring content by transmitting observations by reference. The sender embeds each observation and searches a shared vector table stored in persistent memory. When it finds a sufficiently similar prior observation, it sends a compact reference; otherwise, it sends the observation itself and adds it to the table. This design shifts work from wireless communication to local computation and storage, without requiring a fixed task-specific model. We implement Memento on a microcontroller with an SD card and evaluate it on three image datasets and one radar dataset. Memento provides favorable accuracy-communication and accuracy-energy tradeoffs against compression-based and task-oriented baselines. At high-accuracy operating points, it matches cloud classification accuracy on three workloads while using 5.5 to 27.1 times less energy, and comes within 0.14 percentage points on a fourth while using 14.7 times less energy. These results show that retrieval over persistent local memory can reduce communication costs in recurrent sensing workloads.

Closest papers

Nearest neighbours by meaning across the whole index.

"Is Low Power Enough?" Rethinking Energy Efficiency in High-Fidelity Sensing

cs.AR ·2026-10-10 ·Chae Young Lee, Lan Mei, Jesse Fonseca, Zerina Kapetanovic
position similarity 0.64
Abstract

For two decades, long-lived sensor nodes have been built from the lowest-power parts, because their scalar readings take only milliseconds to acquire and send. Scientists now want higher fidelity data from the field, such as images and audio, and these observations break that rule: a low-power microcontroller stays awake for seconds to read, store, and transmit each one, so low power is no longer low energy. We argue that long-lived, high-fidelity nodes should instead be built around a more capable microcontroller, provided the whole board sleeps deeply. We revisit two principles from early sensor networks, "race to sleep" and "talk less", for high-fidelity data and on-device AI, and test them by comparing the STM32N6, which pairs a fast core with a neural accelerator, against the low-power Apollo4 Plus. Although the STM32N6 draws 1.9x more power, it completes an observation (capture, storage, on-board detection, and a LoRa transmission) 9.9x faster and so uses 5.2x less energy. On the same model, it runs inference with 3.2-11.4x less energy, and it fits models over 23 points more accurate. A high-fidelity node lives longest when it finishes quickly, sleeps deeply, and sends only what matters.

0.25

PulseInfer: I/O-Centric Sparse KV Cache Offloading for Efficient Long-Context LLM Decoding

cs.LG ·2026-09-28 ·Qiuyang Zhang, Kai Zhou, Kai Lu, Haocheng Lu, Jian Zhou +4 more
similarity 0.61
Abstract

Long-context LLM serving is increasingly bottlenecked by decode, where large KV caches limit batch size and underutilize GPUs. Sparse KV cache offloading expands effective capacity by storing most historical KV blocks in CPU DRAM and recalling only selected blocks on demand. However, we find that existing offloading systems shift the bottleneck to CPU-GPU recall I/O: recall volume varies widely across layers, decode steps and requests, while headwise sparse selection fragments recalls into many small PCIe transfers. This paper presents PulseInfer, an I/O-centric sparse KV cache offloading system. PulseInfer hides variable recall latency with interruptible layer-wise scheduling, adapts offloading decisions with IO-Adaptive Offloading Admission, and coalesces fragmented transfers using SoloHead sparse selection and a gather-scatter I/O engine. Implemented on SGLang, PulseInfer improves decode throughput by up to 4.7x over SGLang and 2.6x over the best existing offloading baseline, while reducing TPOT by up to 76% and preserving near-lossless accuracy.

0.17

MemLLM: End-to-end In-Storage Acceleration of On-device Retrieval-Augmented Generation using Precomputed KV Caches

cs.AR ·2026-10-15 ·Seungkwan Kang, Hyungseok Ko, Heemin Kim, Myoungsoo Jung
top venue similarity 0.60
Abstract · To be published in IEEE/ACM MICRO 2026

Retrieval-augmented generation (RAG) on edge devices enables personalized large language model (LLM) inference while preserving privacy. However, RAG's inherent length asymmetry makes the prefill phase the dominant bottleneck. While precomputing the KV caches offline alleviates the prefill cost on server systems, the multi-gigabyte caches over the narrow interconnect create a severe I/O wall for on-device systems. To mitigate this, we propose MemLLM, an end-to-end in-storage processing (ISP) architecture that executes the complete attention pipeline based on precomputed KV caches within the SSD. MemLLM utilizes per-channel accelerators to fully utilize the aggregated NAND channel bandwidth and accelerates all KV cache-related computations on the storage-side to minimize PCIe transfers. To efficiently handle the sparse updates required by RAG, MemLLM introduces a fused recomputation-query kernel paired with a hardware-based filter logic to halve the NAND read volume and eliminate write-back penalties. Furthermore, MemLLM's global SRAM-based stateful reduction engine enables a completely DRAM-less dataflow, thereby removing the internal memory bottlenecks and bounding the PCIe egress to an $O(1)$ footprint. A full-stack software stack allows asynchronous, zero-copy transfers from the ISP to the host and provides transparent execution within modern ML frameworks. Evaluated across eight real-world RAG datasets and six on-device LLM models, MemLLM achieves an average end-to-end speedup of 4.06$\times$ over the GPU baseline.

0.36

Parameter Efficient Continual Learning for Sparse Event-Based Transformers

cs.CV ·2026-08-27 ·Vaishnavi Nagabhushana, Kartikay Agrawal, Ayon Borthakur
similarity 0.60
Abstract

Robotic and edge intelligence systems operate in dynamic environments where data arrives continuously, requiring models to adapt while preserving previously learned knowledge under strict memory and energy constraints. While parameter-efficient fine-tuning has shown promise for continual learning with vision transformers, conventional architectures rely on dense computation and remain costly for real-world deployment. Sparse event-based vision transformers provide energy-efficient event-driven computation, yet their continual learning capabilities remain largely unexplored. We here introduce sLoTh, a parameter-efficient continual learning framework for pretrained sparse event-based (spiking) vision transformers. sLoTh freezes the backbone and restricts plasticity to scalable-efficient low-rank attention updates (seLoRA) and shared neuronal threshold modulation, enabling adaptation without replay buffers by updating less than 1% of model parameters. Experiments across CIFAR-100, Tiny-ImageNet, ImageNet-100, and ImageNet-R with up to 100 tasks demonstrate competitive rehearsal-free performance in class-incremental learning and online continual learning, while enabling approximately 6.5x lower energy consumption than conventional dense vision transformers.

0.19

UniCache: Task- and Type-Aware KV Cache Compression for Unified Multimodal Models

cs.LG ·2026-09-26 ·Wanqi Yang, Yuexiao Ma, Mei Xie, Xiawu Zheng, Shiwei Liu
similarity 0.59
Abstract

Unified multimodal models combine understanding, generation, and editing within a single network, offering a promising foundation for versatile multimodal applications. However, growing multimodal contexts make KV cache storage and access increasingly costly. Existing KV cache compression methods are typically tailored to specific tasks and single-modality caches, while overlooking changes in cache importance across tasks and timesteps. However, in unified multimodal models, each task involves multiple KV cache types, and both their composition and dynamics differ across tasks. As a result, a single compression policy overlooks task- and type-specific requirements, leading to the loss of critical information and degraded quality across tasks. Based on these findings, we propose UniCache, a training-free framework for task- and type-aware KV cache compression. UniCache identifies the cache segments activated by each task and assigns suitable compression policies through offline calibration. It coordinates their parallel execution under a shared storage budget through attention-guided allocation and task-aware temporal scheduling. Experiments show that UniCache achieves $5\times$ KV cache compression for understanding and editing and $2.5\times$ for generation with negligible quality loss, while increasing throughput by up to $1.78\times$ in long-context settings, significantly improving the practicality of scaling unified multimodal models to longer context.

0.43

LeanStream: A Speculate-and-Refine Streaming Framework for Efficient on-Device LLM Inference

cs.LG ·2026-09-02 ·Renyuan Liu, Yuyang Leng, Kaiyan Liu, Yuzhou Zhong, Shaohan Hu +5 more
top venuecode/data similarity 0.59
Abstract · 6 pages, 13 figures. Accepted at ACM MobiCom 2026. Code available at https://github.com/RenyuanLIU/LeanStream

On-device LLM inference is attractive for privacy and responsiveness, but remains challenging on mobile and embedded devices because model weights far exceed available DRAM. Prior systems exploit activation sparsity and offload weights to SSD or flash storage, but face a fundamental systems trade-off: accurate sparse execution decisions require the latest context, whereas efficient computation-I/O overlap requires early prediction. As a result, existing designs either serialize execution or incur redundant weight fetches, extra computation, and large cache overheads. We present LeanStream, a streaming speculate-and-refine framework for efficient on-device LLM inference. LeanStream progressively refines computation, loading, and cache-retention priorities using partial GPU results, enabling fine-grained overlap between GPU execution and storage I/O. We implement LeanStream on both mobile and embedded platforms. Compared with prior on-device LLM inference systems, LeanStream reduces memory usage by 4.8$\times$ to 7.5$\times$ at the best throughput achieved by prior work, while further improving token generation throughput by 1.6$\times$ to 2.1$\times$. Source code is available at https://github.com/RenyuanLIU/LeanStream.

0.52

Industrial ReMEmbR: Scaling Spatiotemporal Memory to Robot Fleets

cs.RO cs.AIcs.SE ·2026-10-20 ·Jad Yammine, Malek Wahidi, Abrar Anwar, Yan Chang, Mihir Acharya +1 more
similarity 0.59
Abstract

Warehouse robot fleets continuously observe operational conditions, but preserving these observations as reusable semantic memory incurs substantial computation, communication, and storage costs. For example, explaining recurring aisle blockages can require reviewing video from multiple robots across several shifts. We present IndustrialRemembr, a shared spatiotemporal memory system that extends NVIDIA ReMEmbR to robot fleets and reduces server-side computation by generating scene descriptions only on demand. On each robot, an NVIDIA Jetson encodes video clips into retrieval embeddings with Cosmos-Embed1, vision tokens with Cosmos3-Edge, and reconstruction latents with the Wan2.2 VAE, without uploading raw camera frames. The encoding models are re-used to detect people in image patches, zeroing them out to support PII abstraction for GDPR-compliant deployments. We split Cosmos3-Edge at its vision-language boundary, placing the vision encoder on the robot and the language decoder on an on-premises server. A Nemotron agent retrieves memories by content, position, and time and queries the decoder using cached vision tokens. This design eliminates caption generation at write time, while cached-token decoding reproduces the unsplit model's output in all 450 tested decodes.

0.39

Energy-Efficient Timely Relevant IoT Data Retrieval with Wireless Memory Approximation

cs.NI ·2026-10-21 ·Junya Shiraishi, Zihang Song, Morten Andersen, Petar Popovski
similarity 0.58
Abstract · Submitted for possible publication

Collecting relevant data from Internet of Things devices under freshness and energy constraints is a key challenge in 6G edge networks. A lightweight neural network on the device filters irrelevant observations, but storing it in dynamic random access memory consumes refresh energy during standby. This letter proposes a pull-based framework where an edge server remotely activates and approximates memory and jointly selects the activation timing, refresh period, model size, and transmission threshold. We derive the expected freshness and energy over erasure channels in closed form and show that the scheme consumes less energy than an always-on baseline under the same freshness constraint.

0.27