CS Paper Radar

ECO-COMM: An Ultra Low-Latency Event Camera based Optical Communication System

Chengling Xu, Keigo Hirakawa, Feng Ye

cs.NI ·submitted 2026-08-25 15:24 UTC · v1
published

Abstract

Ultralow-latency communication is critical for emerging next-generation applications such as XR, real-time control, and distributed sensing. We present ECO-COMM, an event-camera-based optical communication system for ultra-low-latency device association and lightweight information exchange. By exploiting the asynchronous sensing and microsecond-level temporal resolution of event cameras, ECO-COMM captures high-frequency optical signals without frame-based acquisition delays. We identify and analyze key hardware-induced challenges in event-camera communication, including timestamp inconsistency, readout contention, trailing effects, and the inevitable refractory period, and develop hardware-aware mitigation techniques to address them. Focusing on a single transmitter-receiver optical link, ECO-COMM establishes the feasibility of practical ultra-low-latency event-camera communication using commercially available hardware.A prototype implementation using an eight-LED transmitter and an off-the-shelf event camera achieves device association within 15 microseconds, symbol latency as low as 100 microseconds, and end-to-end latency below 8 milliseconds for 32-byte payloads at 0.1% bit error rate. ECO-COMM establishes a practical and complementary communication paradigm for ultra-low-latency systems where responsiveness and temporal precision are paramount.

Comment
Conditionally accepted to appear ACM MobiHoc 2026

Closest papers

Nearest neighbours by meaning across the whole index.

ECO-ID: Event-Camera based Optical System for Secure Multi-User Ultra-Low Latency Identification

eess.SP cs.CRcs.ITcs.NI+1 ·2026-08-17 ·Subham Sabud, Chengling Xu, Feng Ye
similarity 0.70
Abstract · 6 pages, 5 figures, and 2 tables. Submitted to IEEE globecom

Time-critical interactive systems increasingly require ultra-low-latency device identification for multiple users, yet prevailing approaches such as passwords, QR codes, and RFID/NFC are constrained by human input, frame-based sensing, or near-contact range. This paper presents ECO-ID, an event-camera-based optical system for multi-user, ultra-low-latency identification over visible light communication (VLC). Leveraging microsecond-resolution, asynchronous observations of brightness transitions, ECO-ID employs a spatiotemporal coding design: disjoint LED subsets provide spatial separation among users, while user-specific timing delays encode identities without inter-user synchronization. The optical channel and event-driven sensing reduce full-scene capture relative to frame cameras and limit the RF attack surface, while enabling rapid token verification with freshness and replay protection. We implement a prototype and demonstrate that ECO-ID can practically achieve approximately 99.8\% localization and 98.7\% identification with 0.64 ms mean latency, while theoretically supporting identification at the scale of tens of concurrent users. Overall, ECO-ID provides a fast, privacy-conscious, and security-aware alternative for scalable multi-user identification in time-critical interactive environments.

0.29

Asynchronous Tracking, Optical Communication and 3D Motion Capture using Event-based Sensors

cs.RO cs.CV ·2026-10-03 ·Ziwei Wang, Angus Apps, Holly Battisson, Iain Guilliard, Timothy Molloy +1 more
similarity 0.68
Abstract · 16 pages, 17 figures

Inter-robot communication is a key enabling technology in cooperative robotics applications. While wireless communication is ubiquitous, simple, and effective, it has inherent limitations: the receiving robot cannot easily localise the source of an incoming signal, clock synchronisation is challenging, and signals are broadcast to all nearby devices rather than targeted recipients. Optical communication provides a complementary channel that is inherently directional and spatially localised, directly addressing these limitations. Event cameras are bio-inspired dynamic vision sensors that respond to changes in image intensity with high temporal resolution, high dynamic range, and low latency, making them well-suited as receivers for high-rate optical communication in cooperative robotic systems. In this paper, we propose the Asynchronous Tracking and Optical Communication (ATOC) system, which integrates LED smart-beacon modulation, event-based detection, optical tracking, and event-data demodulation in a single pipeline. By simultaneously tracking and demodulating multiple LED smart beacons, ATOC transforms a conventional visual marker into a robust communication channel suitable for a wide range of high-impact robotics applications. We validate ATOC in a suite of laboratory studies and two 'applications': a smart-city demonstration and a 3D motion-capture system.

0.19

Ternary Visible Light Communication Using Event-Based Vision Sensors

eess.IV eess.SP ·2026-09-29 ·Sotaro Kuremoto, Junya Hara, Hiroshi Higashi, Yuichi Tanaka
similarity 0.65
Abstract · Submitted to ICASSP 2027. 5 pages, 5 figures, 1 table

This paper proposes a ternary visible light communication method using an event-based vision sensor (EVS) and a liquid crystal display (LCD). The throughput of optical camera communication (OCC) is limited by the frame rates of conventional frame-based cameras, and EVSs are expected to overcome this limitation because their pixels asynchronously trigger events with polarity in response to brightness changes, with a temporal resolution on the order of microseconds. However, existing event-based OCC relies on binary signaling that uses only the presence or absence of events and leaves the polarity unused. The proposed method maps the three brightness transitions (increase, decrease, and no change) to ternary symbols, thereby increasing the information carried per symbol. At the transmitter, the LCD displays a marker in which the transmitted data are encoded; at the receiver, the EVS captures the marker and records the brightness changes as events with positive and negative polarities. To suppress errors caused by the timing mismatch between display updates at the transmitter and demodulation at the receiver, we also propose a demodulation algorithm based on frame-transition detection. Experimental results demonstrate that the proposed method achieves a throughput of 336.5 kbps, approximately 150% higher than that of its binary counterpart.

0.28

Neuromorphic Camera for Multi-Target Pointing Acquisition and Tracking in Free Space Optical Communication

eess.IV physics.optics ·2026-11-03 ·Francesco Nardo, Nigitha Selvaraj, Klaus Schertler, Peter Krötz, Ricardo Barrios +2 more
published similarity 0.63
Abstract · 16 pages, 11 figures, 3 tables including 3 appendices. This paper has been accepted for invited presentation at SPIE Sensors + Imaging 2026,…

Pointing, Acquisition, and Tracking (PAT) in Free-Space Optical Communication (FSOC) applications must achieve both low jitter and a large Field of View (FoV) to support beacon acquisition and multi-target tracking. While conventional frame-based sensors provide the necessary angular coverage, their performance is limited by latency, available frame-rate, and motion blur. This work explores and demonstrates the application of an event-based vision sensor for PAT tasks in FSOC. The system employs a neuromorphic sensor that asynchronously records brightness changes (events) with microsecond-level temporal resolution. The main contribution of this paper is a comparative analysis of event-based tracking algorithms for the simultaneous acquisition and tracking of multiple optical beacons that operate directly on this asynchronous stream. The performance of these strategies is validated on an experimental dataset representing realistic operational conditions for dynamic High-Altitude Platform (HAP) and Unmanned Aerial Vehicle (UAV) networks. The analysis compares key metrics, such as tracking accuracy and processing latency, under various signal-to-background conditions.

0.38

EventHOI: Event-Driven Resource-Efficient Hand-Object Interaction Logging on Smartglasses

cs.DC cs.CVcs.HC ·2026-11-06 ·Le Zhang, Kailai Cui, Hao Chen, Vlad Roznyatovskiy, Jianzhong Zhang +3 more
benchmark similarity 0.55
Abstract · 15 pages, 21 figures, 3 tables

Hand-object interactions (HOIs) can be captured by smartglasses to learn how people manipulate objects in daily life. Automatic logging of these interactions from an egocentric perspective provides time-stamped evidence of daily actions for applications like memory assistance. However, continuous RGB capture and wireless transmission exceed the energy and bandwidth budgets of smartglasses. We present EventHOI, an event-driven sensing and compression system that couples selective RGB capture with HOI-aware encoding to enable egocentric logging over Bluetooth Low Energy (BLE) while preserving downstream HOI logging performance. Our key insight is to use low-power event sensing both to determine when RGB capture is needed and to identify where visual detail must be preserved. A lightweight IMU-based egomotion cancellation pipeline suppresses egomotion-induced events so that residual HOI motion can guide RGB triggering and spatial compression. We build a smartglasses prototype and conduct an end-to-end evaluation of EventHOI on a 50-hour egocentric benchmark with 97 subjects and a 20-hour real-world dataset we collect from 10 participants, together covering a broad range of daily-life scenarios and environments. Compared to RGB-only baselines, EventHOI reduces always-on backend power consumption by 5.8-10.4x and uplink bandwidth by 2.9x, with minimal HOI recognition accuracy loss. The resulting RGB uplink of less than 130 kbps fits within commodity BLE bandwidth budgets, making stable BLE video streaming feasible for egocentric HOI logging. Demo video and project website: https://eventhoi.github.io

0.35

Bend the Clock: Predicting Ahead to Beat Latency in Event-Based Object Detection

cs.RO cs.CV ·2026-09-22 ·Biswadeep Sen, Benoit R. Cottereau, Nicolas Cuperlier, Terence Sim
similarity 0.55
Abstract

Event cameras promise low-latency perception for high-speed robotic systems, where even short delays can render detections stale by the time they inform downstream robotic decisions. Yet modern event detectors still require tens of milliseconds of computation before their predictions become available. Conventional evaluation ignores this delay by comparing predictions with annotations at the observation timestamp, even though the scene may have changed by the time those predictions are produced. We study this observation-availability mismatch in event-based multi-object detection and show that state-of-the-art event detectors degrade substantially when evaluated at prediction availability rather than observation time. To address this, we introduce ChronoFuse, a causal availability-time detector that predicts object states for when its output becomes available rather than for when its input was observed. ChronoFuse performs causal cross-time fusion over a multi-scale feature hierarchy, combining current representations with cached temporal features to expose short-term temporal cues without using future observations. The fusion pathway is lightweight, adding only 0.17 million parameters and 0.84 ms of mean end-to-end latency overhead. ChronoFuse recovers 71% of the accuracy lost to latency on 1Mpx driving data and 90.8% under rapid drone motion on FRED, nearly restoring zero-delay performance. Under the extreme motion of EV-Flying, ChronoFuse reaches 20.95 sAP, compared with 2.25 for the strongest standard event detector (9.3x gain). These results show that predicting ahead can be critical for robots operating in fast-changing scenes, including autonomous driving, agile flight, and robotic interception.

0.20

A Time-Encoded Analog Photonic Interposer for Energy-EfficientIntegration of Analog Vision Sensors and Analog Accelerators

cs.AR ·2026-09-02 ·Subhradip Chakraborty, Zihan Yin, Xuming Chen, Chengwei Zhou, Gourav Datta +1 more
similarity 0.55
Abstract

This work introduces a time-encoded analog photonic interposer that enables long-distance, high-fidelity transport of analog signals between spatially separated chiplets. Unlike prior silicon-photonic links limited to digital data, the interposer preserves analog information by converting amplitudes into timing intervals using an analog-to-time converter (ATC), transmitting them over a wavelength-division-multiplexed photonic link, and reconstructing values at the receiver without an explicit high-precision ADC/DAC data-converter pipeline. The link instead embeds an implicit 6-bit time-domain quantization and uses a single wavelength per processing element independent of bit precision. Evaluated in a fully analog vision pipeline with an in-pixel computing (IPC) sensor, it achieves a 2.04x energy--delay product (EDP) improvement over an 8-bit digital electrical baseline on the 560x560 Visual Wake Words dataset, with the advantage widening with link length even against a precision-matched 6-bit baseline. The pipeline holds 89.87% and 86.15% accuracy on ResNet18 and MobileNetV2 for VWW and generalizes across CIFAR-10 and ModelNet40 within 2% of the digital baseline.

0.26

When Reconstruction Helps Event-Camera Person Triggers

cs.CV ·2026-11-10 ·Yifan Shuai
similarity 0.55
Abstract · 10 pages, 3 figures, ancillary score tables and recomputation script

Event cameras record asynchronous changes in brightness. To use a general visual model as a recording trigger, a system must represent these measurements in a form the model can interpret. We compare direct grayscale accumulation, two temporal encodings, and two intensity reconstructors on paired real event data. On 192 windows from four held-out DSEC recordings, thresholds calibrated only on development data yielded 40 of 52 person detections and 12 of 140 background positives with E2VID. The strongest direct temporal encoding at an admissible fixed cutoff yielded 14 detections and seven background positives. A retrospective comparison at a common 10% background-positive cap yielded 40 detections for E2VID and at most 19 for any direct encoding. FireNet+ had lower preparation cost and produced 21 detections with zero observed background positives at its frozen cutoff. On the same 192 windows, Qwen3-VL-4B yielded 33/52, 2/140 with E2VID and 9/52, 9/140 with the highest-recall direct rendering, the three-bin image (person detections, background positives). A 96-second exploratory replay illustrates the sensitivity of episode capture and recording starts to cutoff selection. The experiments identify a detection benefit from reconstruction under controlled input history and distinguish it from the cost and false starts of continuous triggering.

0.32