CS Paper Radar

Semantic Edge-Cloud Communication for Real-Time Urban Traffic Digital Twins

Murat Arda Onsu, Arman Dogru, Poonam Lohan, Burak Kantarci, Aisha Syed

cs.NI cs.CVcs.DCeess.SP ·submitted 2026-10-09 18:02 UTC · v1
published

Abstract

Urban traffic systems are becoming increasingly complex, demanding real-time traffic perception, proactive collision prediction, and intelligent management to improve safety and reduce congestion. Although AI-driven traffic management has shown strong promise, its success relies on diverse, high-quality data spanning critical scenarios such as collisions, near-collisions, and traffic rule violations. Digital twins offer a powerful solution by enabling synchronized virtual replicas of physical traffic environments for real-time monitoring, collision prediction, traffic-flow optimization, and diverse realistic scenario generation. However, continuously synchronizing a high-fidelity urban traffic digital twin through edge surveillance cameras requires substantial edge-cloud communication, and transmitting raw video streams leads to severe bandwidth and latency constraints. To overcome this challenge, this paper proposes a semantic communication-based edge-cloud framework for real-time urban traffic digital twin applications. By leveraging edge intelligence to extract and transmit only task-relevant semantic traffic information instead of full video feeds, the proposed framework significantly reduces communication overhead while preserving the essential dynamics needed for accurate real-time digital twin reconstruction. Experimental results demonstrate more than 99% transmission savings and an average trajectory reconstruction error of only 0.12 m, confirming the proposed framework as an effective, scalable, and low-latency solution for AI-enabled urban traffic digital twin applications.

Comment
6 pages, 4 figures, accepted to IEEE Global Communications (Globecom) Conference, 2026

Closest papers

Nearest neighbours by meaning across the whole index.

VISTA: A Framework for Vision-Informed Semantic Traffic Awareness

cs.CV cs.LGcs.NI ·2026-11-16 ·Murat Arda Onsu, Poonam Lohan, Burak Kantarci, Aisha Syed, Matthew Andrews +1 more
published similarity 0.67
Abstract · 8 pages, 4 figures, Accepted for publication in IEEE Internet of Things Magazine, 2026

The Internet of Things (IoT) is transforming intelligent transportation systems by connecting roadside cameras, edge computing units, vehicles, and traffic infrastructure into a shared sensing and decision-making ecosystem. However, transmitting raw traffic video over vehicle-to-everything (V2X) links is bandwidth-intensive, while deploying large multimodal models directly on resource-constrained vehicles is often impractical. To address these limitations, this article proposes VISTA (Vision-Informed Semantic Traffic Awareness), a multimodal vision-language edge-intelligence framework that combines predictive video representation learning with lightweight language-based reasoning to provide communication-efficient traffic situational awareness. In the proposed architecture, roadside surveillance units employ the Video Joint Embedding Predictive Architecture (V-JEPA) and an attentive-pooler module to convert traffic video clips into compact future-scene embeddings. These embeddings are transmitted through V2X links to vehicle-mounted systems, where a TinyLlama small language model, enhanced with a custom visual adapter, interprets the embeddings alongside natural-language (NL) traffic queries. VISTA enables vehicles to obtain interpretable traffic information, reason about upcoming scene dynamics, and identify potential collision risks without receiving raw video streams. Experimental results in a digital-twin urban traffic environment show that VISTA achieves 97.77% accuracy and an 89% F1 score for future collision prediction while reducing the communication payload by several orders of magnitude compared with raw RGB video transmission. These results demonstrate the feasibility of embedding-based multimodal intelligence for low-latency, communication-efficient, and safety-oriented IoT-enabled transportation systems.

0.31

Risk-Adaptive Edge--Cloud Visual Reasoning for Communication-Efficient Autonomous Driving

cs.CV ·2026-08-15 ·Meng Ma, Shuyang Li, Naigang Wang, Ruimin Ke
similarity 0.63
Abstract · 7 pages, 4 figures, 5 tables

Cloud-hosted vision-language models (VLMs) offer greater contextual reasoning capabilities than smaller onboard models, but frequent visual uploads increase communication overhead and add network and inference latency to tactical decisions. We present a risk-adaptive edge-cloud architecture in which onboard traffic assessment determines when cloud reasoning is requested. An onboard VLM and a lightweight detector capture temporal traffic conditions and path-relative hazards for conservative local response and selective cloud access. The cloud model provides tactical advice, while validation, vehicle control, and automatic emergency braking remain local. In CARLA experiments, our method matched the task success rate of periodic cloud access while reducing cloud requests by 54.1% and recording fewer automatic emergency braking (AEB) activations. In a delayed-roadwork ablation, semantic events triggered requests before the next scheduled audit. Across three emulated network profiles, the method continued to reduce cloud traffic, although lane changes took longer than with periodic access. Onboard traffic assessment therefore served as a practical trigger for selective VLM inference in these experiments.

0.07

TrafficFab: An Autonomic Edge-Cloud Testbed Fabric forAI-Driven Traffic Management

cs.DC ·2026-09-24 ·Mayank Arya, Pranjal Naman, Priyanshu Pansari, Roopkatha Banerjee, Daksh Mehta +3 more
similarity 0.63
Abstract

Traffic management in emerging megacities requires real-time analytics over thousands of CCTV video streams under latency, bandwidth, compute and energy constraints. We present TrafficFab, an autonomic edge--cloud testbed for AI-driven traffic management, designed to validate a representative slice of a megacity deployment. TrafficFab combines RTSP stream emulation, heterogeneous edge inference using DNNs, cloud-based nowcasting and forecasting using Spatio-Temporal Graph Neural Network (ST-GNN), and continual model adaptation through foundation-model (FM)-assisted Federated Learning (FL). Its autonomic control enables fine-grained scale-out/in of edge inference through energy- and migration-aware scheduling, elastic scale-up/down of GNN forecasting on public clouds, and periodic adaptation of the DNN on edge accelerators and private cloud, without centralized video collection. We evaluate TrafficFab on a Bangalore-city inspired deployment, spanning Raspberry Pis, Jetson accelerators, GPU fogs, private cloud servers, and cloud VMs, sustaining real-time analytics for $\approx 400$ live camera streams (10% of Bangalore) and analytically characterize larger setups. The results demonstrate that TrafficFab offers a practical validation-scale platform for closed-loop traffic analytics, short-term operational decision support, and longer-horizon planning analyses in megacity scales.

0.16

How Roadside Units Enhance Intersection Safety? Cooperative Autonomous Driving System Design and A Proof of Concept

eess.SY ·2026-08-10 ·Taoyuan Yu, Kui Wang, Zongdian Li, Tao Yu, Walid Saad +1 more
similarity 0.60
Abstract

Intersections remain one of the most hazardous locations in urban road networks, where heterogeneous traffic participants and limited visibility frequently lead to severe traffic conflicts. In this paper, a vehicle-to-infrastructure-to-vehicle (V2I2V) cooperative system is proposed for improving road safety and traffic efficiency by using digital twins (DTs) deployed on roadside units (RSUs) to eliminate blind spots and centrally coordinate connected and automated vehicles (CAVs) in smart intersections. The proposed system integrates cloud-based global DTs for macroscopic guidance and RSU-based local DTs for real-time operations. Within this architecture, a hierarchical reinforcement learning (HRL) framework combines offline pre-training with online fine-tuning to achieve robust cooperative control. Experimental results show that the proposed system achieves substantial improvements in safety and efficiency in simulation experiments and real-world proof-of-concept (PoC) trials. In simulations, our system ensures high safety, efficiency, and smoothness under realistic communications and traffic constraints. In PoC trials, the RSU-centric control loop achieves a decision-making latency of approximately 42 ms and maintains a safe stopping distance of 8.5 m for pedestrians, while also shortening stop duration and overall traversal time. These results indicate that the proposed system provides robust and scalable performance at smart intersections.

0.04

VLALight: A Vision-Language-Action Model for Traffic Signal Control

cs.AI ·2026-09-29 ·Pan Zhang, Siqi Lai, Kemu Dong, Hao Liu
code/data similarity 0.60
Abstract

Traffic signal control (TSC) is essential for improving urban mobility and reducing congestion. Although roadside cameras are widely deployed at signalized intersections and provide rich visual observations of evolving traffic, existing TSC methods typically rely on manually engineered traffic states or separate perception modules, creating a gap between physical observations and control decisions. We present VLALight, the first vision-language-action (VLA) model for end-to-end traffic signal control from multi-view roadside videos. VLALight directly maps visual observations to coordinated signal actions through multi-target spatiotemporal traffic reasoning and topology-aware cooperative perception across intersections. To establish this capability, we develop a two-stage supervised cold-start training strategy for visual traffic understanding and signal decision-making, followed by cooperative agentic reinforcement learning that jointly optimizes local control and network-wide traffic efficiency. Furthermore, VLALight introduces adaptive fast and slow reasoning modes, enabling the policy to allocate deeper reasoning only when additional deliberation provides sufficient control benefits. Through balanced mode-aware rollouts and relative advantage optimization, VLALight learns to trade off decision quality and inference cost. Extensive experiments on seven real-world traffic-flow datasets across three urban networks demonstrate that VLALight consistently outperforms transportation-based, RL-based, and LLM/VLM-based baselines. Ablation studies validate the effectiveness of cooperative perception, network-level optimization, and adaptive reasoning. These results demonstrate the potential of VLA models for real-world physical traffic control. Our project is available at https://github.com/usail-hkust/VLALight.git.

0.23

Semantic Extraction Framework for Goal-Oriented V2X Communication Supporting Safe Intersection Passage

eess.IV cs.CV ·2026-11-06 ·Haoran Yang, Shan Lu, Takaya Yamazato
hot direction similarity 0.60
Abstract · Accept by 2026 Asia-Pacific Conference on Communications

This paper proposes a transmitter-side semantic extraction framework for goal-oriented Vehicle-to-Everything (V2X) communication supporting safe intersection passage. Instead of transmitting raw sensory data, roadside infrastructure extracts task-relevant semantic information from video and traffic-signal sequences and organizes them into compact semantic packets for low-latency driving-decision assistance. The intersection-passing problem is formulated as a set of traffic tasks under Japanese traffic regulations, and the proposed pipeline generates perception and intent semantics through object detection, object tracking, region-of-interest (ROI)-based semantic extraction, and recommended-action generation. The framework is implemented and evaluated on a self-constructed, CARLA-based single-vehicle dataset collected under clear weather conditions. Experimental results show high recommended-action accuracy within the tested task set, while the mean processing latency remains below the frame interval of the 15~fps input video.

0.30

Adaptive Semantic Communication with Residual Quantization for Resilient Vehicular Networks

cs.NI ·2026-10-07 ·Xuanhao Luo, Ruichen Gao, Sandeep Sreenivasan, Zhizhen Li, Yuchen Liu
similarity 0.59
Abstract

Vehicular networks require timely visual information exchange to support safety-critical applications such as cooperative perception and hazard awareness, yet transmitting high-dimensional camera data over bandwidth-limited and dynamic wireless links remains challenging. In this paper, we propose an adaptive semantic communication architecture for vehicular multicast that adjusts the amount of visual information transmitted according to current channel conditions, available communication resources, and latency requirements. Specifically, the visual encoder uses residual quantization to represent each image at multiple bitrate and reconstruction-quality levels. At runtime, the system selects an appropriate level based on the communication conditions, enabling it to trade visual fidelity for lower transmission overhead when network resources are limited. Context-adaptive entropy coding further compresses the quantized representations using offline-learned statistics, without requiring retraining for different channel conditions. This design allows the visual representation to be learned offline while the communication strategy is adapted online. Experimental results demonstrate competitive rate-distortion performance at ultra-low bitrates, improved delivery reliability and deadline satisfaction across diverse vehicular scenarios, and strong downstream perception performance, achieving up to 0.88 mAP50 while dynamically adapting to changing communication conditions.

0.15

ST-NDT: A Topological Framework for Reducing Communication Overhead in Network Digital Twins

cs.NI cs.ET ·2026-08-15 ·John Sengendo, Fabrizio Granelli
published similarity 0.59
Abstract · Accepted at 17th International Conference on Network of the Future NoF 2026

Next-generation networks (NGN) are becoming increasingly complex, especially with the increasing size of topologies. To manage this complexity requires the adoption of frameworks that enable real-time monitoring, optimization, and ``what-if'' case scenario analysis. Network Digital Twins (NDTs) have emerged as a key enabler technology for supporting these capabilities because of their ability to provide digital replicas of physical networks operations, enabling scenario testing without interfering with the live network. Although NDTs are considered a key enabler technology, maintaining continuous synchronization with the Physical Twin (PT) introduces considerable communication overhead and excessive bandwidth utilization, limiting sustainability in resource-constrained networks. This paper proposes a topological signal processing framework for sparse network monitoring in NDTs. We represent network edge flows as signals defined on a cell complex, and exploit the Hodge spectral structure of the graph to identify a minimal set of maximally informative sensor edges, thereby reducing the measurement overhead between the physical network and its digital twin replica. Results show that the proposed Sparse Topological Network Digital Twin (ST-NDT) framework consistently outperforms all four baseline frameworks across most of the edge monitoring budgets. For example, at a 20\% monitoring budget (48 of 243 edges monitored), ST-NDT achieves improvements of 10.85\%, 11.24\%, 7.36\%, and 6.15\% over degree-based, core-number, betweenness centrality, and random-selection frameworks, respectively.

0.19