CS Paper Radar

Joint Age-of-Latent and Resource Minimization for Wireless Multi-Camera Perception With Temporal Window Selection

Chih-Yu Lin, Wanjiun Liao, Sumudu Samarakoon, Mehdi Bennis

cs.IT eess.SP ·submitted 2026-08-10 10:35 UTC · v1

Abstract

Multi-camera wireless perception requires a base station (BS) to maintain timely and reliable latent beliefs from distributed cameras under limited uplink resources. Conventional Age-of-Information (AoI) measures the age of the latest received update but not task-relevant latent content. We introduce Age-of-Latent (AoL) to quantify the freshness of each camera's latest decoded latent representation. A finite temporal window of integration (TWI) determines the task-commitment time and available uplink slots, creating a tradeoff among update opportunities, prediction duration, commit-time AoL, prediction reliability, and accumulated resource cost. Within this horizon, redundant or overlapping views enable correlated prediction, reducing reliance on the highest-cost communication and encoding configuration to maintain BS-side latent beliefs. We formulate a joint AoL-resource minimization problem coupling task-level TWI selection with slot-level encoder selection, scheduling, and NOMA power allocation under prediction-reliability constraints. We propose correlation-aware latent prediction for AoL minimization (CoLA), which uses Lyapunov optimization for task-level TWI selection based on AoL-resource cost and prediction uncertainty, and proximal policy optimization for slot-level resource control. Results on a warehouse multi-camera RF dataset show that CoLA adapts the TWI to camera-update availability and achieves the most favorable AoL-resource tradeoff among the benchmarks while maintaining prediction reliability, particularly under prolonged and severe camera outages.

Comment
13 pages, 10 figures, 4 tables

Closest papers

Nearest neighbours by meaning across the whole index.

Wireless Evidence Acquisition for Multimodal Inference Constrained by Temporal Windows

eess.SP ·2026-09-25 ·Alessandro Compagnoni, Anup Mishra, Carla Fabiana Chiasserini, Elad Michael Schiller, Petar Popovski
hot direction similarity 0.64
Abstract · 5 pages, 4 figures, submitted to IEEE Communications letters

Multimodal inference in safety-critical applications, such as autonomous driving and robot navigation, requires heterogeneous sensor observations to reach an edge server within a task-prescribed temporal window. Referenced to the event or state being inferred, this window ends at the latest time an observation remains useful for the current decision. Since sensor readiness times, data volumes, wireless channel conditions, and task relevance vary across sensors, maximising network throughput does not necessarily minimise the fused prediction error when the window closes. We cast multimodal uplink scheduling as sequential wireless evidence acquisition and, for a linear minimum mean-square error (LMMSE) fusion model, derive a conditional evidence gain metric from the reduction in residual-error volume. Defined through second-order statistics, this metric applies beyond Gaussian models and coincides with conditional mutual information when the target and prediction errors are jointly Gaussian. We then develop MIRA, a greedy task-driven maximum information-rate allocation policy that combines conditional evidence gain with each sensor's channel state information and remaining data volume, while updating sensor relevance as evidence is acquired. Experiments on synthetic classification, human activity recognition, and vehicle-trajectory regression show that MIRA outperforms both relevance-only and channel-only scheduling. Relative to the former, MIRA improves classification accuracy by up to 70% and reduces regression mean-square error (MSE) by up to 5.5%. Relative to the latter, it requires 58% less acquisition time to attain an 80% target accuracy, while achieving up to 95% higher accuracy and 9% lower regression MSE. These gains are achieved without maximising received-data volume.

0.35

UniFlow-RS: Unified Generative Prediction for Heterogeneous Remote-Sensing Tasks

cs.CV ·2026-11-10 ·Jianlong He, Liang Liao, Jing Xiao, Chaofeng Chen, Gui-Song Xia
code/data similarity 0.60
Abstract

Remote-sensing foundation models increasingly unify representations across sensing modalities and downstream tasks, yet their prediction mechanisms remain largely task-specific. Separate decoders, prediction heads, and objectives leave prediction fragmented across tasks. This naturally raises a question: can heterogeneous remote-sensing tasks share the prediction process? UniFlow-RS answers this question with a single latent flow-matching predictor shared across tasks. This requires addressing two key challenges: unifying heterogeneous prediction spaces and harmonizing joint optimization across tasks. First, we cast heterogeneous task outputs into structured visual targets in a common latent space, allowing them to be modeled by the same pretrained flow predictor. Task-dependent conditioning further accommodates differences in input configurations. Second, we optimize all tasks with a common Flow Matching objective, eliminating task-specific prediction losses. To mitigate optimization mismatch across tasks and modalities, we introduce Task-Modality Adaptive Timestep Sampling (TMAS), which dynamically allocates training timesteps according to the online learning state of each task-modality group. Using a single shared model, UniFlow-RS handles six tasks and thirteen datasets, surpassing recent task-specific state-of-the-art methods on several benchmarks while remaining competitive on the others. Beyond these benchmarks, the same checkpoint demonstrates strong zero-shot transfer across unseen datasets, task settings, occlusion conditions, and near-infrared false-color imagery, without target-specific adaptation. Codes are available at https://github.com/MindVision-AI/UniFlow-RS.

0.37

Multi-Agent Video Prediction: Self-Correcting Conditional Frames for Dynamic Scene Forecasting

cs.NI ·2026-09-21 ·Qixin Zhang, Ajay Kumar, Zhi-Li Zhang
top venuebenchmark similarity 0.59
Abstract · Published in the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), 2026

Transmission latency significantly degrades user quality of experience in real-time interactive perception systems. In remote driving, maintaining reliable visual feedback is critical for safe operation under dynamic network variability. Although video prediction offers a promising approach to compensate for short-term transmission delays and approximate near-zero-latency streaming, prediction-only methods remain vulnerable in highly dynamic scenes, especially when newly emerged objects appear during uplink outages. To address these challenges, we propose a multi-agent video prediction framework that combines continuous edge-side video prediction with lightweight mask-guided conditional frame reconditioning. The framework consists of three role-specialized agents: a continuous prediction agent for low-latency visual continuity, a vehicle-side trigger agent for detecting newly appeared objects, and a conditional reconditioning agent that repairs the predictor conditioning state using sparse mask guidance. This design enables semantic recovery of exogenous scene changes without requiring full-frame retransmission. We validate the proposed framework through extensive experiments on benchmark video data under realistic 5G communication traces. Results show that our method improves semantic recovery of novel objects while preserving perceptual quality and practical runtime efficiency under network-induced disruptions.

0.41

Guess and Send: World-Model-Guided Semantic Packet Transmission for Robust Video Perception

cs.MM ·2026-10-21 ·Yan Gong, Zheng Chu, Wei Koong Chai, Hari Mohan Pandey, Jiankang Zhang +4 more
similarity 0.58
Abstract

Reliable video perception over bandwidth-constrained wireless links requires transmitting information that the receiver cannot already recover from its evolving scene representation. This paper introduces Guess and Send, a world-model-guided semantic packet transmission framework that prioritizes information according to its contribution to the receiver's perception. A shared feature-space world model predicts the receiver's scene state through affine motion compensation and learned residual displacement, while sender-side verification identifies reusable predictions. An acknowledgment-synchronized receiver twin estimates task-impact scores through two counterfactual evaluations, guiding packet selection and unequal error protection over LDPC-coded wireless channels. A compact 3-bit feature representation increases spatial coverage under stringent bandwidth constraints, while predictive fallback sustains perception during packet outages. Experiments on KITTI-MOTS (KITTI) and VisDrone2019-MOT (VisDrone) under Rayleigh fading and AWGN demonstrate substantial gains in low-SNR conditions. On KITTI at a 4.13% reference bandwidth budget, Guess and Send achieves 47.5% J&F at 0 dB Rayleigh SNR, outperforming H.264 by 11.3 percentage points. Controlled ablations show that world-model prediction contributes up to 8.7 points under Rayleigh fading. Object-detection experiments further demonstrate the transferability of receiver-relative predictive transmission across visual perception tasks. These results establish world-model-guided, receiver-state-aware transmission as an effective approach to robust video perception under severe communication constraints.

0.17

MV-JEPA: Post-Training Video Encoders for Cross-View Understanding

cs.CV ·2026-11-18 ·Yangchen Zhao, Ali Payani, Caiwen Ding
similarity 0.57
Abstract

JEPA-based video encoders learn strong representations for video and image understanding through prediction in latent space. However, their standard pretraining predicts features within individual images or video clips, without explicitly exploiting paired camera views of the same object or moment. Consequently, the learned representations may not reliably support matching across different camera viewpoints. To solve this problem, we introduce multi-view predictive post-training to strengthen cross-view instance and temporal correspondence while retaining independent single-view inference. A shared encoder processes masked context views independently, and a training-time predictor jointly predicts latent tokens for masked context regions and a fully held-out view. We alternate cross-view prediction with single-view masked prediction on general image and video data to help retain the encoder's pretrained capabilities. After only 9,000 post-training updates on a single GPU, MV-JEPA improves cross-view instance retrieval and coarse cross-camera moment retrieval on various datasets, with further gains in zero-shot action-phase retrieval and frozen-feature classification on AE2. Frozen-probe evaluations further indicate that post-training largely preserves motion recognition, image recognition, and dense semantic segmentation performance on the evaluated benchmarks. Together, these results demonstrate that multi-view predictive post-training can strengthen instance and coarse temporal correspondence in JEPA video encoders without modifying the encoder architecture or single-view inference interface.

0.21

Adaptive Semantic Communication with Residual Quantization for Resilient Vehicular Networks

cs.NI ·2026-10-07 ·Xuanhao Luo, Ruichen Gao, Sandeep Sreenivasan, Zhizhen Li, Yuchen Liu
similarity 0.57
Abstract

Vehicular networks require timely visual information exchange to support safety-critical applications such as cooperative perception and hazard awareness, yet transmitting high-dimensional camera data over bandwidth-limited and dynamic wireless links remains challenging. In this paper, we propose an adaptive semantic communication architecture for vehicular multicast that adjusts the amount of visual information transmitted according to current channel conditions, available communication resources, and latency requirements. Specifically, the visual encoder uses residual quantization to represent each image at multiple bitrate and reconstruction-quality levels. At runtime, the system selects an appropriate level based on the communication conditions, enabling it to trade visual fidelity for lower transmission overhead when network resources are limited. Context-adaptive entropy coding further compresses the quantized representations using offline-learned statistics, without requiring retraining for different channel conditions. This design allows the visual representation to be learned offline while the communication strategy is adapted online. Experimental results demonstrate competitive rate-distortion performance at ultra-low bitrates, improved delivery reliability and deadline satisfaction across diverse vehicular scenarios, and strong downstream perception performance, achieving up to 0.88 mAP50 while dynamically adapting to changing communication conditions.

0.15

More Interactions Make Communications More Efficient: A Directed Information Bottleneck Approach to Task-Oriented Communication

cs.IT ·2026-10-12 ·Zhirun Zheng, Yiqin Deng, Phone Lin, Yuguang Fang
theory similarity 0.56
Abstract · Submitted to IEEE Transactions on Networking

Task-oriented communication improves communication efficiency by transmitting semantic information required for downstream tasks, but may incur redundancy with previously transmitted information. To address this issue, we propose a variational directed information bottleneck joint source-channel coding (VDIB-JSCC) framework that transmits only previously unacquired information. Specifically, we use directed information to characterize the causal flow of task-relevant incremental information and theoretically demonstrate its advantages over mutual information and conditional mutual information. Based on this metric, we formulate a directed information bottleneck (DIB) objective that balances task-relevant information preservation and redundant information compression. We further derive a variational formulation, termed VDIB, whose tractable upper bound serves as the training loss. The encoder integrates a Vision Transformer for frame-wise semantic extraction and a Mamba-based causal state-space model for capturing temporal dependencies and extracting incremental information, while the decoder uses a Mamba-based state-space model for task inference. Experiments on CIFAR-10 and CIFAR-100 video streams demonstrate that VDIB-JSCC achieves higher classification accuracy with less transmitted information than state-of-the-art semantic communication methods. These results show that leveraging historical knowledge enables task completion with less information, improving communication efficiency.

0.14

Wireless Edge-Assisted Adaptive Latent Reasoning for Vision-Language-Action Models in Physical AI

cs.RO cs.NI ·2026-11-14 ·Fatih Temiz, Melike Erol-Kantarci
benchmark similarity 0.56
Abstract · 6 pages, 6 figures, submitted to IEEE ICC

Vision-language-action (VLA) models enable embodied artificial intelligence (AI) by translating visual observations and language instructions into robotic actions. Emerging use cases in physical AI are expected to drive the need for efficient inference and communication, as the computational demands of the VLA models pose challenges for real-time control with limited onboard resources. Test-time scaling through latent reasoning allows these models to refine hidden representations without generating explicit chain-of-thought (CoT) tokens, but introduces a trade-off between task success, inference latency, and energy consumption. In this paper, we address the efficient collaborative inference under a realistic communication scenario. We propose a wireless edge-assisted framework for adaptive latent reasoning (WEALR) that augments onboard computation with edge computing. A decision-making agent jointly selects the execution location and latent-reasoning convergence threshold. We formulate this joint adaptation as a constrained Markov decision process (CMDP). A Lagrangian-constrained deep reinforcement learning (CDRL) approach, namely trust region policy optimization Lagrangian (TRPO-Lag), learns to balance task performance and resource consumption under varying wireless conditions and task requirements. We evaluate the framework using LIBERO manipulation tasks, profiled VLA inference costs, and ray-traced wireless channels. Experimental results demonstrate that TRPO-Lag achieves up to 23% higher feasibility-weighted task success rate compared to benchmark CDRL methods.

0.09