CS Paper Radar

Event-Native Immersive Communication for 6G: From Multimodal Streams to Event Beliefs

Yiyang Zhu, Li Wei, Chau Yuen

cs.IT eess.SP ·submitted 2026-10-08 16:34 UTC · v1

Abstract

The development of multimodal sensing capabilities is crucial for realizing immersive communications and enabling rich, natural remote interactions in future sixth-generation~(6G) communications. However, transmitting high-dimensional sensory streams places substantial pressure on wireless resources and leaves a fundamental question unresolved: what information about the underlying physical process should be preserved across wireless delivery? To address this issue, we establish an event-native immersive-communication framework in which a service-relevant physical event defines the communication object, while event beliefs represent the information available to transceiver agents before and after wireless delivery. Based on this event-native framework, we further propose event-belief deficiency (EBD) to evaluate quality of experience (QoE) in immersive communications, which differs from the conventional normalized mean-squared error (NMSE), as NMSE can be insensitive to physically distinct procedures whose stream distortions lie in a similar range. For Gaussian event beliefs with mode-separable delivery over Rayleigh fading, we derive the log-det EBD, its induced received signal-to-noise ratio (SNR) threshold, the exact outage probability, and the required transmit SNR. Simulation results with a physics-driven source show that stream NMSE can remain nearly unchanged across physically distinct event procedures, whereas log-det EBD reliably reflects their event-level uncertainty. Relative to a mean-squared-error (MSE)-oriented interface, event-native delivery reduces normalized log-det EBD by up to $63.6\%$ and lowers the required average received SNR by $3.47$~dB under the evaluated outage constraint, substantiating the effectiveness of the proposed framework.

Closest papers

Nearest neighbours by meaning across the whole index.

Event-Inference Reliability for Physical AI over Wireless Networks

eess.SP ·2026-08-31 ·Anup Mishra, Petar Popovski
benchmarktheory similarity 0.57
Abstract

Wireless-enabled physical artificial intelligence (physical AI) systems call for a shift from reliable data delivery to reliable inference of physical events. The relevant question is not only whether packets arrive, but whether the set of cues available at the decision node, i.e., the evidence, is sufficiently timely and informative to support reliable inference about the event. Accordingly, this paper develops a framework in which event-inference reliability (EIR) is determined jointly by cue informativeness, cue availability, and temporal admissibility. The latter is determined by the downstream task requirement and represented through the usefulness horizon. We define event-inference error ratio (EIER) as the normalised residual event uncertainty after incorporating admitted cues, and EIR as the corresponding normalised uncertainty reduction, both conditioned on decision-node context. We further distinguish the evidence-limited Bayes benchmark from operational performance of a particular inference engine and derive an entropy-based lower bound on the minimum achievable event error from the same decision-node information. The framework then enables an event-aware wireless design interface for cue prioritisation, cue-reliability allocation, and event-inference coverage characterisation. A multiclass indoor activity-inference study combining empirical cue likelihoods with wireless delivery instantiates the framework and demonstrates how it characterises EIR under finite usefulness horizons.

0.50

Perception-Aware Joint Power and Sub-Band Allocation for 6G In-Body Subnetworks

cs.NI ·2026-09-07 ·Samira Abdelrahman, Hossam Farag
similarity 0.50
Abstract

In-body subnetworks (IBSs) are expected to become a key enabler of immersive eXtended Reality (XR) services in sixth-generation (6G) networks by providing ultra-short-range, low-latency wireless connectivity around the human body. However, the dense coexistence of multiple IBSs leads to severe co-channel interference, requiring increased transmit power to satisfy the stringent latency requirements of XR applications. Existing interference management approaches allocate radio resources solely according to application-level Quality-of-Service (QoS) requirements, overlooking the perceptual limitations of human users. This paper proposes perception-aware joint power control and sub-band allocation framework that integrates users' delay perception into radio resource allocation for XR-oriented IBSs. A learning-based perception model is first developed by combining Gaussian mixture modeling (GMM) with supervised learning to develop a statistical model of the delay perception threshold. The learned perception model is then incorporated into a stochastic radio resource allocation problem, which is reformulated using a Lyapunov drift-plus-penalty and solved through a low-complexity per-slot resource allocation procedure. System-level simulations under realistic intra- and inter-IBS propagation conditions demonstrate that the proposed approach substantially improves radio resource efficiency, achieving up to 26% transmit power reduction under stringent latency requirements and approximately 60% power savings in dense IBS deployments, while maintaining the required Quality of Experience (QoE).

0.26

Why Today's Internet Cannot Support Tomorrow's Immersive Experiences: Insights from the NSF Workshop

cs.NI cs.CRcs.HCcs.MM ·2026-09-23 ·Bo Han, Amitabh Varshney, Klara Nahrstedt, Songqing Chen, Sarita Adve +8 more
similarity 0.48
Abstract · 32 pages, 6 figures

Immersive computing is poised to become a major paradigm for future human-computer interaction (HCI), enabling spatial and embodied experiences across applications such as education, healthcare, manufacturing, emergency response, and scientific discovery. However, today's Internet and computing infrastructure were not designed for real-time, multi-user, sensor-rich, and privacy-sensitive immersive applications. They require coordination across sensing, representation, compression, networking, edge/cloud computing, rendering, security/privacy, and human experience. This report summarizes key findings from the NSF Workshop on Networking and Systems Challenges in Immersive Computing. The workshop brought together researchers from networking, systems, extended reality (XR), artificial intelligence (AI), graphics, HCI, security, privacy, and applications to identify challenges and opportunities. We conclude that immersive computing cannot be enabled by isolated advances in network bandwidth, device capabilities, AI models, or rendering alone. The field needs end-to-end architectures that adapt to user behavior, application requirements, resource constraints, and social expectations. We organize the agenda into six themes: networked systems for immersive computing; real-time edge-cloud orchestration for XR applications; AI for immersive experiences; privacy, security, and trust in XR systems; human-centered design and user experience in XR; and scalable infrastructure, testbeds, and open ecosystems for XR. We further identify key research questions, future trends, risks, ten-year success metrics, and action items for academia, industry, government, and research community. The report calls for coordinated investment in open platforms, reproducible benchmarks, privacy-preserving systems, and human-centered evaluation to build trustworthy, scalable, and broadly impactful infrastructure.

0.28

EventHOI: Event-Driven Resource-Efficient Hand-Object Interaction Logging on Smartglasses

cs.DC cs.CVcs.HC ·2026-11-06 ·Le Zhang, Kailai Cui, Hao Chen, Vlad Roznyatovskiy, Jianzhong Zhang +3 more
benchmark similarity 0.48
Abstract · 15 pages, 21 figures, 3 tables

Hand-object interactions (HOIs) can be captured by smartglasses to learn how people manipulate objects in daily life. Automatic logging of these interactions from an egocentric perspective provides time-stamped evidence of daily actions for applications like memory assistance. However, continuous RGB capture and wireless transmission exceed the energy and bandwidth budgets of smartglasses. We present EventHOI, an event-driven sensing and compression system that couples selective RGB capture with HOI-aware encoding to enable egocentric logging over Bluetooth Low Energy (BLE) while preserving downstream HOI logging performance. Our key insight is to use low-power event sensing both to determine when RGB capture is needed and to identify where visual detail must be preserved. A lightweight IMU-based egomotion cancellation pipeline suppresses egomotion-induced events so that residual HOI motion can guide RGB triggering and spatial compression. We build a smartglasses prototype and conduct an end-to-end evaluation of EventHOI on a 50-hour egocentric benchmark with 97 subjects and a 20-hour real-world dataset we collect from 10 participants, together covering a broad range of daily-life scenarios and environments. Compared to RGB-only baselines, EventHOI reduces always-on backend power consumption by 5.8-10.4x and uplink bandwidth by 2.9x, with minimal HOI recognition accuracy loss. The resulting RGB uplink of less than 130 kbps fits within commodity BLE bandwidth budgets, making stable BLE video streaming feasible for egocentric HOI logging. Demo video and project website: https://eventhoi.github.io

0.35

3D Gaussian Splatting: A New Paradigm for Wireless Environment Representation

eess.SP ·2026-10-31 ·Jinya Zhang, Jiajia Guo, Chao-Kai Wen, Shi Jin
code/data similarity 0.47
Abstract · A collection of paper on 3DGS for Wireless Communications can be found at https://github.com/AI4Wireless/3DGS_for_Wireless

Wireless channels are shaped by the surrounding propagation environment, making explicit environment representation an effective approach for characterizing channels. By combining explicit environment modeling with learnable radio frequency characteristics, 3D Gaussian splatting (3DGS) emerges as a new paradigm for wireless environment representation. This article establishes a systematic perspective on 3DGS-enabled wireless communications in terms of environment representation. We first clarify the rationale for extending 3DGS from visual scene modeling to wireless communications and formulate a unified framework for wireless environment representation. Building on this framework, we further investigate the applicability of 3DGS-based representations to a broad range of communication and sensing tasks, and characterize key considerations for practical deployment. Finally, emerging directions are highlighted, including cross-scene generalization, near-field channel modeling, real-world data collection, and lifecycle management.

0.43

Sensory Precision Inference for Multimodal Arbitration under Uncertainty

cs.LG cs.NE ·2026-09-14 ·Tin Mišić, Takato Horii
similarity 0.46
Abstract · This work has been accepted for publication in the International Workshop on Active Inference (IWAI2026) proceedings. This is the Submitted …

Autonomous agents operating on multisensory data cannot assume that all sensory modalities remain consistently informative. In real environments, sensory streams are frequently corrupted by noise, missing data, or inter-modal incongruence, requiring adaptive arbitration between competing sensory hypotheses. While active inference provides a principled framework for uncertainty-guided inference, the role of dynamically inferred sensory precision in generative multimodal arbitration under sensory conflict remains comparatively underexplored. We propose a multimodal perceptual inference model in which latent beliefs and modality-specific sensory precisions are jointly updated through iterative free-energy minimization. In our proposed model, sensory precision dynamics not only reflect sensory uncertainty but actively shape the evolution of latent beliefs during multimodal conflict. In addition, we introduce a learned prior over sensory precisions that induces structured, class-dependent precision patterns and influences cross-modal inference dynamics. We evaluate the model using a synthetic multimodal MNIST dataset combining visual, auditory, and tactile representations of digit classes under controlled sensory noise and inter-modal incongruence. Results show that dynamic precision inference improves reconstruction robustness under corrupted sensory evidence, supports coherent latent inference from reduced sensory evidence, and enables stable arbitration between conflicting modalities. Furthermore, learned precision priors generate interpretable precision structures that shape inference dynamics and cross-modal latent structure. These findings support sensory precision inference as a mechanistic control process for adaptive multimodal belief formation under uncertainty, highlighting precision dynamics as a computational mechanism for robust and interpretable multisensory integration.

0.36

LR-V2X: Loss-Resilient Collaborative Perception under Low-Bandwidth Communication

cs.CV ·2026-10-08 ·Kang Yang, Tianci Bu, Peng Wang, Deying Li, Yongcai Wang
code/data similarity 0.46
Abstract

Given the inherent unpredictability of packet loss in vehicular wireless communications, V2X collaborative perception can yield practical benefits only if agents can achieve reliable collaboration under lossy and low-bandwidth communication conditions. Existing dense BEV feature fusion methods depend on redundant BEV feature exchange, which is infeasible in low-bandwidth scenarios, while compact-communication methods aggressively compress messages but can hardly recover the missing feature content after packet loss. In this paper, we present LR-V2X, a loss-resilient, latent-space reconstruction framework that converts corrupted received latents (even under severe 90% packet loss) into a spatial prior and then reconstructs the missing BEV information from this informative prior and using ego context as condition. Notably, the model can be trained under complete communication conditions and can be directly applied to lossy conditions at test time, eliminating the need for training under numerous lossy conditions. Experiments on DAIR-V2X and V2XREAL show that LR-V2X delivers the strongest robustness under severe packet loss and preserves reliable collaboration as communication quality degrades. And it reduces communication overhead by $64\times$ compared to dense BEV feature fusion baselines. Code will be released at https://github.com/sidiangongyuan/LR-V2X.

0.38

Source Entropy-Guided Adaptive Transmission for Communication-Driven Multi-View Sensing

cs.IT eess.SP ·2026-09-16 ·Mingjie Yang, Guangming Liang, Dongzhu Liu, Lei Zhang, Xiaonan Liu +1 more
similarity 0.46
Abstract

Communication-driven multi-view sensing relies on routine communication transmissions for sensing acquisition, while the resulting sensing data at distributed devices must be uploaded to an edge server under limited communication resources. This creates a unique coupling between sensing acquisition and edge inference: the communication interval determines the source information, whereas the uplink condition determines how much information can be delivered to the server for sensing inference. To account for this coupling, we propose a source entropy-guided adaptive transmission framework. Specifically, we characterize the entropy of packet-triggered channel state information (CSI) as a function of the communication interval using a multi-output Gaussian process. The resulting analytical bound is compared with the available bit budget, determined by the transmission rate and latency requirement, to select between original-data and task-oriented transmission. For task-oriented transmission, we formulate the communication-constrained inference problem based on the information bottleneck and decompose it into adaptive distributed encoding and multi-view inference (ADE-MI), which avoids alternating optimization between the devices and the edge server. Experiments on the Widar3.0 multi-view CSI gesture recognition dataset show that the analytical bound closely follows the normalizing-flow numerical estimate, while ADE-MI outperforms task-oriented benchmarks under the same bit budget and the proposed framework further improves recognition accuracy under time-varying channels.

0.20