CS Paper Radar

Why Today's Internet Cannot Support Tomorrow's Immersive Experiences: Insights from the NSF Workshop

Bo Han, Amitabh Varshney, Klara Nahrstedt, Songqing Chen, Sarita Adve, Ruofei Du, Xueyu Hou, Yongjie Guan, Jiayi Meng, Qiao Jin, Xiaonan Guo, Nan Wu, Ruizhi Cheng

cs.NI cs.CRcs.HCcs.MM ·submitted 2026-09-23 22:00 UTC · v1

Abstract

Immersive computing is poised to become a major paradigm for future human-computer interaction (HCI), enabling spatial and embodied experiences across applications such as education, healthcare, manufacturing, emergency response, and scientific discovery. However, today's Internet and computing infrastructure were not designed for real-time, multi-user, sensor-rich, and privacy-sensitive immersive applications. They require coordination across sensing, representation, compression, networking, edge/cloud computing, rendering, security/privacy, and human experience. This report summarizes key findings from the NSF Workshop on Networking and Systems Challenges in Immersive Computing. The workshop brought together researchers from networking, systems, extended reality (XR), artificial intelligence (AI), graphics, HCI, security, privacy, and applications to identify challenges and opportunities. We conclude that immersive computing cannot be enabled by isolated advances in network bandwidth, device capabilities, AI models, or rendering alone. The field needs end-to-end architectures that adapt to user behavior, application requirements, resource constraints, and social expectations. We organize the agenda into six themes: networked systems for immersive computing; real-time edge-cloud orchestration for XR applications; AI for immersive experiences; privacy, security, and trust in XR systems; human-centered design and user experience in XR; and scalable infrastructure, testbeds, and open ecosystems for XR. We further identify key research questions, future trends, risks, ten-year success metrics, and action items for academia, industry, government, and research community. The report calls for coordinated investment in open platforms, reproducible benchmarks, privacy-preserving systems, and human-centered evaluation to build trustworthy, scalable, and broadly impactful infrastructure.

Comment
32 pages, 6 figures

Closest papers

Nearest neighbours by meaning across the whole index.

AI Smart Glasses for Wearable Intelligence: From Egocentric Sensing to Agentic Personalization

cs.CV ·2026-09-17 ·Xu Yuan, Yi Wang, Zhuohang Jiang, Haohao Qu, Yujuan Ding +6 more
survey similarity 0.59
Abstract

Recent advances in artificial intelligence (AI) are reshaping smart glasses from egocentric capture and display devices into platforms for wearable intelligence. Smart glasses increasingly serve as wearable AI systems that connect first-person observation with real-time assistance under strict form-factor constraints. We frame this transition through the lens of \emph{AI smart glasses} and define them as a system-level concept in which egocentric sensing, resource-aware computing, intelligent reasoning, multimodal interaction, and real-world application constraints are co-designed for personalized assistance in the physical world. To systematically study this perspective, we organize the survey around four connected dimensions. First, we examine the hardware foundation that bounds sensing, computation, feedback delivery, and sustained deployment. Second, we study wearable intelligence, where egocentric signals are transformed into perceptual, contextual, and agentic capabilities. Third, we discuss interaction design, through which users request, receive, correct, and regulate assistance during ongoing activity. Fourth, we analyze application scenarios across healthcare, accessibility, situated learning, daily life assistance, cultural tourism, and industrial support, showing how domain requirements reshape system design and evaluation. We further identify five cross-cutting research challenges for future AI smart glasses: next-generation hardware, trustworthy egocentric intelligence, lifelong personalized memory, proactive intelligence, and embodied foundation models. By centering smart glasses as wearable-intelligence platforms, this survey provides a unified framework for organizing technologies, applications, and open challenges in this emerging area.

0.30

Secure Agentic AI and Multimodal Intelligence in 6G Communication Systems

cs.AI eess.SP ·2026-10-21 ·Satyam Gaba, Devanshu Motwani, Siva Sai, Vineet Suri, Vikas Ranjan +1 more
publishedsurvey similarity 0.59
Abstract · 20 pages, 5 figures, 5 tables

Sixth-generation (6G) communication systems are expected to support immersive, intent-driven, and latency-critical services through tight integration of multimodal intelligence, edge computing, and autonomous network control. In this setting, agentic AI systems can reason over heterogeneous inputs, use tools and network functions, coordinate across distributed entities, and adapt to dynamic environments. These capabilities make agentic multimodal intelligence promising for 6G applications such as semantic communications, digital twins, and zero-touch network management, but they also introduce security and privacy risks that extend beyond conventional AI and network security models. Vulnerabilities can propagate across multimodal data pipelines, memory, tools, communication interfaces, and inter-agent coordination loops. We survey multimodal intelligence and agentic AI for 6G cross-layered communication systems from the perspectives of privacy and security. We present a 6G-oriented system view spanning perception, memory, tool use, and multi-agent orchestration; analyze threat models and attack surfaces across sensing, cognition, action, memory, and communication layers; organize existing attacks into a structured taxonomy; and review mitigation strategies including prompt and memory defenses, inter-agent trust mechanisms, secure orchestration, and privacy-preserving learning. We conclude by outlining open research directions for trustworthy multimodal multi-agent 6G systems.

0.58

Beyond the Headset: A Systematization of Knowledge on Extended Reality Privacy and Security in Healthcare

cs.CR cs.HC ·2026-09-29 ·Nafisa Anjum, M. Rasel Mahmud
publishedsurveybenchmarkhighly cited similarity 0.59
Abstract · Published in 31st ACM Symposium on Virtual Reality Software and Technology

Extended reality (XR) systems are increasingly used in healthcare applications ranging from surgical planning to remote rehabilitation and mental health support. However, the rich streams of sensor, biometric, behavioral, and environmental data that enable these applications also introduce substantial privacy and security risks. Adversaries may exploit insecure communication, sensor side channels, application-layer vulnerabilities, or data-processing pipelines to infer sensitive information or disrupt clinical workflows. Despite growing interest in XR security and privacy, the healthcare-specific literature remains fragmented. In this Systematization of Knowledge (SoK), we review 65 peer-reviewed studies published between 2017 and 2024 across XR, security, privacy, and healthcare venues. We develop a unified threat taxonomy spanning device, user, network, and cloud layers and introduce XR-PRISM, a quantitative Privacy and Risk Impact Scoring Metric for systematically characterizing security and privacy risks. Our analysis identifies several gaps in the literature: more than 70% of proposed countermeasures lack standardized risk evaluation, fewer than 15% of studied attacks require high attack prerequisites, and reproducibility is limited by the scarcity of publicly released artifacts and datasets. Based on these findings, we outline a research roadmap emphasizing shared benchmark datasets, stronger artifact-release practices, improved cloud-layer protections, and more comprehensive detection, mitigation, and recovery mechanisms. This SoK provides a structured and data-driven foundation for understanding existing risks and guiding the development of more secure, privacy-preserving, and usable XR healthcare systems.

0.57

The Evolution of In-Premise Networks In the Era of Immersive Services: From Copper to Fiber-to-The Room [Invited Tutorial]

cs.NI ·2026-10-11 ·Elaine Wong, Sourav Mondal
similarity 0.58
Abstract · This article is under review in IEEE/Optica Journal of Optical Communications and Networking. Copyright @ IEEE/OSA 2026

The telecommunications industry is shifting toward an experience-driven era defined by immersive applications that impose stringent network demands. While passive optical network (PON)-based Fiber-To-The-Home (FTTH) architectures have historically delivered high-capacity broadband, a growing performance gap between access and indoor networks necessitates driving fiber deeper into premises. Complementing existing copper and WiFi technologies, Fiber-to-the-Room (FTTR) is emerging as a critical enabler. This article examines the drivers of this architectural shift, specifically focusing on collaborative extended reality (XR). We analyze the multi-modal traffic characteristics and Quality-of-Experience (QoE) requirements of XR, alongside the resulting network performance implications. To address these demands, we propose a novel resource allocation framework integrating coarse-grained traffic forecasting with intelligent in-premise roaming. This framework facilitates the flexible deployment of artificial intelligence models tailored to the computational capabilities of the FTTH, FTTR, and WiFi segments. Numerical evaluations of a representative multi-tier network demonstrate that long-horizon, multi-step-ahead traffic forecasts significantly reduce inference frequency. This approach enables coordinated resource allocation and network-orchestrated seamless mobility across rooms, effectively satisfying collaborative XR QoE requirements. Finally, we highlight strategies to amortize FTTR capital expenditure by extending the optical infrastructure's role beyond basic connectivity. By supporting diverse services over a unified physical layer, FTTR enhances infrastructure utilization, unlocks novel revenue streams, and maximizes the value of in-premise fiber deployments.

0.31

Security and Privacy in the Musical Metaverse: Threat Analysis and Design Implications

cs.CR ·2026-09-03 ·Luca Turchet, Michał Kłosinski
unusual similarity 0.58
Abstract · IEEE International Symposium on Emerging Metaverse 2026

The Musical Metaverse (MM) introduces immersive, real-time environments for collaborative musical interaction, characterized by ultra-low-latency constraints, continuous multimodal data streams, and heterogeneous devices. These properties create a distinctive security and privacy landscape that differs significantly from conventional XR or multimedia systems. This paper presents a multi-layer threat analysis of MM ecosystems, identifying key assets including live musical content, expressive interaction data, identity and session metadata, and intellectual property. Threats are analyzed across network, application, data/AI, device, intellectual property rights, and social layers, with particular attention to risks arising from expressive and neurophysiological data, which enable inference, re-identification, and potential privacy violations. We describe a stakeholder-driven survey involving 14 participants from 13 organizations, revealing that neurophysiological data leakage and real-time stream disruption are perceived as the most critical risks, followed by intellectual property infringement and avatar impersonation. We further evaluate the suitability of existing security protocols under strict latency constraints, showing that conventional approaches such as TLS over TCP are often incompatible with real-time musical interaction, while lightweight, stream-oriented mechanisms (e.g., SRTP, DTLS) provide a more suitable balance between security and performance. Based on these findings, we derive a set of design guidelines for MM systems, emphasizing latency-aware security, differentiation of interaction paths, data minimization, and edge-centric processing. The results support a security-by-design approach that enables trust and compliance without compromising real-time performance.

0.28

Dorsal Hand Images for Immersive (XR) and Privacy-preserving Age Assurance and Child Safety

cs.CV ·2026-08-21 ·Riccardo Bovo, George Loukas, Josh P. Davis
similarity 0.57
Abstract · v2: Revised data availability statement; dataset will not be shared. No changes to results

Ensuring that Extended Reality (XR) environments are age-appropriate is an important regulatory and safety challenge. However, current age assurance operates only at registration and cannot verify the age of the active user during a session. Face-based approaches, the dominant solution in social media and adult platforms, are impractical in XR, because they require removing the headset and taking a self-captured image, often on a mobile app. This both breaks immersion and introduces the privacy risk of sharing face pictures with third parties, which leaves XR platforms without a viable path to continuous, in-session and privacy-preserving age assurance. We propose the dorsal part of the hand as an alternative to the face, by exploiting the egocentric cameras that XR headsets inherently and naturally use to capture gesture interactions. To evaluate this, we collect an age- and sex-stratified, ethnodiverse dataset of 436 participants spanning the minor--adult boundary, captured under unconstrained lighting and orientation conditions. To characterise what is achievable with off-the-shelf methods at the minor--adult boundary, we evaluate standard neural network architectures for age assurance at the legally critical 18-year threshold. Analysis confirms performance is robust to skin-tone variation. On this dataset, the challenge-31 operating point achieves zero minor admission, making the system a viable first-stage filter for age assurance. These findings position dorsal hand morphometrics as an effective and more privacy-preserving biometric modality for in-session age assurance in XR.

0.28

Cyber-Physical Systems for Accessibility and Ability Augmentation: Bridging Diverse Communities

cs.HC ·2026-08-19 ·Shuchang Xu, Riku Arakawa, Mina Huh, Nandi Zhang, Tianyu Zhang +9 more
published similarity 0.57
Abstract · UIST 26 Workshop

The powerful convergence of wearables, robotics, extended reality, and smart environments is expanding the design space for cyber-physical systems (CPS) that support and augment human abilities in daily life. By sensing real-world contexts, modeling user needs, and providing situated assistance, these systems can improve accessibility for people with disabilities while enhancing broader human abilities such as perception, memory, learning, and mobility. However, realizing this potential requires addressing key challenges in context sensing, user modeling, adaptive interaction, privacy, and evaluation to ensure that CPS are reliable and effective in real-world contexts. This workshop will bring together researchers and practitioners across HCI, AI, wearables, robotics, XR, smart environments, accessibility, and ability augmentation to examine shared strategies and challenges for designing accessibility- and ability-centered CPS. Through panel discussions, interactive demos, and mixed-group design activities, participants will identify recurring design principles, technical challenges, and future directions for CPS that support and augment human abilities in real-world settings. For details, please visit: https://cps4all.github.io.

0.31

Abstractions for Network Intelligence: A Reference Architecture for AI at the Wireless Edge

cs.NI ·2026-08-10 ·Salil Reddy, Haohuang Wen, Ness Shroff, Venki Ramaswamy, Zhiqiang Lin +3 more
similarity 0.57
Abstract

Networks are increasingly adopting AI as are AI applications leveraging networks. Awareness sharing between networks and AI applications promises to unlock higher levels of network utilization and application performance, but is inadequately supported in the current architecture of the Internet. In this paper, we describe a reference architecture that abstractly enables the synergistic interaction of intelligent applications and the intelligent network, via an information waist, and also supports the network intelligence services in the emerging intelligence plane in networks. We discuss the rationale for our AI-EDGE architecture, its functional requirements, and the core abstractions. We present a reference component-level design of the core abstractions to support experimentation and development on existing platforms for wireless networking (i.e., based on O-RAN cellular networks) and edge computing (i.e., based on 3GPP Edge App and ETSI MEC). Moreover, we provide representative use cases from the perspective of different types of users that demonstrate the benefits of the architecture in contexts of awareness sharing, portability, prototyping, and validation.

0.04