CS Paper Radar

SemISAC: Semantic Integrated Sensing and Communications

Xiaoqi Zhang, J. Andrew Zhang, Zhongqin Wang, Chang Liu, Weijie Yuan, Giuseppe Caire, Geoffrey Ye Li

eess.SP ·submitted 2026-09-16 08:26 UTC · v1

Abstract

Conventional integrated sensing and communications (ISAC) systems primarily integrate communications and sensing through shared physical resources, without explicitly exploiting task-relevant semantic information. To move beyond such physical-level integration, we propose semantic ISAC (SemISAC), a general framework that unifies semantic communication (SemCom) and semantic sensing (SemS) to convey source meaning and acquire environmental meaning. Specifically, the transmitter combines source semantics and sensing task information with available side information to design the shared waveform and allocate radio resources, while the receiver-side communication and sensing task decoders recover the source meaning and infer the required environmental information, respectively. We also provide an information-theoretic interpretation to characterize the relationship between physical and task-relevant information and the resulting semantic trade-off in SemISAC. Building on this framework, we formulate the general SemISAC design problem and propose two realization methods, namely end-to-end (E2E) SemISAC optimization and modular SemISAC optimization. As a concrete realization, we apply modular SemISAC optimization to jointly design a learnable time-frequency (TF) precoder in an orthogonal frequency-division multiplexing (OFDM) system for representative SemCom and SemS tasks. Simulation results demonstrate that the proposed realization reduces sensing semantic distortion under a given communication requirement and achieves a more favorable communication-sensing trade-off than baseline designs.

Closest papers

Nearest neighbours by meaning across the whole index.

Adaptive Pilot Selection for Unified Semantic Communication and Semantic Sensing in ISAC

eess.SP cs.AI ·2026-09-25 ·Muhammad Abubakar Rashid, Muhammad Hannan Akram, Haejoon Jung, Syed Ali Hassan
similarity 0.66
Abstract

Semantic communication (SemCom) and integrated sensing and communication (ISAC) are promising technologies for future 6G wireless networks. Existing studies have applied semantic technology to either the communication module or the sensing module of ISAC. In this work, we propose SemISAC, which performs both SemCom and semantic sensing within a single dual-function waveform. SemISAC uses a joint semantic encoder that extracts task-specific information for both communication and sensing. We evaluate SemISAC in a vehicular scenario in which vehicles share pixel-wise segmentation of the road environment and, through sensing, classify surrounding objects and estimate their ranges. On the transmitter side, a deep learning encoder converts the input road-scene image into semantic symbols and places them on the data cells of an OFDM grid, while the remaining cells serve as pilots for channel state information estimation and sensing. The pilot configuration is adaptively optimized based on the channel conditions to balance communication and sensing requirements. At the receiver, a deep learning model reconstructs the segmentation from the received waveform, while the transmitting vehicle captures the reflected waveforms from surrounding objects and uses task-specific deep learning decoders for target recognition and range estimation. Simulation results show that SemISAC achieves a segmentation accuracy close to that of the dedicated SemCom module while outperforming both conventional and semantic baselines in target recognition and range estimation.

0.13

Prospective Importance-based Cognitive Pilot Design for Semantic Sensing in ISAC Systems

eess.SP ·2026-11-09 ·Guanping Shang, Anzheng Tang, Zeyan Zhuang, Shenghui Song
similarity 0.63
Abstract · The paper has been submitted to the 2027 WCNC conference

Semantic sensing enables integrated sensing and communication (ISAC) systems to acquire environmental information relevant to downstream tasks. However, existing pilot design methods either rely on static pilot configurations or learn end-to-end pilot selection policies, without explicitly evaluating the semantic contribution of candidate pilot locations. In this work, we propose a cognitive semantic sensing framework for human activity recognition in orthogonal frequency division multiplexing (OFDM)-ISAC systems. Rather than directly learning a high-dimensional mapping from observations to pilot locations, we introduce a semantic importance weight (SIW) to measure the semantic contribution of each candidate pilot location. Leveraging the information bottleneck (IB) principle and the mutual information-minimum mean-square error (I-MMSE) relationship, SIW assigns high values to future time-frequency (TF) channel coefficients that are both difficult to infer from the preceding observations and valuable for downstream inference. To efficiently obtain the SIW, we further develop a conditional diffusion model that predicts the corresponding uncertainty through denoising covariance estimation. Experiments on a real-world Wi-Fi sensing dataset show that the proposed method consistently outperforms baselines across different signal-to-noise ratios (SNRs) and pilot budgets.

0.29

Semantic Communication via Analog RF Computing: When the Radio Computes the Meaning

eess.SP cs.AIcs.IT ·2026-11-17 ·Christo Kurisummoottil Thomas
similarity 0.62
Abstract

Semantic communication (SC) systems transmit continuous latent representations of meaning, but computing the semantic encoder at resource-constrained edge devices incurs substantial energy and memory costs. To address this challenge, we propose an end-to-end SC framework that executes the semantic encoder in the client's RF receiver front end using analog RF computing. A base station (BS) broadcasts encoder weights as RF waveforms, while each edge device reuses its receiver's passive mixer to compute semantic latents at ultra-low energy. These latents are transmitted over the uplink for network-side task inference. We show that analog computing noise across encoder layers and channel noise affecting transmitted latents admit a unified mathematical model. We define a task-posterior semantic distortion metric and derive its second-order decomposition into per-client, per-stage semantic sensitivities. Using this decomposition, we obtain a closed-form semantic-aware water-filling allocation of the total client energy budget across clients, encoder layers, and uplinks, assigning tighter accuracy targets to semantically sensitive stages. This allocation induces a broadcast beamforming problem that accounts for client-specific, per-layer accuracy requirements. We further refine the allocation through stochastic optimization and jointly design it with multi-task noise-aware training of the shared semantic model. MNIST simulations show that, at matched total client energy, the proposed allocation reduces network semantic distortion by 9.2\%-19.2\% compared with uniform precision and 5.1\%-13.1\% compared with client-blind allocation. Noise-aware co-design yields a further 46\% reduction.

0.35

Significance-Driven Semantic Communication

cs.IT ·2026-08-28 ·Christian McDowell, Andrea Panebianco, Sirin Chakraborty, Yin Sun
similarity 0.60
Abstract

In this paper, we study a significance-driven cross- layer semantic communication design problem. Based on sta- tistical decision theory, we introduce an information-theoretic measure of per-sample data significance that quantifies the task-specific value of each individual observation. Using this metric, we formulate a cross-layer optimization problem that simultaneously optimizes (i) physical-layer semantic encoding and inference and (ii) MAC-layer resource allocation, with the objective of maximizing semantic spectrum efficiency, defined as the semantic value delivered per unit bandwidth per unit time. At the physical layer, we develop Meta-Learning Variational Information Bottleneck (Meta-VIB), a new semantic transceiver that employs a meta-learned hypernetwork to compress high- dimensional observations into semantically significant latents, enabling instantaneous adaptation to dynamic channel conditions and varying symbol budgets without online retraining. At the MAC layer, we model channel allocation as a Multi-Action Restless Multi-Armed Bandit (MA-RMAB) and adopt the Q- Maximization algorithm, which dynamically allocates channel resources to sensors based on their semantic value of information. Experimental results on a real-world pedestrian safety dataset demonstrate that our joint design achieves substantial gains in semantic spectrum efficiency over baselines, reaching up to 1000 times gain at an average SNR of 0 dB and 40 times gain at an average SNR of 5 dB.

0.32

Agentic Semantic Sensing for Resource-Adaptive AI-RAN

cs.AI eess.SP ·2026-10-06 ·Zhongqin Wang, Xiaoqi Zhang, Nan Yang, Kai Wu, J. Andrew Zhang +1 more
similarity 0.60
Abstract

Semantic sensing (SemS) acquires task-relevant information rather than reconstructing complete physical information. Existing SemS formulations typically operate open loop: sensing configurations and observation schedules are fixed before inference and cannot respond to evolving task-level evidence. We propose Agentic SemS, a closed-loop framework for AI-enabled radio access networks (AI-RANs) that controls sensing within a communication-feasible profile set. A profile-conditioned causal Transformer updates the semantic belief from streaming observations, while key-value caching enables efficient state updates across profile changes without repeatedly processing the complete history. A semantic utility network estimates the task-level benefit of acquiring the next observation block under each feasible profile after accounting for sensing cost. The resulting continuation utilities jointly support next-profile selection and semantic early exit, adapting sensing configuration and duration to evolving evidence. The expected semantic gain is further related to conditional mutual information, providing a value-of-information interpretation of continued online sensing. Experiments on Widar3.0 with six emulated sensing profiles show that, in comparison with full-sequence High, the resource-efficient Agentic setting reduces normalized cumulative sensing cost by 25.33% while achieving 85.79% Macro-F1. At the same utility checkpoint, semantic early exit provides a further 12.35% cost reduction over adaptive sensing without early exit, with a 0.97-percentage-point Macro-F1 decrease.

0.14

Embodied Semantic Communication for Collective Autonomous Agents: A Tutorial on Representation, Wireless Delivery, and Closed-Loop Coordination

cs.MA cs.AI ·2026-09-28 ·Yizheng Huang, Wensheng Lin, Lixin Li, Qinghe Du, Wenchi Cheng +1 more
similarity 0.59
Abstract

As autonomous systems and embodied intelligence enter the dynamic physical world, multi-agent collaboration calls for a paradigm shift in communication design. However, existing communication paradigms overlook that agents form action understanding from their own states, environmental observations, and collaboration relations through a process that evolves as a task unfolds. Consequently, reliable bit delivery, general semantic recovery, or single-task utility optimization alone cannot ensure that heterogeneous agents form coordinated actions compatible with their own conditions from shared information during task execution. To address this gap, this paper proposes embodied semantic communication (ESC) as a paradigm that transforms information transmission into action-oriented semantic interaction. Specifically, ESC characterizes how an explicit communication link can encapsulate multimodal perceptual states, intrinsic hardware capabilities, and collaborative intents into unified actionable semantic representations, thereby enabling heterogeneous receiving agents to parse, align, and ground them in local motor control. This paper clarifies the conceptual boundary, system characteristics, and environment-constrained technical pathways of ESC. It maps the underlying mathematical tools, including semantic information theory, world models, and multi-agent decision theory. Finally, this paper summarizes key open challenges, including measurable semantic reliability, ambiguity-triggered interaction under dynamic environments and tasks, and bandwidth-adaptive semantic transmission, outlining a roadmap for collective embodied networks.

0.16

Enabling Emergency Communication via Semantic Radar-Centric ISAC

cs.NI ·2026-09-06 ·Mohaimin Al Barat, Chaoyu Zhang, Hexuan Yu, Kai Zeng, Y. Thomas Hou +1 more
published similarity 0.59
Abstract · 6 pages, 1 figure, 5 tables. Accepted by IEEE MILCOM 2026

Combat aircraft and other modern military platforms field two co-located RF assets: a radar for sensing and a dedicated radio for communication. In contested battlefield environments, however, the dedicated communication path is highly likely to be targeted and disrupted by jamming, blockage, or physical damage, while the radar remains fully operational. A natural fallback is to repurpose the surviving radar aperture as an emergency communication channel. The difficulty is that radar is purposely engineered for sensing rather than communication, so loading any information onto its waveform perturbs the beampattern and inevitably erodes sensing performance: the more bits we push, the more sensing we lose. We identify the core problem as enabling emergency communication via a radar-centric integrated sensing and communication (ISAC) link while preserving the radar's primary sensing function. Therefore, we propose a semantic radar-centric ISAC framework that pairs a learned vector-quantized semantic encoder, which compresses task-relevant content into a few tens to a few hundred bits, with a wideband phased-MIMO radar restricted to a conservative spatial-spectral configuration subset that respects a bounded sensing-degradation budget. Experiments on SAR target classification and text classification show that our framework supports reliable emergency communication for downstream tasks while keeping the radar beampattern almost unchanged.

0.38

Radio Echo Representation Learning for Semantic Sensing in Multi-Modal ISAC Systems

eess.SP ·2026-10-11 ·Guanping Shang, Anzheng Tang, Kwok Kit Chan, Shenghui Song
similarity 0.59
Abstract · This paper has been submitted to the IEEE trans journals

Semantic sensing extends integrated sensing and communication (ISAC) beyond physical parameter estimation by exploiting task-oriented representations from radio echoes. Nevertheless, existing multimodal sensing remains largely limited to vision-assisted radio physical parameter estimation or typically processes the visual and radio modalities separately, leaving radio representations underutilized for visual task enhancement. Feature-level fusion enables closer cross-modal interaction, while echo interference complicates the learning of user-specific radio representations and its semantic consistency with the visual entities. To address these challenges, this paper proposes a multimodal semantic sensing framework for orthogonal frequency-division multiplexing (OFDM)-ISAC systems. We propose a radio encoder to learn radio representations oriented toward visual localization from superimposed pilot echoes, together with Variational Radio-Visual Grounding (VRVG) to promote semantic consistency between the learned radio representations and visual spatial features. The radio representations are then formulated as semantic probes to highlight the corresponding entities in the visual scene through cross-modal fusion. Experiments using real-world RCooper dataset show that the resulting synergistic radio-visual embeddings enable accurate radio-visual user matching and significantly improve both user-specific visual localization and physical parameter estimation performance. The results substantiate the benefits of radio representation learning and semantically consistent fusion for multimodal semantic sensing.

0.30