CS Paper Radar

Over-the-Air Semantic Alignment via Dual Stacked Intelligent Metasurfaces

Mario Edoardo Pandolfo, Kyriakos Stylianopoulos, George C. Alexandropoulos, Paolo Di Lorenzo

eess.SP cs.LGstat.ML ·submitted 2026-11-14 17:21 UTC · v1
hot direction

Abstract

Semantic communications enable task-oriented information exchange, but suffer from latent-space mismatch when transmitter and receiver employ heterogeneous machine learning models. Existing semantic alignment methods rely on digital processing, introducing computational and latency overhead. This paper proposes a dual stacked intelligent metasurfaces (dual-SIM) architecture that performs semantic alignment entirely in the wave domain. By jointly exploiting programmable metasurfaces at both ends of a link and the wireless channel, the proposed architecture realizes an end-to-end linear transformation between heterogeneous latent spaces. We show phase-only multilayer SIM can approximate both supervised linear aligners and zero-shot Parseval-frame equalizers. We investigate single-SIM, disjoint asymmetric and symmetric dual-SIM, and jointly optimized dual-SIM configurations, considering channel equalization and constructive channel exploitation. For joint design, we develop an alternating projected gradient algorithm with convergence guarantees to first-order stationary points. We further introduce a deep-unrolled network that unrolls gradient-based iterations to reduce computational cost of SIM reconfiguration under channel variations. Numerical results with heterogeneous vision transformer encoders show accurate semantic alignment from moderate to high signal-to-noise ratios. The joint and symmetric disjoint dual-SIM designs achieve the highest accuracy over compact channels, the joint design leads at shallow stack depths, and the advantage over single-SIM designs diminishes at equal depth.

Closest papers

Nearest neighbours by meaning across the whole index.

Multi-User Precoding with Stacked Intelligent Metasurfaces via Neural Reparameterization

eess.SP ·2026-11-02 ·Yongqiang Zhang, Qurrat-Ul-Ain Nadeem
similarity 0.65
Abstract · 15 pages, 9 figures, Submitted to an IEEE journal for publication

Stacked intelligent metasurfaces (SIMs) enable wave-domain signal processing, and provide a promising architecture for enhancing spectral efficiency in multi-user wireless communication systems. However, jointly optimizing transmit power and multi-layer phase shifts in SIM-assisted wireless systems under quality-of-service (QoS) constraints results in a large-scale nonconvex problem, for which conventional numerical optimization-based methods, such as alternating optimization (AO), suffer from high computational burden and limited scalability. In this paper, we develop a QoS constraint-aware neural reparameterization framework for SIM-assisted downlink precoding. By embedding the cascaded wave-propagation structure of the SIM into a model-based differentiable architecture, both the phase shift configuration and transmit power allocation are reparameterized as parameters of a structured neural model that inherently satisfies feasibility constraints of the original problem. The resulting formulation enables efficient optimization that does not rely on a channel-to-precoding mapping learned through offline training. Instead, it directly updates the reparameterized optimization variables to realize real-time precoding for any channel realization. Simulation results demonstrate that the proposed method achieves superior sum rate performance under QoS constraints, while significantly improving computational efficiency compared with conventional numerical optimization approaches.

0.19

Wave-Domain Semantic Equalization Using a Practical Dynamic Metasurface Antenna with Strong Mutual Coupling

eess.SP physics.app-ph ·2026-09-27 ·Yassine Sghaier, Emilio Calvanese Strinati, Philipp del Hougne
similarity 0.65
Abstract · 5 pages with 3 figures

Semantic mismatch between independently trained AI-native agents in heterogeneous networks can impair semantic communications. Hybrid analog-digital semantic equalization can align the incompatible latent representations without retraining the semantic transceivers. We study a practical realization of this approach based on a fabricated dynamic metasurface antenna (DMA), an emerging low-cost, low-power, ultracompact technology for hybrid analog-digital beamforming. We model the DMA-assisted channel using multiport-network theory (MNT), accounting for mutual coupling (MC), structural scattering, and binary lossy tuning states. We use the experimentally estimated MNT parameters of our fabricated 19-GHz DMA prototype with strong MC. We jointly optimize digital pre- and post-equalizers and the DMA at a reference receiver geometry for latent-space alignment, then freeze the digital stages and adapt only the DMA after receiver motion. In our CIFAR-10 image-classification task at the receiver, the jointly optimized system achieves 94.5% accuracy, while DMA-only adaptation restores a median accuracy of 90.3% after receiver motion. Our semantic-aware wave-domain adaptation substantially outperforms semantic-unaware benchmarks. We further observe that varying the DMA configuration across channel uses provides little additional benefit for either semantic-aware or semantic-unaware optimization.

0.58

An Efficient SIM Beamforming Scheme Based on Physical-Empowered Projected Gradient

eess.SP ·2026-10-29 ·Yuzhi Yang, Hao Liu, Tianhao Guo, Jiancheng An, Lu Gan +2 more
similarity 0.62
Abstract · under review by ieee trans

Stacked Intelligent Metasurfaces (SIMs) have emerged as a promising technology for next-generation wireless systems. Especially in multi-input multi-output (MIMO) systems, it has the potential to realize complicated wave-domain transformations with low hardware costs and energy consumption. However, SIM-assisted MIMO systems face two major challenges in channel estimation and beamforming. As the SIM elements do not have the signal processing capability, channel estimation can only be conducted in an indirect manner, which makes it challenging. Moreover, the precoding optimization after channel estimation is non-convex and also difficult. Targeting these issues, we exploit the time-division duplex (TDD) channel reciprocity to calculate the gradient backpropagation in an over-the-air manner. Based on this structure, we propose a gradient-based optimization framework that optimizes beamforming without explicitly estimating the SIM--UE channel. The proposed method, namely the physical projected gradient descent (P2GD) method, optimizes the achievable sum rate while incorporating zero-forcing (ZF) constraints. Based on the method of incorporating the ZF restriction, we propose two variations of P2GD, namely user equipment (UE)-P2GD and base station (BS)-P2GD. We also provide a theoretical convergence analysis and projected gradient techniques to ensure physical feasibility. Simulation results show that the proposed approach can achieve suboptimal beamforming in the multi-user system within a small number of over-the-air iterations, using a per-direction signaling budget below the pilot cost of explicit SIM--UE channel estimation. The proposed method provides a low-overhead beamforming scheme for SIM systems without explicit SIM--UE channel estimation.

0.48

Stacked Intelligent Metasurface-Based MultiModal Feature Fusion for Collaborative Inference in Edge Networks

cs.DC ·2026-10-09 ·Yushi Wang, Zhengxin Yu, Guhan Zheng, Haris Pervaiz, Zheyi Chen +1 more
similarity 0.59
Abstract

In navigating the challenges of computational and communication overhead within the 6G-era Collaborative Inference (CI), this paper explores the feasibility of employing Stacked Intelligent Metasurface (SIM) to perform CI, termed SIM-CI. The SIM functions as a physical computing unit, receiving multi-user Over-The-Air (OTA) aggregated features within the same spectrum. It thus executes the necessary spatial-frequency combining and inference in a single physical wave propagation.SIM-CI also incorporates a tri-heterogeneity robustness adapter to address the network heterogeneity, such as multi-modal data and user inference models, as well as a quality-aware contrastive approach that align features from different modalities and extraction levels into a unified feature space. Considering the heterogeneous and dynamic channels, we further integrate Channel State Information (CSI) as an additional input into the adapter design, enabling users' early perception of potential channel states. Moreover, to maximally mitigate the impact of channel variations, we design a new hybrid beamforming network that combines the robustness of model-driven pre-equalization with the adaptability of data-driven learning. Experimental results demonstrate the effectiveness of our SIM-CI compared to digital-domain inference, achieving 98.6\% accuracy to conversional digital-domain CI approaches under various heterogeneous conditions, while reducing computational energy by 25\% and requiring 75\% fewer transmission time slots.

0.19

Towards High Semantic Fidelity: Hyperdimensional Symbolic Messages in Multi-Agent Communication

cs.MA ·2026-10-16 ·Shoucheng Song, Chang Yao, Hao Wu, Youfang Lin, Sheng Han +1 more
published similarity 0.59
Abstract · NeurIPS 2026 Accept

Semantic fidelity is essential for multi-agent communication under non-ideal channels, comprising transmission fidelity and conversion fidelity. Yet existing numerical and neural message formats cannot simultaneously achieve both. To address this, we propose a novel message format-\textbf{H}yperdimensional \textbf{S}ymbolic \textbf{M}essages (HSM) and its corresponding communication framework \textbf{Herm}. For transmission fidelity, Herm suppresses semantic entanglement via an entity-attribute-value structured encoding pipeline. For conversion fidelity, Herm first leverages a receiver-centric ego-binding mechanism to align semantics. Then, a similarity-aware dual-branch fusion module is proposed to prevent critical semantic dilution. To realize explicit message-semantic conversion, we devise an iterative decoding scheme via algebraic inverse operations. Experiments exhibit that Herm outperforms baselines across various noisy scenarios while maintaining superior structural readability.

0.29

Multimodal Semantic Communication using Shared and Unique Representation Decomposition

cs.IT eess.SP ·2026-11-11 ·Peng Yi, Ying-Chang Liang
similarity 0.58
Abstract · This work has been submitted to the IEEE for possible publication

Semantic communication (SemCom) has emerged as a promising paradigm for bandwidth-constrained mobile and vehicular networks. This paper proposes a unified representation learning framework for multimodal SemCom (MSC), which encodes heterogeneous data into a compact semantic space for efficient transmission and source recovery. The framework addresses the multimodal semantic representation gap, which arises when at least one modality contains semantic information that cannot be fully inferred from the other. To preserve this information for reconstruction, the framework decomposes each representation into shared and modality-specific components. We formulate a mutual information objective for source reconstruction, cross-modal alignment of the shared components, and decoupling of the shared and modality-specific components. To enhance transmission efficiency, we introduce a shared knowledge base implemented as a compact codebook of semantic vectors learned during training. The shared components are transmitted digitally as codebook indices, while the modality-specific components are sent in analog form. We apply knowledge distillation during training, using a pretrained vision foundation model to guide the learning of quantized shared features. On image--text pairs over additive white Gaussian noise (AWGN) and Extended Vehicular A (EVA) channels, the proposed framework improves image reconstruction over conventional separate source-channel coding (SSCC) and representative multimodal and unimodal SemCom systems. Further evaluations show gradual degradation under channel-estimation mismatch, complementary effects of alignment, decoupling, and knowledge distillation on the shared representation, and alignment of shared features across modalities with separation of the modality-specific features.

0.28

XL MIMO Extreme Learning Machines: Wave-Domain Inference with Stacked Metasurfaces

eess.SP cs.ETcs.LG ·2026-10-26 ·Kyriakos Stylianopoulos, Mattia Fabiani, Davide Dardari, George C. Alexandropoulos
similarity 0.57
Abstract · Submitted for journal publication

The recently envisioned goal-oriented communications paradigm requires machine learning inference to be performed directly on wirelessly transferred data, by splitting neural network computations between the transmitter, the Receiver (RX), and the wireless channel. Such approaches aim to offload large portions of the computation onto the channel itself, which is often controlled by reconfigurable MetaSurfaces (MSs). Typical MS-parametrized systems, however, enable only limited computation offloading in the wave domain, usually corresponding to a single neural network layer, due to adverse channel fading effects and the almost linear operation of the channel and conventional MS models. In this paper, we demonstrate that an eXtremely Large (XL) Multiple-Input Multiple-Output (MIMO) system equipped with Stacked Intelligent MSs (SIM) at the RX side, together with a single antenna and its accompanying radio-frequency chain, may act as a two-layer neural network operating exclusively over the air. The first (uncontrollable) network layer corresponds to the transformations offered by wireless fading, while the second (controllable) layer is implemented via SIM operations. In particular, only the first, front-end MS layer needs to exhibit nonlinear response to serve as an activation function. Leveraging the Extreme Learning Machine (ELM) framework, the proposed XL MIMO system architecture is shown to be a universal approximator, and the optimal linear-SIM-based combining is derived in closed form, allowing for fast training even and partial signal observability. Numerical evaluations across diverse datasets showcase that the proposed XL-MIMO-ELM framework achieves classification accuracy comparable to idealized digital models, thereby, proving the viability of low complexity, wave-domain neural computations.

0.38

Geometric Inductive Biases for Semi-Supervised Equalization: The Constellation-Aware Transformer

cs.LG cs.ITeess.SP ·2026-09-27 ·Avi Caciularu
top venueposition similarity 0.57
Abstract · accepted to NeurIPS 2026

Decoding signals over unknown channels with minimal pilot overhead is a critical challenge in next-generation communications. Existing deep learning approaches typically rely on generic encoders that struggle to model long-range temporal dependencies or efficiently capture the channel's physical properties from scarce data. We argue that standard architectures suffer from agnostic estimation gaps, as they must implicitly learn the constellation geometry that is already known. We introduce the Constellation-Aware Transformer (CAT), a novel architecture that explicitly injects geometric inductive biases into the equalization process. CAT is composed of a stack of custom TransFIRmer blocks, which use an "early interaction" paradigm to co-process received signals and ideal constellation symbols. Each block features a split Feed-Forward Network that applies a Finite Impulse Response (FIR)-inspired filter for deconvolution and a parallel MLP for geometric refinement. We show that this design is structurally aligned with the optimal linear (MIMO Wiener) receiver: its attention can implement a matched-filter bank, and its bidirectional FIR branch provides the non-causal filtering that block MMSE equalization requires. In the semi-supervised setting, CAT needs fewer pilots than VAE and standard Transformer baselines: on two of our three ISI channels, it reaches a lower SER with 64 pilots than they do with 128.

0.52