CS Paper Radar

Movable-Antenna Relay Enhanced Multiuser Communications: Reinforcement Learning-Based Antenna Positioning and Power Allocation

Yuanjun Zhang, Lipeng Zhu, Haobin Mao, Zhe Li, Zhenyu Xiao

eess.SP ·submitted 2026-10-14 13:03 UTC · v1

Abstract

Movable antenna (MA) has emerged as a promising technology for enhancing wireless communication performance by flexibly reconfiguring wireless channels via antenna movement. In this paper, we propose an MA relay-enhanced multiuser communication system that adopts a half-duplex decode-and-forward (DF) relay scheme. The relay node is equipped with an MA array, and a buffer is employed to enhance the end-to-end transmission performance. Specifically, we formulate an optimization problem to maximize the minimum average achievable rate among multiple users over a given transmission period by dynamically optimizing the positions of MAs, transmit power, and beamforming matrices, subject to the constraints on antenna movement, inter-antenna spacing, and total energy budget for antenna movement and transmission. To address this non-convex problem with highly coupled variables, we propose a reinforcement learning (RL)-based algorithm, where a twin delayed deep deterministic policy gradient (TD3) algorithm is utilized to optimize the antenna positions and power allocation, while the transmit and receive beamforming solutions are obtained through closed-form expressions in each time slot. Numerical results validate the efficacy of the proposed RL-based algorithm and demonstrate the superiority of the proposed MA relay-enhanced multiuser communication system over the conventional fixed-position antenna (FPA)-based relay system and other MA-based benchmarks.

Comment
Submitted to an IEEE Journal for possible publication

Closest papers

Nearest neighbours by meaning across the whole index.

Multi-Agent Reinforcement Learning for Movable Antenna-aided Cell-Free Massive MIMO Systems

cs.IT ·2026-10-06 ·Bokai Xu, Jiayi Zhang, Shuaifei Chen, Ziheng Liu, Huahua Xiao +2 more
published similarity 0.67
Abstract

The inherent non-convex minimum-separation constraints introduced by movable antennas present a formidable challenge to the joint optimization of antenna positions and transmission strategies, rendering conventional methods computationally infeasible, particularly in large-scale cell-free massive multiple-input multiple-output (MIMO). In this work, we propose the graph-based learning individual intrinsic reward heterogeneous-agent proximal policy optimization (GLIIR-HAPPO) algorithm, a novel heterogeneous multi-agent reinforcement learning (MARL) framework that fundamentally overcomes this impasse by systematically decomposing the original coupled optimization into coordinated subproblems. To ensure tractability, we embed the non-convex geometric constraints into a penalty-augmented reward structure and develop a specialized geometric solver that enables the positioning agents to efficiently navigate the high-dimensional action space. Specifically, we propose an architecture featuring a dynamic-interaction graph critic for adaptive cross-role coordination, together with role-conditioned federated distillation that synchronizes same-role policies through compact actor-output statistics. Beyond architectural design, we establish a rigorous theoretical analysis that derives monotonic performance improvement bounds and establishes convergence guarantees for the proposed bi-level optimization. Numerical simulations demonstrate that our framework yields significant sum-rate improvements over state-of-the-art MARL schemes. Moreover, the performance of our advanced architecture closely approaches its fully centralized counterpart, while drastically reducing communication overhead.

0.59

World Model for Energy Efficiency Maximization in Dynamic Metasurface Antennas

cs.IT eess.SY ·2026-10-26 ·Abdolrasoul Sakhaei Gharagezlou, Mehdi Monemi, Matti Latva-aho, Mehdi Rasti
similarity 0.65
Abstract

Dynamic metasurface antennas (DMAs) have emerged as a promising technology for realizing large-scale antenna arrays in next-generation wireless networks owing to their ability to enable dense and energy-efficient antenna architectures. However, jointly optimizing digital beamforming and DMA element weights under time-varying channel conditions remains challenging due to their coupled effects on the received signal and interference powers. We formulate this problem to maximize time-averaged energy efficiency (EE) under time-varying channel conditions, subject to transmit power constraints, Lorentzian phase limitations, and minimum rate requirements. To enable long-term planning and improve sample efficiency compared with model-free reinforcement learning, we develop a world model framework that learns latent system dynamics from interactions with the environment and jointly optimizes digital beamforming and DMA element weights through imagined trajectories. Furthermore, we incorporate feasibility-preserving action mappings and safety cost signals to ensure constraint satisfaction during policy learning. Simulation results demonstrate that the proposed framework improves the time-averaged EE by approximately 20% compared with the deep Q-network baseline, while achieving higher sample efficiency and more reliable constraint satisfaction.

0.32

GML-Based Optimization for Movable Antenna Wireless Networks: Challenges and Opportunities

eess.SP ·2026-08-13 ·Zhendong Li, Yujie Zhao, Zhou Su, Tom H. Luan, Zhiqing Wei +2 more
similarity 0.64
Abstract

Movable antenna (MA) is proposed as an emerging technology for future wireless networks. By leveraging the additional spatial degrees of freedom, MA can proactively reshape the wireless propagation environment, thereby enhancing network performance.However, fully unlocking the potential of MA networks necessitates the joint optimization of MA antenna positioning and beamforming. For this non-convex and highly coupled problem, existing solutions exhibit significant limitations. Therefore, this paper proposes a gradient-based meta learning (GML) optimization framework. Specifically, we first elaborate on the hardware architecture and channel characteristics of MA, based on which we analyze the primary challenges in optimizing MA wireless networks. Subsequently, we introduce the fundamental logic of the GML framework and compare it with existing methods. Furthermore, we discuss the constraint handling strategies for applying the proposed optimization framework to MA networks. A specific case is studied to show the performance of proposed framework based on numerical simulation. Finally, this paper outlines future research directions for both the GML framework and MA wireless networks.

0.04

Rotatable Antenna Relaying: Joint Precoding and Antenna Pointing Design

eess.SP ·2026-08-25 ·Ying Gao, Qingqing Wu, Wen Chen
similarity 0.64
Abstract · 13 pages,8 figures,submitted to an IEEE journal for possible publication

This paper investigates a rotatable antenna (RA)-enhanced half-duplex amplify-and-forward relaying system, where a multi-antenna base station (BS) serves multiple single-antenna users via a multi-antenna relay. The BS and users employ isotropic antennas, whereas the relay employs directional RAs whose pointing matrix is shared by both hops to avoid inter-hop reorientation delay and control overhead. We aim to maximize the minimum signal-to-interference-plus-noise ratio (SINR) among all users by jointly optimizing the BS precoding, relay precoding, and RA pointing matrices. To tackle this non-convex problem, we first investigate the single-user scenario and reduce the joint design to RA pointing optimization using the optimal relay precoding matrix available in closed form. A manifold-aware Frank--Wolfe (MFW) method is then employed to obtain a suboptimal pointing solution. Under a symmetric far-field line-of-sight geometry, we further characterize the globally optimal pointing structure and derive a directivity threshold separating common pointing from antenna splitting. Building on this MFW procedure, we next address the general multiuser scenario. Specifically, the quadratic transform is first applied to obtain an equivalent auxiliary-variable formulation, which is subsequently solved suboptimally via alternating optimization (AO). In particular, we employ a safeguarded extension of the MFW method based on log-sum-exp smoothing to update the RA pointing matrix in each AO iteration. Simulation results demonstrate that the proposed algorithms consistently achieve the best signal-to-noise ratio (SNR) and SINR performance among all considered schemes. It is further shown that the optimized RA pointing adapts to the two-hop geometry, the preferred directivity factor depends on user load, and relay placement with relatively balanced two-hop propagation conditions is generally preferable.

0.25

WiSDoM: Wireless Sparse Decision Transformer with Mixture-of-Experts for Multi-Task Mobile Network Optimization

cs.NI cs.AIcs.LG ·2026-08-31 ·Fatih Temiz, Shavbo Salehi, Melike Erol-Kantarci
similarity 0.63
Abstract · 13 pages, 11 figures, submitted to IEEE for possible publication

Emerging 6G wireless networks are expected to operate across diverse deployment scenarios, where variations in network topology, user mobility, traffic demand, and radio conditions challenge the scalability of conventional radio resource management (RRM). While offline reinforcement learning (RL) methods have demonstrated strong decision-making capabilities, learning a single policy that performs consistently across heterogeneous wireless environments remains difficult due to conflicting optimization objectives and limited model specialization. These challenges become particularly pronounced in coordinated multipoint (CoMP) transmission, where selecting the optimal serving-cell combination requires sequential decision-making under evolving network conditions. This paper presents the Wireless Sparse Decision Transformer with Mixture of Experts (WiSDoM), a sparse multi-task offline RL framework for adaptive multi-cell selection. WiSDoM combines Decision Transformers (DTs) with a Mixture-of-Experts (MoE) architecture that dynamically activates specialized experts according to task characteristics. This MoE mechanism improves model capacity without proportionally increasing inference cost, mitigates negative transfer, and enables expert specialization across tasks. WiSDoM is trained jointly on diverse network configurations spanning multiple base station and user equipment densities, mobility levels, and scheduler policies. Experimental results show that WiSDoM consistently outperforms heuristic methods, single-task models, and conventional multi-task DTs, improving quality of experience (QoE) by up to 55% while activating approximately one-third of the parameters of its dense counterpart during inference. Furthermore, WiSDoM exhibits strong task generalization and efficiently adapts to unseen wireless scenarios through few-shot prompting without retraining or fine-tuning.

0.34

DRL-Based AoI Minimization for RSMA in Finite-Blocklength MU-MISO

cs.IT ·2026-10-08 ·Enes Kaya, Mehmet Alp Demircioğlu, Elif Tugce Ceran, Melda Yuksel
publishedbenchmark similarity 0.63
Abstract

This letter investigates age-of-information (AoI) minimization in multi-user wireless networks operating in the finite-blocklength (FBL) regime, which is critical for low-latency transmission of short state-update packets. While rate-splitting multiple access (RSMA) provides a powerful and flexible framework for interference management in multi-user FBL systems, the joint optimization of its parameters, such as precoding vectors, power allocation, and rate-splitting ratios, to guarantee information freshness results in analytically intractable complexity. To address this challenge, we propose an actor--critic deep reinforcement learning (DRL) framework to learn dynamic resource-allocation policies in multi-user multiple-input single-output (MU-MISO) broadcast channels. Simulation results show that the proposed RSMA-RL framework achieves consistently lower AoI than the state-of-the-art benchmarks, with substantial gains observed at low signal-to-noise ratio (SNR) and short blocklengths, while matching benchmark performance at high SNR with significantly lower online complexity via a single neural-network forward pass at execution.

0.41

Movable Antenna Aided Robust Wireless Transmission: From Model-Based Optimization to Scalable Reinforcement Learning

eess.SP ·2026-11-03 ·Jinshuo Zhang, Yafei Wang, Hongwei Hou, Wenjin Wang, Shi Jin +2 more
hot direction similarity 0.63
Abstract · This work has been submitted to the IEEE for possible publication. Copyright may be transferred without notice, after which this version may…

This paper investigates robust joint antenna positioning and precoding for multiuser movable antenna (MA) systems under imperfect channel state information (CSI). First, we identify the mismatch between the spatial statistics of densely sampled MA channels and the discrete Fourier transform (DFT) basis used for conventional robust precoding. To address this, we develop a novel discrete prolate spheroidal sequence (DPSS)-based a posteriori channel model. By exploiting the spatial covariance structure of MA channels, this model is better suited to modeling MA channel uncertainty. Building on this model, we develop an efficient iterative algorithm for robust joint antenna positioning and precoding to maximize the expected sum rate. By transforming the coupled optimization of antenna positioning and precoding at each iteration into direct comparisons of closed-form scores, we design a low-complexity position replacement scheme that effectively reuses matrix computations across candidate sets. To further improve efficiency and scalability, we exploit the inherent tensor equivariance (TE) of the problem to develop a reinforcement learning framework. To explicitly account for channel uncertainty, we develop novel pairwise user-interaction and CSI-conditioned equivariant attention mechanisms to encode channel statistics and adaptively fuse them with the available CSI. We further introduce distance-biased spatial attention to incorporate the geometry of candidate positions into attention weighting, thereby enhancing spatial feature learning. Simulation results show that the proposed methods improve sum-rate performance while reducing online runtime under imperfect CSI. These methods also achieve near-optimal performance under perfect CSI, closely matching the exhaustive-search method. Moreover, the learning framework generalizes across different numbers of users and MAs without retraining.

0.30

When to Move: Online Repositioning of Movable Antenna Arrays Under a Long-Term Actuation Energy Budget

eess.SP ·2026-11-13 ·Yunseob Tae, Jeongjae Lee, Songnam Hong
similarity 0.62
Abstract · This work was intended as a replacement of arXiv:2609.25439 and any subsequent updates will appear there

Movable antenna (MA) arrays improve multiuser throughput by repositioning their elements, but mechanical movement reduces transmission time and consumes actuation energy. Changes in user configurations create nonuniform demand for repositioning over time, while each movement determines which positions are reachable in subsequent slots. Thus, online control must decide when to spend a limited actuation-energy budget, not only where to position the antennas. We formulate causal effective-throughput maximization under displacement-dependent movement delay, inter-slot reachability, and a long-term average actuation-energy constraint. We propose Lyapunov-based online movable-antenna repositioning (LOMA), which adjusts the price of movement through a virtual queue and solves the resulting nonconvex position problem via proximal minorization--maximization, accounting for nonsmooth movement delay and promoting sparse antenna updates. We establish monotone ascent of the smoothed per-slot objective, a finite-horizon sample-path energy bound, almost-sure long-term budget feasibility under a Gaussian fading model with bounded large-scale gains, and a state-matched throughput comparison separating temporal energy allocation from per-slot optimization error. Simulations show that LOMA concentrates actuation after intermittent user changes and improves effective throughput over optimized fixed arrays and a per-slot-budget counterpart, while continuous channel drift favors more frequent incremental repositioning. Additional simulations with pilot-based channel estimates in sparse millimeter-wave channels show that LOMA retains most of the throughput benefits of online repositioning while operating near its prescribed long-term actuation-energy budget.

0.05