CS Paper Radar

Low-Altitude Fluid Antenna Network with Multi-Agent Reinforcement Learning

Tong Zhang, Yanfei Su, Shuai Wang, Wanli Ni, Chengzhong Xu, Huseyin Arslan

cs.IT cs.AI ·submitted 2026-08-28 04:27 UTC · v1
published

Abstract

Low-altitude wireless networks (LAWNs) integrate terrestrial and aerial platforms to provide ubiquitous communication, sensing, and localization services for unmanned aerial vehicles (UAVs) and electric vertical takeoff and landing (eVTOL) aircraft. However, dynamic air-ground and air-air channels, abrupt blockages, and heterogeneous interference hinder the realization of this goal. Nevertheless, fluid antenna (FA), a cutting-edge multiple-input multiple-output (MIMO) technique, overcomes these challenges by reconfiguring antenna positions to unlock additional spatial degrees-of-freedom. In this paper, towards bringing low-altitude FA networks into reality, we study the fast and high-performance FA reconfiguration for low-altitude FA networks with multi-agent reinforcement learning (MARL). Specifically, we present an electromagnetic digital twin (EM-DT)-assisted MARL framework. To fill the sim-to-real gap, we introduce a two-stage transfer learning framework. Our case study shows that joint FA positions and beamforming optimization can enhance the system sum-rate by 118.5%, compared to the fixed position baseline. This gain comes from the dynamic millisecond timescale reconfiguration of FA arrays and the adaptive steering of beams toward aerial users with mobility.

Comment
Accepted by IEEE Communications Magazine

Closest papers

Nearest neighbours by meaning across the whole index.

Lightweight AI for UAV-Mounted RIS: An Overview

cs.NI ·2026-08-26 ·Sherief Hashima, Kohei Hatano, Eiji Takimoto, Mohamed Rihan, Basem. M. Elhalawany +1 more
survey similarity 0.67
Abstract

Unmanned Aerial Vehicles (UAV)-mounted Reconfigurable Intelligent Surfaces (RIS) have emerged as a promising architecture for enhancing wireless coverage, spectral efficiency, and energy performance in 6G networks. By combining programmable electromagnetic wave manipulation with aerial mobility, UAV-RIS systems enable dynamic blockage mitigation, adaptive beamforming, and flexible deployment across terrestrial, maritime, and satellite-integrated environments. However, joint optimization of UAV trajectory, RIS phase configuration, and resource allocation incurs high computational complexity, which is incompatible with the strict energy and onboard processing constraints of UAV platforms. Lightweight AI techniques offer practical solutions to this challenge. Hence, this paper provides a comprehensive overview of lightweight AI techniques for UAV-mounted RIS systems, including Reinforcement Learning (RL), meta-learning, Federated Learning (FL), Multi-Armed Bandits (MAB), and energy-aware optimization. We present a detailed taxonomy and comparative analysis of existing work, highlight computational-energy trade-offs, and identify open research challenges for scalable, energy-efficient airborne intelligent surfaces. Furthermore, we present a case study demonstrating the effect of MAB schemes on throughput and energy efficiency in UAV-mounted RIS.

0.25

Agentic AI Networking for Heterogeneous Unmanned Aerial Systems in Low-Altitude Wireless Networks

cs.AI cs.MA ·2026-09-17 ·Nguyen Duc Minh Quang, Chang Liu, Shuangyang Li, Derrick Wing Kwan Ng
similarity 0.64
Abstract

Low-altitude wireless networks (LAWNs) are emerging as a key infrastructure for heterogeneous unmanned aerial systems that support concurrent services within a shared three-dimensional airspace. Their coexistence creates strong coupling among mobility, connectivity, and shared network resources, while heterogeneous services impose distinct and time-varying requirements. These interactions naturally form a dynamic non-cooperative game in which both operating conditions and coordination objectives evolve over time. Conventional optimization and learning-based controllers typically rely on predefined objectives, limiting their ability to adapt autonomously to changing service requirements and resource priorities. To address this challenge, we propose a hierarchical hybrid large language model (LLM)- multi-agent reinforcement learning (MARL) architecture organized as a dual-loop structure. Specifically, an outer adaptation loop employs LLM-assisted game orchestration to interpret service requirements and operator intent, and reconfigure objectives and resource priorities, while an inner loop executes decentralized, parameter-conditioned MARL policies under the configured game. A logistics-monitoring case study illustrates how the proposed framework facilitates coordinated coexistence among heterogeneous services, adapting to evolving operating conditions without retraining the underlying MARL policies. Finally, we discuss key challenges and research directions toward scalable, trustworthy, and adaptive agentic LAWNs.

0.24

Fluid Antennas Enabled UAV Communication Systems: Fundamentals, Challenges, and Future Directions

eess.SP ·2026-10-26 ·Wenchao Liu, Weijie Yuan, Jun Wu, Jinke Ren, Xuhui Zhang +1 more
similarity 0.62
Abstract

Low-altitude wireless networks (LAWNs) require uncrewed aerial vehicle (UAV) communication systems to adapt to large-scale propagation changes and fast local channel fluctuations. Fluid antennas (FAs) provide an additional degree of freedom (DoF) by reconfiguring antenna positions within a compact aperture. This article investigates FA-enabled UAV communication systems from the perspectives of fundamentals, design challenges, and future research directions. We first introduce a dual-mobility perspective, in which UAV trajectory planning provides macro-mobility for large-scale air-to-ground geometry adaptation, and FA position reconfiguration provides micro-mobility for fine-grained local channel adaptation. We then identify key design challenges arising from the high computational complexity and information uncertainty in the joint optimization of UAV trajectory, FA positions, and beamforming under mobility, energy, hardware, and security constraints. To address these challenges, we present a hybrid offline-online optimization framework, where prior information such as environment maps, user mobility patterns, and statistical channel state information (CSI) supports long-term planning, while real-time information such as instantaneous CSI and UAV state enables fast online correction. A case study on FA-enabled UAV-assisted vehicular communications demonstrates the effectiveness of the proposed framework. Finally, we discuss future directions of FA-enabled UAV communication in integrated sensing and communication (ISAC), secure communication, mobile edge computing (MEC), and aerial relaying.

0.14

Multi-Agent Reinforcement Learning for Movable Antenna-aided Cell-Free Massive MIMO Systems

cs.IT ·2026-10-06 ·Bokai Xu, Jiayi Zhang, Shuaifei Chen, Ziheng Liu, Huahua Xiao +2 more
published similarity 0.62
Abstract

The inherent non-convex minimum-separation constraints introduced by movable antennas present a formidable challenge to the joint optimization of antenna positions and transmission strategies, rendering conventional methods computationally infeasible, particularly in large-scale cell-free massive multiple-input multiple-output (MIMO). In this work, we propose the graph-based learning individual intrinsic reward heterogeneous-agent proximal policy optimization (GLIIR-HAPPO) algorithm, a novel heterogeneous multi-agent reinforcement learning (MARL) framework that fundamentally overcomes this impasse by systematically decomposing the original coupled optimization into coordinated subproblems. To ensure tractability, we embed the non-convex geometric constraints into a penalty-augmented reward structure and develop a specialized geometric solver that enables the positioning agents to efficiently navigate the high-dimensional action space. Specifically, we propose an architecture featuring a dynamic-interaction graph critic for adaptive cross-role coordination, together with role-conditioned federated distillation that synchronizes same-role policies through compact actor-output statistics. Beyond architectural design, we establish a rigorous theoretical analysis that derives monotonic performance improvement bounds and establishes convergence guarantees for the proposed bi-level optimization. Numerical simulations demonstrate that our framework yields significant sum-rate improvements over state-of-the-art MARL schemes. Moreover, the performance of our advanced architecture closely approaches its fully centralized counterpart, while drastically reducing communication overhead.

0.59

XL MIMO Extreme Learning Machines: Wave-Domain Inference with Stacked Metasurfaces

eess.SP cs.ETcs.LG ·2026-10-26 ·Kyriakos Stylianopoulos, Mattia Fabiani, Davide Dardari, George C. Alexandropoulos
similarity 0.61
Abstract · Submitted for journal publication

The recently envisioned goal-oriented communications paradigm requires machine learning inference to be performed directly on wirelessly transferred data, by splitting neural network computations between the transmitter, the Receiver (RX), and the wireless channel. Such approaches aim to offload large portions of the computation onto the channel itself, which is often controlled by reconfigurable MetaSurfaces (MSs). Typical MS-parametrized systems, however, enable only limited computation offloading in the wave domain, usually corresponding to a single neural network layer, due to adverse channel fading effects and the almost linear operation of the channel and conventional MS models. In this paper, we demonstrate that an eXtremely Large (XL) Multiple-Input Multiple-Output (MIMO) system equipped with Stacked Intelligent MSs (SIM) at the RX side, together with a single antenna and its accompanying radio-frequency chain, may act as a two-layer neural network operating exclusively over the air. The first (uncontrollable) network layer corresponds to the transformations offered by wireless fading, while the second (controllable) layer is implemented via SIM operations. In particular, only the first, front-end MS layer needs to exhibit nonlinear response to serve as an activation function. Leveraging the Extreme Learning Machine (ELM) framework, the proposed XL MIMO system architecture is shown to be a universal approximator, and the optimal linear-SIM-based combining is derived in closed form, allowing for fast training even and partial signal observability. Numerical evaluations across diverse datasets showcase that the proposed XL-MIMO-ELM framework achieves classification accuracy comparable to idealized digital models, thereby, proving the viability of low complexity, wave-domain neural computations.

0.38

Adaptive Beam Hopping and Power Control for Dual-Layer Over-the-Air Online Federated Learning in LEO Satellite Networks

cs.IT eess.SP ·2026-09-02 ·Zhendong Li, Shaojie Wang, Zhou Su, Zihao Zhang, Haixia Peng +3 more
benchmark similarity 0.61
Abstract

This paper investigates over-the-air (OTA) computation enabled online federated learning (FL) in low-Earth orbit (LEO) satellite networks. Specifically, we consider a dual-layer OTA aggregation architecture, where ground devices upload analog model updates to serving satellites via uplink OTA aggregation, and satellites forward the aggregated signals to a data processing center through the second round OTA aggregation. Then, we formulate a long-term data-utilization maximization problem in which devices continuously collect new data and untrained samples gradually lose freshness. The problem is subject to the satellite beam budget, transmit-power limit, and global mean squared error (MSE) constraint that governs end-to-end aggregation distortion. This yields a coupled mixed-integer nonlinear programming (MINLP) problem, involving tightly coupled discrete beam-hopping decisions and continuous power control. Due to the combinatorial action space and nonconvex constraints, the problem is NP-hard and computationally intractable. Furthermore, the time-varying satellite topology and dynamic data generation render it a sequential decision-making problem, necessitating adaptive online scheduling. To address these issues, we cast the problem as a Markov decision process and develop a proximal policy optimization (PPO)-based deep reinforcement learning framework that jointly optimizes adaptive beam hopping and power control, using an MSE-aware reward to balance data utilization and aggregation accuracy. Numerical simulation results verify that the proposed algorithm consistently outperforms other benchmark schemes, achieving superior long-term data utilization and faster FL convergence while satisfying the MSE requirement.

0.17

Non-Coherent Over-the-Air Federated Learning: Protocol, Convergence, and Device Scheduling

cs.IT cs.LGeess.SP ·2026-09-08 ·Haifeng Wen, Nicolò Michelusi, Osvaldo Simeone, Yang Yang, Hong Xing
theory similarity 0.60
Abstract · 13 pages, 8 figures, submitted for possible journal publication

To mitigate the scalability bottleneck in the radio access network (RAN) in federated edge learning (FEEL), over-the-air federated learning (AirFL) exploits waveform superposition over multiple-access channels (MACs) for analog model aggregation. However, coherent AirFL typically relies on stringent PHY-layer conditions such as accurate channel state information (CSI), tight time/frequency synchronization, and frequent transceiver calibration for signal alignment. However, these requirements, if not impossible to be met, incur substantial communication and computation overhead. In this paper, we propose a non-coherent AirFL (NCAirFL) protocol over a broadband single-antenna MAC, leveraging binary dithering, unbiased non-coherent detection, and long-term error feedback to waive the need for instantaneous CSI. For NCAirFL with general smooth non-convex objectives and a constant learning rate, we establish a convergence bound achieving the convergence rate in the same order of $\mathcal{O}(1/\sqrt{T})$ as communication-ideal FedAvg, where $T$ is the total number of communication rounds. To further improve communication efficiency under data and wireless resource heterogeneity, we also derive a lower bound on the expected single-round objective decrease in the global loss conditioned on device scheduling, building upon which a surrogate objective function is obtained for jointly optimal device selection and power control. Experimental results on MNIST and CIFAR-10 corroborate that NCAirFL achieves learning performance close to FedAvg in practical settings, with the proposed device scheduling policy substantially accelerating convergence.

0.32

Movable-Antenna Relay Enhanced Multiuser Communications: Reinforcement Learning-Based Antenna Positioning and Power Allocation

eess.SP ·2026-10-14 ·Yuanjun Zhang, Lipeng Zhu, Haobin Mao, Zhe Li, Zhenyu Xiao
similarity 0.60
Abstract · Submitted to an IEEE Journal for possible publication

Movable antenna (MA) has emerged as a promising technology for enhancing wireless communication performance by flexibly reconfiguring wireless channels via antenna movement. In this paper, we propose an MA relay-enhanced multiuser communication system that adopts a half-duplex decode-and-forward (DF) relay scheme. The relay node is equipped with an MA array, and a buffer is employed to enhance the end-to-end transmission performance. Specifically, we formulate an optimization problem to maximize the minimum average achievable rate among multiple users over a given transmission period by dynamically optimizing the positions of MAs, transmit power, and beamforming matrices, subject to the constraints on antenna movement, inter-antenna spacing, and total energy budget for antenna movement and transmission. To address this non-convex problem with highly coupled variables, we propose a reinforcement learning (RL)-based algorithm, where a twin delayed deep deterministic policy gradient (TD3) algorithm is utilized to optimize the antenna positions and power allocation, while the transmit and receive beamforming solutions are obtained through closed-form expressions in each time slot. Numerical results validate the efficacy of the proposed RL-based algorithm and demonstrate the superiority of the proposed MA relay-enhanced multiuser communication system over the conventional fixed-position antenna (FPA)-based relay system and other MA-based benchmarks.

0.43