CS Paper Radar

Adaptive Beam Hopping and Power Control for Dual-Layer Over-the-Air Online Federated Learning in LEO Satellite Networks

Zhendong Li, Shaojie Wang, Zhou Su, Zihao Zhang, Haixia Peng, Nan Cheng, Ying Wang, Wen Chen

cs.IT eess.SP ·submitted 2026-09-02 22:34 UTC · v2
benchmark

Abstract

This paper investigates over-the-air (OTA) computation enabled online federated learning (FL) in low-Earth orbit (LEO) satellite networks. Specifically, we consider a dual-layer OTA aggregation architecture, where ground devices upload analog model updates to serving satellites via uplink OTA aggregation, and satellites forward the aggregated signals to a data processing center through the second round OTA aggregation. Then, we formulate a long-term data-utilization maximization problem in which devices continuously collect new data and untrained samples gradually lose freshness. The problem is subject to the satellite beam budget, transmit-power limit, and global mean squared error (MSE) constraint that governs end-to-end aggregation distortion. This yields a coupled mixed-integer nonlinear programming (MINLP) problem, involving tightly coupled discrete beam-hopping decisions and continuous power control. Due to the combinatorial action space and nonconvex constraints, the problem is NP-hard and computationally intractable. Furthermore, the time-varying satellite topology and dynamic data generation render it a sequential decision-making problem, necessitating adaptive online scheduling. To address these issues, we cast the problem as a Markov decision process and develop a proximal policy optimization (PPO)-based deep reinforcement learning framework that jointly optimizes adaptive beam hopping and power control, using an MSE-aware reward to balance data utilization and aggregation accuracy. Numerical simulation results verify that the proposed algorithm consistently outperforms other benchmark schemes, achieving superior long-term data utilization and faster FL convergence while satisfying the MSE requirement.

Closest papers

Nearest neighbours by meaning across the whole index.

Dual-Layer Over-the-Air Federated Learning in LEO Satellite Networks: Architecture, Key Technologies and Applications

eess.SP ·2026-08-14 ·Zhendong Li, Shaojie Wang, Zhou Su, Tom H. Luan, Ruijin Sun +2 more
similarity 0.74
Abstract

Low Earth orbit (LEO) satellite networks are emerging as a pivotal infrastructure for global edge intelligence. In this context, integrating over-the-air (OTA) computation with adaptive beam hopping (BH) provides an innovative framework that seamlessly merges physical-layer analog aggregation with dynamic resource orchestration. This effectively overcomes the stringent bandwidth and power constraints of space platforms while extending federated learning (FL) to pervasive Internet-of-things (IoT) deployments. In this article, we first outline the fundamental principles of the dual-layer OTA model and introduce the adaptive BH mechanism designed for time-varying topologies. Then, we summarize the distinct advantages of this learning-centric architecture, which include decoupling aggregation latency from device density, optimizing spatio-temporal resource efficiency, and balancing data freshness with channel quality. Several application scenarios are explored to highlight the framework's potential across diverse vertical industries. Furthermore, a specific case is studied to demonstrate the practical efficacy of the proposed scheduling policy. The results reveal substantial performance gains in terms of model convergence speed and data utilization for satellite-based FL systems. Finally, we discuss the implementation challenges and outline future research directions, aiming to provide insights for the evolution of ubiquitous non-terrestrial intelligence.

0.04

Hierarchical Asynchronous Federated Learning over Space-Air-Ground Integrated Networks

cs.LG ·2026-10-31 ·Kai Wang, Chee Wei Tan
publishedbenchmark similarity 0.69
Abstract

With the emerging 6G paradigm where AI services operate over decentralized and resource-constrained edge infrastructure, performance of distributed learning algorithms remains a significant challenge. This paper proposes HAFL, a Low Earth Orbit (LEO) satellite-assisted hierarchical asynchronous Federated Learning (FL) framework, enabling resource-limited terrestrial clients to collaborate via Ground-Satellite Links (GSLs). Within this framework, LEO satellites serve multiple roles: as edge servers aggregating and broadcasting models, as clients accelerating training, and as high-throughput relays managing inter-satellite routing through Inter-Satellite Links (ISLs). Unlike conventional synchronous Jacobian-type updates, HAFL employs asynchronous Gauss-Seidel-type updates to enhance convergence speed. We provide theoretical convergences for convex, strongly convex, and nonconvex objectives, respectively, and formulate optimization problems to jointly determine optimal hyperparameters to minimize global training latency. Evaluations demonstrate that HAFL achieves faster initial convergence and comparable final performance for benchmark DNNs and datasets, offering promising FL systems across remote areas with 6G technologies, but much less global rounds and communication cost.

0.45

Multi-Agent Reinforcement Learning for Joint Handover Management and Power Allocation in Multi-Orbit Satellite Networks

eess.SP eess.SY ·2026-08-14 ·Yassine Afif, Ashutosh Balakrishnan, Philippe Martins, Mohammed Almekhlafi, Antoine Lesage-Landry +1 more
similarity 0.67
Abstract

Future sixth-generation non-terrestrial networks are expected to combine low Earth orbit (LEO), medium Earth orbit (MEO), and geostationary Earth orbit (GEO) satellites, whose complementary layers must be coordinated through joint user association, power allocation, and handover management under fast LEO dynamics. This paper studies this problem by formulating it as a mixed-integer nonlinear program and decomposing it into a multi-agent reinforcement learning (MARL) policy that selects the associations and a convex power-allocation subproblem solved exactly at each time slot that defines the reward of the MARL part. The association policy is trained with multi-agent proximal policy optimization (MAPPO) and the targeted multi-agent communication (TarMAC) mechanism, and is made aware of the orbital layer through a state that encodes layer-dependent handover penalties. Evaluated on a realistic multi-constellation scenario built from real two-line element data over Nairobi, Kenya, the proposed policy reaches 92% of the throughput of a greedy signal-to-noise ratio (SNR) maximizing scheme while triggering more than four times fewer handovers, and improves throughput by roughly 14% over a conservative stay heuristic. Compared to an LEO-only learned policy of identical architecture, it attains slightly higher throughput with fewer handovers by offloading a fraction of the users to the MEO and GEO layers, an emergent multi-orbit behavior that drives its favorable throughput and handover trade-off.

0.04

ParaBlock++: Communication-Computation Parallel Blockwise Hierarchical Federated Learning

cs.LG ·2026-10-31 ·Kai Wang, Chee Wei Tan
similarity 0.67
Abstract · A journal version extended from the published conference version

In the emerging 6G paradigm, where AI-driven services operate over decentralized and resource-constrained infrastructures, the convergence of distributed learning algorithms remains a significant challenge. This paper introduces $\mathrm{ParaBlock}$++, a low Earth orbit (LEO) satellite-assisted hierarchical federated learning (HFL) framework, enabling resource-limited terrestrial clients to collaboratively engage in federated learning (FL) via ground-satellite links (GSLs) supported by LEO satellite megaconstellations. Within this architecture, LEO satellites serve multiple roles: as edge servers aggregating and broadcasting models, as clients accelerating training, and as high-throughput relays managing inter-satellite routing through inter-satellite links (ISLs). Departing from conventional synchronous Jacobian-type updates, $\mathrm{ParaBlock}$++ employs asynchronous BCD-type updates to enhance convergence speed. We provide theoretical convergence guarantees for convex, strongly convex, and non-convex objectives, and formulate optimization problems to determine optimal cluster resource allocation and model partitioning for minimizing global training latency. Experimental evaluations demonstrate that $\mathrm{ParaBlock}$++ achieves faster initial convergence and comparable final performance for deep neural networks (DNNs) such as ResNet-18, offering promising directions for federated learning across geographically remote areas enabled by 6G technologies, but much less global rounds and communication cost.

0.19

Demand-Aware Cooperative Transmission Design for Energy-Efficient LEO Satellite Networks

cs.IT eess.SP ·2026-08-10 ·Wooseok Cha, Kyeongsoo Kim, Seonghoon Kim, Junil Choi, Jihwan P. Choi
top venuebenchmark similarity 0.63
Abstract · 17 pages, 12 figures, accepted to IEEE Transactions on Wireless Communications

Low Earth orbit (LEO) satellite networks are envisioned as a promising solution for providing ubiquitous connectivity and narrowing the digital divide. The extensive footprint of LEO satellite constellations enables broad coverage, resulting in spatially non-uniform traffic demand across the serviced areas. Meanwhile, stringent on-board power constraints make power-intensive transmission architectures less attractive and motivate energy-efficient transmission strategies that effectively exploit scarce satellite network resources. To this end, this paper proposes a cooperative transmission framework that jointly accounts for non-uniform traffic demand and network-wide power consumption. Each LEO satellite integrates hybrid precoding (HPC), radio frequency (RF) chain activation, and hardware quantization, while user-equipment (UE)-centric satellite clusters are organized using statistical channel state information (sCSI) and traffic demands. A framework for joint optimization of cooperative transmission architecture and resource allocation is designed to maximize demand-aware energy efficiency (EE), resulting in a mixed-integer nonlinear program (MINLP) for which finding a globally optimal solution is generally intractable. Accordingly, a two-stage algorithm is developed under a distributed linear precoding structure, in which a modified cross-entropy (CE) method searches over discrete variables, while fractional programming is employed for transmit power allocation. Numerical results indicate that the proposed framework outperforms benchmark schemes while accounting for traffic demands and EE.

0.35

Topology-Aware Cooperative Beam-Hopping Scheduling for Efficient Resource Allocation in LEO Satellite Systems

cs.NI ·2026-10-08 ·Shuang Zheng, Xing Zhang, Quan Z. Sheng, Wenbo Wang
published similarity 0.63
Abstract · 5 pages, 5 figures, accepted

The dynamic topology and heterogeneous traffic demands of multi-satellite systems present substantial challenges for beam-hopping (BH) resource management. This letter develops a topology-aware cooperative BH framework for multi-satellite systems under partial observability. A lightweight load-balancing scheme first determines the serving relationships, which are then exploited to construct an association-induced satellite-user graph. A two-phase graph neural network (GNN) extracts episode-level topology-aware structural identities for parameter-sharing agents, while a recurrent multi-agent proximal policy optimization (MAPPO) policy handles slot-level dynamics for joint beam scheduling and onboard power control. Simulation results demonstrate notable gains in energy efficiency, throughput, and fairness over the baselines.

0.27

Geometry-Aware DRL for Multi-Subband Scheduling in Satellite-Assisted UAM Networks

eess.SP ·2026-08-18 ·Hyung-Joo Moon, Sangha Park, Chan-Byoung Chae, Robert W. Heath
similarity 0.62
Abstract · 16 pages, 14 figures

In this paper, we investigate downlink scheduling for urban air mobility (UAM) in a cooperative space-air-ground integrated network. Multiple ground stations (GSs) employ narrow three-dimensional beams and share spectrum across multiple subbands, while a satellite provides an orthogonal-band service option. Rapidly time-varying geometry and directional interference require joint decisions on base station association, GS subband assignment, and transmit powers. We formulate a finite-horizon mixed discrete-continuous problem that maximizes sum rate while penalizing handovers and GS overload, using only UAM positions and velocities. To address the combinatorial scheduling problem, we propose GeoSetPPO, a geometry-aware set-attention proximal policy optimization (PPO) method that outputs per-UAM discrete association and subband decisions with permutation-invariant representations. Conditioned on each schedule, GS powers are computed by a per-slot successive convex approximation (SCA) module under per-GS power budgets and minimum signal-to-interference-plus-noise ratio (SINR) constraints. To reduce training cost and improve stability, we adopt a two-stage training strategy that transitions reward evaluation from uniform power to SCA-based power allocation. Simulations demonstrate stable convergence, higher returns than multi-layer perceptron (MLP)- and Transformer-based PPO under the considered training setting, and favorable reward and schedule-feasibility performance relative to algorithm-based and distance-based schedulers. In the larger evaluated network, GeoSetPPO also reduces the scheduling latency from 40.84 ms to 2.90 ms relative to the previous algorithm-based method.

0.34

Interference-Graph-Aided Multi-Agent Reinforcement Learning for Beam Hopping LEO Satellite Networks

eess.SP ·2026-10-20 ·Hao Yuan, Ziyi Yang, Xing Zhang
similarity 0.61
Abstract

Beam hopping technology enables LEO satellites to dynamically switch beam coverage positions, providing flexible resource allocation for non-uniformly distributed traffic demands. However, the severe spatial interference coupling among beams makes coordinated scheduling challenging. To address this problem, in this letter, we propose an interference-graph-aided multi-agent reinforcement learning approach that constructs an interference graph to capture beam coupling relationships and injects this structural prior into agent-side representation learning. Each beam agent aggregates information from interference neighbors via graph convolution before estimating local Q-values, which are then decomposed by the standard mixing network. Simulation results demonstrate that the proposed method achieves 34.4\% higher throughput than QMIX with more stable interference management, under non-uniform traffic and co-channel interference settings.

0.14