CS Paper Radar

Geometry-Aware DRL for Multi-Subband Scheduling in Satellite-Assisted UAM Networks

Hyung-Joo Moon, Sangha Park, Chan-Byoung Chae, Robert W. Heath

eess.SP ·submitted 2026-08-18 10:22 UTC · v1

Abstract

In this paper, we investigate downlink scheduling for urban air mobility (UAM) in a cooperative space-air-ground integrated network. Multiple ground stations (GSs) employ narrow three-dimensional beams and share spectrum across multiple subbands, while a satellite provides an orthogonal-band service option. Rapidly time-varying geometry and directional interference require joint decisions on base station association, GS subband assignment, and transmit powers. We formulate a finite-horizon mixed discrete-continuous problem that maximizes sum rate while penalizing handovers and GS overload, using only UAM positions and velocities. To address the combinatorial scheduling problem, we propose GeoSetPPO, a geometry-aware set-attention proximal policy optimization (PPO) method that outputs per-UAM discrete association and subband decisions with permutation-invariant representations. Conditioned on each schedule, GS powers are computed by a per-slot successive convex approximation (SCA) module under per-GS power budgets and minimum signal-to-interference-plus-noise ratio (SINR) constraints. To reduce training cost and improve stability, we adopt a two-stage training strategy that transitions reward evaluation from uniform power to SCA-based power allocation. Simulations demonstrate stable convergence, higher returns than multi-layer perceptron (MLP)- and Transformer-based PPO under the considered training setting, and favorable reward and schedule-feasibility performance relative to algorithm-based and distance-based schedulers. In the larger evaluated network, GeoSetPPO also reduces the scheduling latency from 40.84 ms to 2.90 ms relative to the previous algorithm-based method.

Comment
16 pages, 14 figures

Closest papers

Nearest neighbours by meaning across the whole index.

SINR-Aware Adaptive Offloading and Resource Allocation in Shared-Spectrum Integrated Terrestrial and Non-Terrestrial Networks

eess.SP ·2026-10-31 ·Aman Khalid, Muhammad Sohaib Aslam, Ahmed Naeem, Seyit Karatepe, Muhammet Kirik +1 more
theory similarity 0.67
Abstract

Sharing the sub-6~GHz spectrum between terrestrial networks and low Earth orbit satellites introduces cross-tier interference in both directions, as terrestrial transmissions can degrade satellite-link reception, while satellite transmissions can impair the performance of terrestrial links. Conventional reference signal received power (RSRP)-based offloading, designed for separate frequency bands, does not account for this cross-tier interference. We study offloading and resource allocation in an integrated terrestrial and non-terrestrial network through a two-timescale framework in which signal-to-interference-plus-noise ratio (SINR)-aware adaptive traffic offloading (SAATO) updates user associations from filtered SINR and load-aware expected throughput, switching a user only across a hysteresis band, while joint cross-tier fractional programming (Joint-FP) optimizes resource allocation for the resulting associations. Under an equal-share resource allocation model, the resulting decision metric approximates the change in proportional-fair utility with an error that decays with load. We prove that joint allocation under the sum-rate utility is nondeterministic polynomial-time (NP)-hard and that the utility sequence accepted by Joint-FP is non-decreasing and convergent. At full spectral overlap, RSRP-based offloading leaves 44\% of user samples below 0.5~Mbps (outage), whereas SAATO with Joint-FP, given instantaneous channel knowledge, leaves none and increases geometric-mean throughput by 8\% and 2\% under half and full spectral overlap, respectively, relative to power control without offloading. It also limits tier switching to at most 0.05 switches per user per minute.

0.20

Joint Energy Efficiency and Fairness Optimization for D2D Communications in Aerial-Ground Integrated Heterogeneous Networks

cs.NI ·2026-09-21 ·Chuan-Chi Lai, Ang-Hsun Tsai, Shang-Long Wu
published similarity 0.66
Abstract · 15 pages, 5 figures. Accepted for publication in IEEE Transactions on Vehicular Technology. ©2026 IEEE. Personal use of this material is per…

This study investigates an Aerial-Ground Integrated Heterogeneous network (AGIHN) architecture that combines terrestrial macro base stations and unmanned aerial vehicles (UAVs) serving as aerial base stations to enhance uplink access for macrocell users. To address the complex uplink resource allocation challenge for multiple device-to-device (D2D) communication pairs, we propose a low-complexity Multi-Channel Rate-Fair (MCRF) algorithm. Distinct from traditional exclusive allocation methods, MCRF supports shared reuse, enabling multiple D2D pairs to simultaneously multiplex on the same resource block, thereby significantly improving spectral efficiency. To manage the severe intra-tier interference arising from this non-orthogonal sharing, a heuristic Interference Avoidance (IA) strategy is integrated to ensure the transmission quality of D2D users. The proposed framework jointly optimizes system throughput, user fairness, and energy efficiency without requiring computationally intensive offline training. Simulation results demonstrate distinct performance advantages depending on the reuse mode: Compared to traditional single-channel exclusive reuse schemes, MCRF achieves massive gains, increasing D2D energy efficiency and throughput by approximately 397% and 542%, respectively. Furthermore, relative to multi-channel benchmarks (e.g., MCRR), the proposed algorithm optimizes the efficiency-fairness trade-off, enhancing the fairness index by 7.43% while maintaining a robust fairness score exceeding 0.6 in interference-prone environments.

0.46

Risk-Aware Handover Management Approach for Non-Terrestrial Networks with the NTN-Connect Simulator

eess.SP ·2026-11-16 ·Mohammed Almekhlafi, Antoine Lesage-Landry, Gunes Karabulut Kurt
similarity 0.64
Abstract

The continuous movement of low Earth orbit (LEO) satellites in non-terrestrial networks (NTNs) leads to frequent handovers, requiring joint optimization of visibility duration, transmit power, and user quality-of-service (QoS). This work address this issue by proposing a risk-aware handover management framework that minimizes transmit power and maximizes admitted users under per-satellite power budgets and user-rate chance constraints, while a preference score term penalizes short duration associations. We decompose the resulting mixed-integer nonlinear program (MINLP) into an inner power allocation subproblem and an outer generalized assignment association subproblem. The inner subproblem reformulates the chance constraint into its deterministic counterpart using the value-at-risk (VaR) closed-form. The obtained transmit power allocation is then used in the association subproblem, which is solved optimally using an off-the-shelf solver. Finally, we employ the polynomial-complexity Hungarian algorithm to solve the relaxed assignment problem and enforce the per-satellite power budget using a knapsack algorithm. Simulations, using the proposed NTN-Connect simulator, on the OneWeb and Starlink constellations show that the proposed low-complexity solution achieves near-optimal performance and better performance compared to the risk-aware maximum stay (RA-MST) and risk-aware maximum received signal received power (RA-MRSRP) baselines. On the Starlink constellation, it increases the inter-handover interval (IHI) from $0.37$ to $1.47$~min, reducing the handover rate by $75\%$. At a maximum-IHI operating point, it reduces the total transmit power by 1.1 dBW (22\%) while increasing the admission rate from 97.4\% to 99.3\%.

0.26

Multi-Agent Reinforcement Learning for Joint Handover Management and Power Allocation in Multi-Orbit Satellite Networks

eess.SP eess.SY ·2026-08-14 ·Yassine Afif, Ashutosh Balakrishnan, Philippe Martins, Mohammed Almekhlafi, Antoine Lesage-Landry +1 more
similarity 0.64
Abstract

Future sixth-generation non-terrestrial networks are expected to combine low Earth orbit (LEO), medium Earth orbit (MEO), and geostationary Earth orbit (GEO) satellites, whose complementary layers must be coordinated through joint user association, power allocation, and handover management under fast LEO dynamics. This paper studies this problem by formulating it as a mixed-integer nonlinear program and decomposing it into a multi-agent reinforcement learning (MARL) policy that selects the associations and a convex power-allocation subproblem solved exactly at each time slot that defines the reward of the MARL part. The association policy is trained with multi-agent proximal policy optimization (MAPPO) and the targeted multi-agent communication (TarMAC) mechanism, and is made aware of the orbital layer through a state that encodes layer-dependent handover penalties. Evaluated on a realistic multi-constellation scenario built from real two-line element data over Nairobi, Kenya, the proposed policy reaches 92% of the throughput of a greedy signal-to-noise ratio (SNR) maximizing scheme while triggering more than four times fewer handovers, and improves throughput by roughly 14% over a conservative stay heuristic. Compared to an LEO-only learned policy of identical architecture, it attains slightly higher throughput with fewer handovers by offloading a fraction of the users to the MEO and GEO layers, an emergent multi-orbit behavior that drives its favorable throughput and handover trade-off.

0.04

Topology-Aware Cooperative Beam-Hopping Scheduling for Efficient Resource Allocation in LEO Satellite Systems

cs.NI ·2026-10-08 ·Shuang Zheng, Xing Zhang, Quan Z. Sheng, Wenbo Wang
published similarity 0.63
Abstract · 5 pages, 5 figures, accepted

The dynamic topology and heterogeneous traffic demands of multi-satellite systems present substantial challenges for beam-hopping (BH) resource management. This letter develops a topology-aware cooperative BH framework for multi-satellite systems under partial observability. A lightweight load-balancing scheme first determines the serving relationships, which are then exploited to construct an association-induced satellite-user graph. A two-phase graph neural network (GNN) extracts episode-level topology-aware structural identities for parameter-sharing agents, while a recurrent multi-agent proximal policy optimization (MAPPO) policy handles slot-level dynamics for joint beam scheduling and onboard power control. Simulation results demonstrate notable gains in energy efficiency, throughput, and fairness over the baselines.

0.27

Dynamic Task and Resource Scheduling Towards Space-Air-Ground-Sea Integrated Network

cs.NI ·2026-09-25 ·Yufei Ye, Shijian Gao, Xinhu Zheng, Liuqing Yang
similarity 0.62
Abstract

In the context of 6G ubiquitous connectivity, the space-air-ground-sea integrated network (SAGSIN) emerges as a new paradigm for pervasive service provisioning. To support expanding maritime activities in infrastructure-scarce ocean areas, we propose an innovative dynamic task and resource scheduling approach for SAGSIN to deliver computing services for vessels. It integrates broad-coverage satellites, relay-capable high-altitude platform (HAP), energy-sufficient coastal base station (BS), and flexibly deployed uncrewed aerial vehicles (UAVs) to accommodate wide-area, highly mobile, and sustained maritime services. To address the challenge of task scheduling across four layers, a dynamic task offloading algorithm is developed. It steers task flows toward servers with light loads, strong computing capabilities, and high-rate links based on real-time system states to reduce task execution delay, integrating an anticipatory satellite handover strategy to mitigate post-handover congestion and improving satellite resource utilization. Considering the limited endurance of UAVs, we impose residual energy constraints to ensure task backlog handover and safe return. Furthermore, the UAV-BS bandwidth allocation, UAV trajectories, and computing resource allocation are jointly optimized to enhance the connectivity among low-altitude devices and accelerate task completion. Simulation results validate the proposed method's superior adaptability to system resource variations during task execution in complex maritime environments, achieving at least a 23% reduction in average task delay over benchmarks.

0.27

Adaptive Beam Hopping and Power Control for Dual-Layer Over-the-Air Online Federated Learning in LEO Satellite Networks

cs.IT eess.SP ·2026-09-02 ·Zhendong Li, Shaojie Wang, Zhou Su, Zihao Zhang, Haixia Peng +3 more
benchmark similarity 0.62
Abstract

This paper investigates over-the-air (OTA) computation enabled online federated learning (FL) in low-Earth orbit (LEO) satellite networks. Specifically, we consider a dual-layer OTA aggregation architecture, where ground devices upload analog model updates to serving satellites via uplink OTA aggregation, and satellites forward the aggregated signals to a data processing center through the second round OTA aggregation. Then, we formulate a long-term data-utilization maximization problem in which devices continuously collect new data and untrained samples gradually lose freshness. The problem is subject to the satellite beam budget, transmit-power limit, and global mean squared error (MSE) constraint that governs end-to-end aggregation distortion. This yields a coupled mixed-integer nonlinear programming (MINLP) problem, involving tightly coupled discrete beam-hopping decisions and continuous power control. Due to the combinatorial action space and nonconvex constraints, the problem is NP-hard and computationally intractable. Furthermore, the time-varying satellite topology and dynamic data generation render it a sequential decision-making problem, necessitating adaptive online scheduling. To address these issues, we cast the problem as a Markov decision process and develop a proximal policy optimization (PPO)-based deep reinforcement learning framework that jointly optimizes adaptive beam hopping and power control, using an MSE-aware reward to balance data utilization and aggregation accuracy. Numerical simulation results verify that the proposed algorithm consistently outperforms other benchmark schemes, achieving superior long-term data utilization and faster FL convergence while satisfying the MSE requirement.

0.17

Mobility-Aware Task Offloading in Mobile Edge Computing-Empowered Space-Air-Ground Integrated Internet-of-Things Networks

cs.NI ·2026-11-10 ·Minghao Sun, Jinghuai Xiong, Xiaoli Chu, Zitian Zhang
benchmark similarity 0.62
Abstract

Mobile edge computing (MEC)-empowered spaceair-ground integrated Internet-of-Things (IoT) networks (SAGIINs) provide a promising solution for computation-intensive tasks generated by mobile IoT devices (IDs). However, task offloading in SAGIINs is challenging due to time-varying IDto-unmanned aerial vehicle (UAV) channels, intermittent LEO satellite service availability, and the coupling among UAV trajectory, communication, computation, and energy decisions. This paper investigates an energy-efficient task offloading and UAV trajectory planning problem in an MEC-empowered SAGIIN, where one UAV acts as both an aerial relay and an MEC server, and multiple LEO satellites provide supplementary computing resources. The UAV trajectory planning, task splitting, and computing resource allocation are jointly optimized to minimize the total system energy consumption under task completion, communication, computation, flight region, and satellite service window constraints. The resulting non-convex problem is decomposed into a UAV trajectory planning subproblem and a task splitting and computing resource allocation subproblem. To solve the former, a retrieval-augmented generation (RAG)-assisted large language model (LLM)-enhanced deep deterministic policy gradient (DDPG) algorithm, termed RLD, is proposed. The latter is shown to be convex and can be solved by using CVXPY for a given UAV trajectory. A weighted retrieval score is further designed to balance ID mobility-pattern similarity and historical UAV trajectory energy performance. Simulation results show that RLD completes all computational tasks in previously unseen test scenarios while consuming less total energy than the benchmark algorithms.

0.18