CS Paper Radar

A Mean-Field Approach for Safe Routing of Multi-Destination Urban Air Mobility Networks

Nameer Fawwaz Ahmed, Cody Fleming, Yasser Shoukry

eess.SY ·submitted 2026-09-17 21:09 UTC · v1

Abstract

As Urban Air Mobility (UAM) systems scale toward high-density operations, managing autonomous Unmanned Aerial Vehicle (UAV) traffic requires control frameworks that are both tractable and safety-critical. This paper presents a principled optimal control-theoretic foundation for routing in multi-destination UAM networks subject to vertiport capacity and flow constraints. We first model the network as a destination-conditioned Continuous-Time Markov Chain (CTMC) to capture the stochastic transitions between queueing, service, and flight states. To ensure tractability, we employ a mean-field fluid approximation and derive the underlying system dynamics as a set of coupled ordinary differential equations. A key contribution of this work is the formal proof of the positive invariance of the queue-free state space. We demonstrate that under specific underloaded conditions, a system initialized without queues will remain queue-free indefinitely. This result allows us to transform a complex, infinite-dimensional continuous-time optimal control problem into a tractable, finite-dimensional algebraic optimization. The resulting framework jointly optimizes for travel time and multi-hop efficiency while ensuring network-wide stability. We validate the approach by characterizing the steady-state flow equilibria and providing sufficient conditions for safe, congestion-free operation in large-scale mobility systems.

Closest papers

Nearest neighbours by meaning across the whole index.

Traffic-Adaptive Per-Hop Multipath Routing in Multi-Hop UAV Networks

cs.NI ·2026-08-26 ·Zhenyu Zhao, Tiankui Zhang, Xiaoxia Xu, Yuanpeng Zheng, Junjie Li +1 more
similarity 0.64
Abstract

In uncrewed aerial vehicle (UAV)-relayed mobile edge computing (MEC) networks, computation tasks generate traffic with diverse latency requirements and data sizes. Routing decisions therefore need to adapt to both traffic characteristics and changing network conditions. Compared with single-path routing, multipath routing is better suited to such heterogeneous traffic because it provides multiple forwarding options and enables flexible traffic splitting. However, conventional multipath routing usually splits traffic over predefined end-to-end paths, making it difficult to respond quickly to link fluctuations and topology changes in UAV networks. To address this issue, we propose a traffic-adaptive per-hop multipath routing method for multi-hop UAV networks, in which each UAV dynamically distributes traffic among multiple candidate next hops. We formulate the routing problem to improve the on-time packet delivery ratio while reducing the packet loss ratio, and model it as a decentralized partially observable Markov decision process (Dec-POMDP). To solve this problem, we develop a multi-agent reinforcement learning (MARL) algorithm, termed Multi-Agent Proximal Policy Optimization with Dirichlet Modeling (MAPPO-DM). MAPPO-DM follows the centralized-training-and-decentralized-execution framework and models continuous traffic-splitting actions using a Dirichlet distribution. Simulation results show that MAPPO-DM outperforms the baseline methods and maintains robust performance under various network conditions.

0.21

Heterogeneous Services in Multi-UAV Networks with No-Fly Zone and User Mobility

eess.SY ·2026-10-14 ·Bin Li, Senning Wan, Decheng Zhang, Yonglei Yao, Yu Xue
publishedbenchmark similarity 0.64
Abstract · 12 pages, 10 figures

In this paper, we investigate a wireless communication network supported by multiple uncrewed aerial vehicles (UAVs). To ensure reliable connectivity, UAVs are desired to approach the boundaries of designated no-fly zones (NFZs) without violating them when mobile users (MUs) enter NFZs. To support heterogeneous communication services, MUs are assigned different priority levels based on their individual communication types. Considering the practical constraints arising from user mobility, heterogeneous communication requirements, and NFZs, the objective is to maximize the weighted sum of MU communication rates, where weights correspond to MU priorities. This is achieved by jointly optimizing trajectory planning, UAV transmission power control, and the binary association factor between UAVs and MUs. To address this challenging optimization problem under dynamic constraints, we develop a soft actor-critic algorithm with prioritized experience replay, which learns an adaptive control policy. Numerical results show that the proposed algorithm outperforms benchmark schemes in terms of convergence speed and stability. Moreover, it effectively meets diverse communication requirements, satisfies UAV energy constraints, and ensures reliable operation under NFZ constraints.

0.21

Stochastic Corridor Time Network Capacity Planning for Low Altitude Airspace Systems

cs.CE ·2026-08-11 ·Yipu Yao, Li Ding, Yanlu Zhao
similarity 0.62
Abstract

Regulators in China, the United States, and the European Union now provide low-altitude airspace access as priced, time-windowed corridor authorizations, booked in advance and forfeited if unused. We ask how much capacity a UAV logistics planner should reserve on each corridor--time unit before demand is realized, to maximize expected profit net of reservation cost. Reserved capacity cannot be transferred across corridors or time windows and is consumed jointly along time-respecting paths, so reservations are coupled through the network in ways that models with exogenous airspace capacity cannot capture. We formulate a two-stage stochastic program whose recourse selects and routes accepted requests on a time-expanded network, prove its arc-based and path-packing forms equivalent, and solve it by Benders decomposition with column-generated subproblems. The decomposition operates on the LP relaxation, and all reported reservation and routing decisions are recovered as integer plans. Computational experiments achieve single-digit LP-Benders gaps on moderate-sized networks and extend to much larger instances through a truncated-path approach. A Shenzhen case study shows reservations concentrating on structurally central corridors, with demand level and reservation price having more influence on the quantity of capacity reserved than the selection of corridors.

0.04

Vertiport Design Methodology and Capacity Analysis

eess.SY ·2026-09-29 ·Emin Burak Onat, Jean-Luc Lupien, Raja Sengupta
similarity 0.61
Abstract

This paper presents a comprehensive methodology for vertiport design and capacity analysis using stochastic queueing models. Vertiport capacity is defined as the maximum steady-state throughput of aircraft per hour while maintaining a specified maximum queuing delay with high probability. We introduce a two-node queueing network model with a finite buffer to analytically derive mean queue lengths and delays at singleTLOF vertiports, supported by a simulation model that validates these findings under various operational conditions. Our analyses reveal that vertiport capacity is significantly constrained by the interactions between takeoff/landing operations and turnaround activities. Capacity is further reduced by the variance in these operational parameters, with deterministic times substantially enhancing capacity. The study shows that vertiport throughput is typically around 50% of the theoretical maximum departure capacity in a Markovian model, decreasing sharply as confidence in maximum queuing delay increases. Non-Markovian models with adequate parking pads achieve full TLOF capacity. Additionally, our methodology identifies the optimal number of parking pads required to maximize throughput per unit area. The findings provide insights for designing vertiport infrastructure to support scalable and efficient UAM deployment.

0.23

Strategically Robust Game-Theoretic Multi-Agent Trajectory Optimization

eess.SY cs.GTcs.MA ·2026-09-28 ·Victor L. Qin, Nicolas Lanzetti, Saverio Bolognani, Hamsa Balakrishnan
published similarity 0.61
Abstract · 7 pages, 5 figures, accepted to CDC 2026

Aviation authorities worldwide expect Advanced Air Mobility (AAM) traffic management to be decentralized among service providers, requiring AAM flights to autonomously plan trajectories by predicting other flights' control inputs rather than relying on centralized coordination. Game-theoretic approaches that formulate multi-agent collision avoidance as an exact dynamic potential game can efficiently find open-loop equilibria, but they assume that agents exactly follow their equilibrium trajectories---an unrealistic assumption given uncertainties in actuation, perception, and computation. We propose a strategically robust formulation where each agent protects against a fictitious adversary that, for each timestep, perturbs other agents' control inputs within a bounded budget to minimize distance at that timestep. We show that, under reasonable assumptions on agents' distance cost and robustness levels, the strategically robust game remains an exact dynamic potential game and admits a quasi-closed-form solution to the inner adversarial problem for linear dynamics, which limits computational overhead. Experiments with up to eight agents using logarithmic distance costs show that strategic robustness selects more robust trajectories in high-collision-risk configurations while leaving low-risk trajectories nearly unchanged, with only a modest increase in runtime.

0.28

Policy Synthesis for Finite Populations of MDP Agents under Aggregate Reach-Avoid Chance Constraints

eess.SY cs.MA ·2026-10-08 ·Jie Fu, Anamika Dubey
similarity 0.60
Abstract · 8 pages, 2 figures. Submitted to the 2027 American Control Conference

Consider a finite population of agents with decoupled Markov transition dynamics and empirical-density feedback, subject to the following constraints: with probability at least $1-δ_r$, at least a fraction $α_r$ of agents must reach a target region at some time $t^*$, while, at each time up to $t^*$, the unsafe population fraction must remain below $β_u$ with probability at least $1-δ_u$. However, standard mean-field methods enforce these constraints only in expectation, which fails to account for stochastic fluctuations at finite fleet size $N$. To address this control problem, we propagate the second-order moment (variance) of the empirical density alongside the mean-field trajectory via a discrete-time Lyapunov recursion, and apply the Cantelli inequality to convert chance constraints into tractable deterministic conditions on the moments of the empirical density. We then incorporate these moment-based surrogate constraints into a gradient-based sequential convex approximation procedure for density-feedback policy synthesis. We further introduce additional moment-error bounds to construct a rigorous finite-$N$ certificate. The method is evaluated on a gridworld environment and a power-system EV-charging aggregation problem and compared with a standard deterministic population-level LP baseline.

0.29

AoI-Driven Hierarchical Learning for Cooperative Resource Sharing in Multi-Operator UAV Networks

eess.SY ·2026-09-19 ·Atefeh Hajijamali Arani, Mahyar Shirvanimoghaddam, Abolfazl Mehbodniya, Halim Yanikomeroglu, Fumiyuki Adachi
similarity 0.60
Abstract

Uncrewed aerial vehicle (UAV)-assisted networks provide a versatile paradigm for on-demand connectivity. However, in multi-operator aerial networks (MOANs), the joint optimization of cooperative resource sharing and 3D trajectory control to maintain information freshness is a complex combinatorial problem, which can be shown to be NP-hard. To address this computational complexity, we propose an age of information (AoI)-driven hierarchical deep reinforcement learning (DRL) framework. Specifically, a Dueling Double Deep Q-Network (D3QN) architecture is deployed at both the operator and UAV decision layers to mitigate overestimation bias and enhance stability in high-dimensional state spaces. To improve system resilience, we introduce an AoI- and load-aware outage compensation mechanism that prioritizes users based on instantaneous transmission demands and temporal freshness. Furthermore, a normalized load exchange balance metric is incorporated to regulate cooperative behavior and ensure resource fairness across operators. Simulation results demonstrate that the proposed hierarchical D3QN significantly outperforms conventional DRL, non-cooperative, and cooperative benchmarks, reducing the average AoI by up to 56.1% under severe congestion while ensuring superior inter-operator fairness and outage mitigation.

0.11

Who Can Safely Wait? Risk-Aware 5G Scheduling for Low-Altitude UAV Operation

cs.NI ·2026-10-05 ·André Melo, Yueqi Chen, Lourenço Pereira, Igor Kadota
similarity 0.59
Abstract

Cellular-connected UAV operations already fly in many countries. However, cellular networks were designed for terrestrial users and remain blind to the operational consequences of delaying information from low-altitude aircraft. We present Risk-Aware (RA), a framework that translates information freshness and operational context into aircraft-specific operational risk, enabling uplink scheduling based on operational consequence rather than network metrics alone. RA balances the consequence of further delay against the service cost of heterogeneous single- and multi-slot updates. It combines a regulation-inspired risk proxy, risk-directed prioritization based on marginal risk growth, and a Max-Weight scheduler with Lyapunov-based performance guarantees. Although RA is derived from an analytically tractable model, we evaluate it under moving UAV trajectories, dynamic operational context, geographically varying population exposure, and realistic UAV video traffic. Across 48 operating points and fleets of up to 120 UAVs in São Paulo delivery operations and the Interlagos Formula 1 Grand Prix setting, RA reduces 99th-percentile per-UAV risk by up to 96% over proportional fair and 86% over round robin, while supporting fleets up to 1.5$\times$ and 3$\times$ larger, respectively, within the same risk envelope.

0.35