CS Paper Radar

Stability-Performance Trade-off in Maritime Integrated Sensing, Communication, and Computation: A Lyapunov-Guided Dual-Timescale Hierarchical RL Approach

Ruoguang Li, Yu Wang, Bingxin Tian, Benedetta Picano, Yingyang Chen, Xiaomin Chen, Li Wang, Guangjie Han, Zhu Han

eess.SP ·submitted 2026-10-29 00:23 UTC · v1

Abstract

Driven by the ever-growing demand for intelligent maritime services, cooperative unmanned aerial vehicle (UAV) and unmanned surface vehicle (USV) operations, together with wireless integrated sensing, communication, and computation (ISCC), have become pivotal in maritime environments. However, the distinctive maritime environment precludes a direct application of terrestrial ISCC models, while sensing, communication, and computation compete for the same spatio-temporal resources, thus yielding inherent performance trade-offs that become particularly severe in resource-constrained ocean scenarios. To address these issues, we investigate an ISCC system in which multiple UAVs detect targets at the sea surface and partially offload the collected data to a USV for cooperative processing. Characterizing the maritime-specific environment impairments, we incorporate sea clutter and wave-induced USV roll motion into the sensing and communication models, respectively. Moreover, we introduce data queueing models at both the UAVs and the USV to capture the dynamic coupling among sensing-data generation, wireless offloading, and computation execution. The optimization objective is to minimize the long-term average system energy consumption by jointly optimizing UAV-target association, UAV trajectories, beamforming, time allocation, offloading ratios, and computation resource allocation. Given that these decisions differ in update frequency and time sensitivity, we propose a Lyapunov-guided dual-timescale hierarchical soft actor-critic (LTH-SAC) framework, which transforms the long-term problem into a sequence of queue-aware online subproblems and coordinates optimization across the two timescales. Simulation results verify the effectiveness of the proposed framework and demonstrate its capability to balance the stability-performance trade-off among sensing, communication, and computation.

Closest papers

Nearest neighbours by meaning across the whole index.

Computation-Efficient Aerial-Marine Integrated Networks for Search and Rescue via Cooperative HAPS, UAVs, and MASSs

cs.NI ·2026-11-06 ·Zhen Wang, Bin Lin, Qiang Ye
top venuebenchmarkhighly cited similarity 0.68
Abstract

In this paper, we propose an aerial-marine integrated network architecture tailored for maritime search and rescue (MSAR) operations, where a high altitude platform station (HAPS) and maritime autonomous surface ships (MASSs) are equipped with edge servers, providing computing services for surveillance uncrewed aerial vehicles (UAVs). These UAVs generate substantial volumes of computation-intensive and delay sensitive tasks, some of which can be strategically offloaded to both MASSs and HAPSs for distributed processing. We formulate the joint task offloading and resource allocation as a mixed-integer nonlinear program (MINLP) to minimize the system computation overhead (CO), quantified by a weighted sum of task completion time and energy consumption. Given the stochastic nature of task arrivals from UAVs and the dynamic characteristics of marine channel conditions, we employ a two-stage optimization to decompose the problem into four tractable subproblems, i.e., 1) edge server selection, 2) transmission power allocation, 3) edge computing resource allocation, and 4) local computation resource allocation. In stage I, we optimize the edge server selection via many-to-one matching. In stage II, we determine the transmission power of each UAV with quasi-convex optimization and solve the edge computing and local computing resource allocation subproblems via a projected gradient descent method and convex optimization, respectively. Simulation results validate that the proposed scheme can achieve superior system performance over benchmark schemes.

0.56

Resource Management and Trajectory Optimization for UAV-IRS Assisted Maritime Edge Computing Networks

cs.NI ·2026-11-13 ·Chaoyue Zhang, Bin Lin, Xu Hu, Shuang Qi, Liping Qian +1 more
publishedhighly cited similarity 0.67
Abstract · 17 pages, 9 figures

With the exponential growth of maritime wireless devices and the rapid development of maritime applications, traditional maritime communication networks encounter communication and computation limitations in supporting computation-intensive and latency-critical tasks. Edge computing and Intelligent Reflecting Surface (IRS) have emerged as promising techniques to improve communication and computation services for maritime devices with limited computation capabilities and battery capacity. This paper studies an IRS Mounted on Unmanned Aerial Vehicle (UIRS) assisted maritime edge computing network, in which the UIRS is deployed to assist the transmission from Unmanned Surface Vehicles (USVs) to the edge server via Non-Orthogonal Multiple Access (NOMA) protocol. We propose a resource management and trajectory optimization scheme by jointly optimizing subslot duration, offloading ratios, transmit power, edge computation capability allocation, UIRS phase shifts and UIRS trajectory, aiming at minimizing the overall energy consumption. Since the non-convex nature of the optimization problem, we propose a two-layered method by decomposing the original problem into two subproblems. The top-layered subproblem is solved by the Semi-Definite Relaxation (SDR) method and the underlying-layered subproblem is solved by the Deep Deterministic Policy Gradient (DDPG) algorithm. Numerical results demonstrate that our proposed scheme can effectively and efficiently reduce overall energy consumption.

0.54

Two-Timescale Trajectory Control, Task Reassignment and Resource Scheduling for Multi-UAV Cooperative Mobile Edge Computing

eess.SY ·2026-11-07 ·Bin Li, Shiyu Sun, Lei Liu, Zesong Fei
top venue similarity 0.67
Abstract · 16 pages, 10 figures

Uncrewed aerial vehicle (UAV)-assisted mobile edge computing (MEC) is a promising technology, leveraging the advantages of UAVs including flexible deployment, wide coverage, and reliable wireless communication. In this paper, we study the task reassignment and offloading problem in a multi-UAV cooperative operating environment, and consider the real occurrence that the computing tasks arrive more frequently than UAVs make flight decisions. In addition, we also take into account the position offset of the UAV during flight and the unavailability of the UAV due to external interference. We propose a two-timescale optimization framework, where the trajectory of the UAV is carried out on a large timescale, while the task reassignment and computing resource allocation are jointly optimized on a small timescale. The core objective is to maximize the long-term average system gain, which takes both energy consumption and task delay into account. To address the UAV trajectory optimization problem under large timescale constraints, we propose a constrained multi-agent deep reinforcement learning algorithm. For decision-making within small timescale, to jointly optimize task offloading decisions and computing resource allocation, we integrate convex optimization with a heuristic algorithm. Finally, we conduct extensive simulations to evaluate the proposed algorithms against the baseline, achieving a 24% reduction in latency and a 28% reduction in total system cost.

0.33

Place, Slice and Schedule: Hierarchical O-RAN Control of a Tethered mmWave UAV-gNB

cs.NI cs.AI ·2026-08-24 ·Alireza Mohammadhosseini, Fatemeh Afghah
similarity 0.64
Abstract · This work has been submitted to the IEEE for possible publication

Unmanned aerial vehicle (UAV)-mounted 5G New Radio base stations (gNBs) can augment terrestrial networks with an on-demand, repositionable Frequency Range 2 (FR2) capacity layer. This flexibility, however, couples the physical network topology with radio-resource management: UAV movement reshapes blockage, channel quality, and the set of effectively served users, while traffic demand, queues, and service requirements evolve at a much faster timescale. Existing Open Radio Access Network (O-RAN)-enabled UAV studies optimize trajectory, deployment, association, or resource allocation, but typically in isolation, without coordinating slow aerial control with fast per-user scheduling. We instead exploit O-RAN disaggregation, Key Performance Indicator (KPI) monitoring, and multi-timescale RAN Intelligent Controller (RIC) control to address this coupling: a Non-Real-Time RIC rApp uses aggregated KPIs and radio-environment context to jointly control tethered UAV placement and the enhanced Mobile Broadband (eMBB)/Ultra-Reliable Low-Latency Communication (URLLC) slice budget, while a Near-Real-Time RIC xApp allocates per-user resources within that budget. We realize this xApp as a permutation-equivariant DeepSets Soft Actor-Critic (D-SAC) scheduler that treats the users as an unordered set, trained in a Sionna RT ray traced channel. The resulting hierarchical controller improves eMBB SLA satisfaction by up to 17% and URLLC on-time delivery by up to 42% over classical and learned schedulers; the learned rApp further raises URLLC on-time delivery by up to 20% over baselines.

0.32

Dynamic Task and Resource Scheduling Towards Space-Air-Ground-Sea Integrated Network

cs.NI ·2026-09-25 ·Yufei Ye, Shijian Gao, Xinhu Zheng, Liuqing Yang
similarity 0.63
Abstract

In the context of 6G ubiquitous connectivity, the space-air-ground-sea integrated network (SAGSIN) emerges as a new paradigm for pervasive service provisioning. To support expanding maritime activities in infrastructure-scarce ocean areas, we propose an innovative dynamic task and resource scheduling approach for SAGSIN to deliver computing services for vessels. It integrates broad-coverage satellites, relay-capable high-altitude platform (HAP), energy-sufficient coastal base station (BS), and flexibly deployed uncrewed aerial vehicles (UAVs) to accommodate wide-area, highly mobile, and sustained maritime services. To address the challenge of task scheduling across four layers, a dynamic task offloading algorithm is developed. It steers task flows toward servers with light loads, strong computing capabilities, and high-rate links based on real-time system states to reduce task execution delay, integrating an anticipatory satellite handover strategy to mitigate post-handover congestion and improving satellite resource utilization. Considering the limited endurance of UAVs, we impose residual energy constraints to ensure task backlog handover and safe return. Furthermore, the UAV-BS bandwidth allocation, UAV trajectories, and computing resource allocation are jointly optimized to enhance the connectivity among low-altitude devices and accelerate task completion. Simulation results validate the proposed method's superior adaptability to system resource variations during task execution in complex maritime environments, achieving at least a 23% reduction in average task delay over benchmarks.

0.27

Mobile Edge Deployment and Resource Management for Maritime Wireless Networks

cs.NI ·2026-11-13 ·Chaoyue Zhang, Bin Lin, Ziru Chen, Lin X. Cai, Jianli Duan
publishedhighly cited similarity 0.62
Abstract · 12 pages, 11 figures

Mobile Edge Computing (MEC) has been envisioned as one of the key technologies for supplying computation and storage resources in Internet of Vessels (IoV) networks. Due to its flexible deployment, low cost and agile maneuverability, Unmanned Surface Vehicle (USV) has emerged as a promising solution, to provide communication and computation services for maritime users. In this paper, we study mobile edge deployment and resource management for MEC-assisted maritime wireless networks where USVs with diverse computation resources are deployed to provide edge computing services that complement the cloud-based services. To this end, we formulate an optimization problem to minimize the expected response time by jointly optimizing the deployment of mobile USVs and computation offloading decisions. To solve the mixed-integer nonlinear program problem, we propose a Dual-Layer Reinforcement Learning (DLRL) framework to attain a near-optimal solution. Specifically, a Deep Deterministic Policy Gradient (DDPG) algorithm is designed to obtain the best USV deployment in the outer layer learning, and a Q-learning algorithm is designed to determine the best computation offloading decisions in the inner layer learning. Numerical results demonstrate that the proposed solution outperforms some literature algorithms by effectively handling both continuous and discrete variables.

0.62

Timely Ground-Station Status Delivery via UAV-Assisted Data Collection and Hierarchical RL

cs.IT eess.SPeess.SY ·2026-11-02 ·Xiangjian Gao, Mohammad Moltafet, Hamid R. Sadjadpour
publishedbenchmark similarity 0.61
Abstract · 5 pages, 3 figures. Author's accepted manuscript. Accepted for publication in the proceedings of the 2026 Asilomar Conference on Signals, Sy…

We consider a UAV-assisted status-update system in which a rotary-wing unmanned aerial vehicle (UAV) collects updates from multiple sensors, stores the newest update of each sensor, and forwards selected buffered updates to a ground station (GS). We minimize a weighted sum of the time-average GS-side age of information (AoI) and UAV energy consumption over a finite horizon. The optimization is subject to half-duplex operation, sensor and UAV energy-causality constraints, transmission-rate and power limits, and a terminal-location constraint. Because collection changes the information age at the UAV but does not reduce the GS-side AoI until the buffered update is forwarded, mobility, collection, and forwarding decisions are coupled over time. We use a hierarchical AoI-energy actor-critic (HAE-AC) controller in which a coarse-timescale actor selects return-feasible UAV movements, while a deterministic per-slot scheduler constructs feasible collection or forwarding sets and assigns the minimum transmit power required for each scheduled transmission. In a 100-sensor deployment, HAE-AC reduces the average GS-side AoI by about 22% relative to an adaptive staleness-gated benchmark. Compared with forward-upon-collection, selective buffered forwarding reduces the number of downlink bursts by roughly 30% while increasing the number of collections per sensor by more than 23%.

0.22

Marine Autonomous Vehicle Fleet Scheduling to Maximise Scientific Impact

cs.RO math.OC ·2026-08-27 ·Mehdi El Krari, Jonathan Smith, Maria Fox
similarity 0.60
Abstract

The marine science community increasingly relies on Marine Autonomous Vehicles (MAVs) to collect the critical environmental data required to understand global ocean systems. However, as these operations scale, manually routing and planning large autonomous fleets becomes exponentially complex and time-consuming. To address this, we propose a mixed-integer linear programming (MILP) model designed to automate and optimise MAV deployment schedules. The model accounts for strict operational constraints, including battery capacities and time windows for data collection, while aiming to maximise total data collection and minimise both the number of deployed vehicles and their energy consumption. A key novelty of this framework is integrating conventional ship itineraries, allowing MAVs to support vessels with mid-mission battery swapping or accelerated transit between waypoints. Computational experiments demonstrate that the model is highly scalable, solving routing problems for fleets of dozens of MAVs in seconds, and scaling to hundreds of vehicles in only a few minutes. Beyond operational scheduling, the framework serves as a robust simulation tool for evaluating 'what-if' scenarios and analysing the impact of varying parameters on deployment strategies. Finally, the solution generates a suite of visualisations designed to enhance explainability and support strategic decision-making for stakeholders.

0.16