CS Paper Radar

Hybrid PPO-Based Multi-Objective Optimization for UAV-mounted STAR-RIS with Energy Harvesting

Anas Hussin, Khaled M. Rabie, Mahmoud M. Salim, Ali H. Muqaibel, Louai A. Al-Awami

eess.SY ·submitted 2026-10-20 18:29 UTC · v1

Abstract

This paper investigates a multi-objective optimiza tion framework for UAV-mounted reconfigurable intelligent sur face (STAR-RIS)-assisted Sixth Generation (6G)-enabled Internet of Things (IoT) systems. The considered framework jointly supports communication enhancement and radio-frequency (RF) energy harvesting (EH) through adaptive STAR-RIS transmission and reflection control. A weighted multi-objective optimization problem is formulated to jointly optimize the base station (BS) beamforming vectors, STAR-RIS transmission and reflection coefficients, RF power-splitting factor, and UAV trajectory under quality-of-service (QoS), power, and mobility constraints. Due to the strong coupling among the communications, EH, and UAV mobility variables, the resulting problem is highly non convex and difficult to solve using conventional optimization methods. To address this challenge, a hybrid proximal policy optimization (H-PPO) framework is proposed. The developed hybrid actor-critic architecture combines a categorical policy for discrete UAV movement decisions with Beta-distributed policies for continuous communication-control variables. In addition, a two-stage reward mechanism is introduced to enforce QoS feasibility while balancing system sum rate, energy efficiency, and harvested energy. Simulation results demonstrate that the proposed H-PPO framework achieves faster convergence and more stable training behavior than proximal policy optimization (PPO) and twin delayed deep deterministic policy gradient (TD3) baselines. In particular, H-PPO achieves approximately 66% and 60% faster convergence than PPO and TD3, respectively, while maintaining more stable training behavior. Furthermore, the proposed framework effectively balances communication performance and EH under different QoS requirements, STAR RIS sizes, transmit power levels, and user densities.

Closest papers

Nearest neighbours by meaning across the whole index.

Heterogeneous Services in Multi-UAV Networks with No-Fly Zone and User Mobility

eess.SY ·2026-10-14 ·Bin Li, Senning Wan, Decheng Zhang, Yonglei Yao, Yu Xue
publishedbenchmark similarity 0.67
Abstract · 12 pages, 10 figures

In this paper, we investigate a wireless communication network supported by multiple uncrewed aerial vehicles (UAVs). To ensure reliable connectivity, UAVs are desired to approach the boundaries of designated no-fly zones (NFZs) without violating them when mobile users (MUs) enter NFZs. To support heterogeneous communication services, MUs are assigned different priority levels based on their individual communication types. Considering the practical constraints arising from user mobility, heterogeneous communication requirements, and NFZs, the objective is to maximize the weighted sum of MU communication rates, where weights correspond to MU priorities. This is achieved by jointly optimizing trajectory planning, UAV transmission power control, and the binary association factor between UAVs and MUs. To address this challenging optimization problem under dynamic constraints, we develop a soft actor-critic algorithm with prioritized experience replay, which learns an adaptive control policy. Numerical results show that the proposed algorithm outperforms benchmark schemes in terms of convergence speed and stability. Moreover, it effectively meets diverse communication requirements, satisfies UAV energy constraints, and ensures reliable operation under NFZ constraints.

0.21

Max-Min Throughput in RSMA-Aided SWIPT for Sustainable Internet of Underground Things: A Deep Reinforcement Learning Approach

eess.SY cs.LGeess.SP ·2026-11-15 ·Kaiqiang Lin, Mohamed-Slim Alouini
similarity 0.65
Abstract · 15 pages, 7 figures, and 3 tables

Unmanned aerial vehicle (UAV)-enabled wireless-powered underground sensor networks (WPUSNs) allow underground devices (UDs) to harvest radio-frequency energy from a UAV via wireless energy transfer (WET) techniques, enabling sustainable Internet of underground things (IoUT) applications. This paper integrates rate-splitting multiple access (RSMA)-aided simultaneous wireless information and power transfer (SWIPT) into UAV-enabled WPUSNs to deliver information and energy to UDs. Within this framework, we investigate a max-min fairness problem that jointly optimizes the UAV transmit power, power allocation and message splitting, power-splitting ratios, and time allocation, aiming to maximize the minimum uplink throughput across UDs subject to per-UD downlink throughput requirements and a UAV energy-consumption constraint. To address this non-convex problem under dynamic underground environments, we develop an off-policy deep reinforcement learning approach based on the primal-dual truncated quantile critics (PD-TQC), where a TQC-based reward critic evaluates the fairness objective, cost critics estimate constraint costs, and an actor learns the resource-control policy with adaptive dual-variable updates. Simulations using in-situ soil volumetric water content measurements from a center-pivot irrigation farm demonstrate that PD-TQC achieves the highest annual average minimum uplink throughput compared with four benchmarks while satisfying the per-frame constraints in over 96% of the evaluated frames, and that this throughput advantage is preserved under different Rician factors, numbers of UDs, and downlink throughput thresholds.

0.23

Mobility-Aware Task Offloading in Mobile Edge Computing-Empowered Space-Air-Ground Integrated Internet-of-Things Networks

cs.NI ·2026-11-10 ·Minghao Sun, Jinghuai Xiong, Xiaoli Chu, Zitian Zhang
benchmark similarity 0.62
Abstract

Mobile edge computing (MEC)-empowered spaceair-ground integrated Internet-of-Things (IoT) networks (SAGIINs) provide a promising solution for computation-intensive tasks generated by mobile IoT devices (IDs). However, task offloading in SAGIINs is challenging due to time-varying IDto-unmanned aerial vehicle (UAV) channels, intermittent LEO satellite service availability, and the coupling among UAV trajectory, communication, computation, and energy decisions. This paper investigates an energy-efficient task offloading and UAV trajectory planning problem in an MEC-empowered SAGIIN, where one UAV acts as both an aerial relay and an MEC server, and multiple LEO satellites provide supplementary computing resources. The UAV trajectory planning, task splitting, and computing resource allocation are jointly optimized to minimize the total system energy consumption under task completion, communication, computation, flight region, and satellite service window constraints. The resulting non-convex problem is decomposed into a UAV trajectory planning subproblem and a task splitting and computing resource allocation subproblem. To solve the former, a retrieval-augmented generation (RAG)-assisted large language model (LLM)-enhanced deep deterministic policy gradient (DDPG) algorithm, termed RLD, is proposed. The latter is shown to be convex and can be solved by using CVXPY for a given UAV trajectory. A weighted retrieval score is further designed to balance ID mobility-pattern similarity and historical UAV trajectory energy performance. Simulation results show that RLD completes all computational tasks in previously unseen test scenarios while consuming less total energy than the benchmark algorithms.

0.18

Active STAR-RIS-Aided RSMA IoT Systems: Performance Analysis, Model-Based and Data-Driven Resource Allocation Frameworks

eess.SP ·2026-09-06 ·Ngo Hoang Tu, Vo Nguyen Quoc Bao, Tran Thien Thanh
published similarity 0.59
Abstract · This work has been accepted for publication in IEEE Internet of Things Journal

STAR-RISs have emerged as a promising technology for achieving full-space signal coverage with low hardware complexity and energy consumption. In parallel, RSMA offers a flexible interference management mechanism that enhances spectral efficiency and user fairness. Integrating STAR-RIS with RSMA provides strong potential for robust and energy-efficient communications; however, the resulting double-fading cascaded channels and the inherent imbalance between near and far users pose reliability and fairness challenges. This study presents comprehensive information-theoretic and optimization frameworks for active STAR-RIS-assisted RSMA Internet-of-Things systems. Closed-form expressions for the OP and EC are derived under both the presence and absence of direct links. Based on these results, asymptotic OP and EC, diversity order, and array gain are analyzed to characterize system behavior. In addition, throughput-based and spectral-based energy efficiency metrics are investigated to quantify the tradeoffs between transmission performance and power consumption. To enhance user fairness, a fairness-oriented RA framework is developed to jointly optimize power allocation and rate-splitting coefficients using successive convex approximation and block coordinate descent techniques. To further improve scalability and real-time applicability, we introduce a data-driven RA framework based on DMNN, CMNN, and MXGB. This framework approximates the optimization-based solutions with substantially reduced computational complexity. Numerical results show that the proposed MXGB model achieves the shortest execution time while maintaining performance comparable to ground-truth-based benchmarks. Extensive Monte Carlo simulations validate the analytical results and demonstrate the effectiveness of the proposed frameworks.

0.32

Toward Mission-Critical ISAC: Reliable Energy-Aware Coordination in UAV Swarms

cs.NI cs.ITcs.MAcs.RO+1 ·2026-09-14 ·Masoud Shokrnezhad, Tarik Taleb, Amir Javadpour
published similarity 0.59
Abstract · Accepted to IEEE ISAC 2026

Unmanned aerial vehicle (UAV) swarms deployed in mission-critical applications must simultaneously track a mobile aerial target and maintain reliable data links. However, active integrated sensing and communication (ISAC) operation imposes a dual energy burden on propulsion and transmission, threatening mission continuity through premature battery depletion. In this paper, we propose a two-tier UAV swarm architecture in which mission UAVs (MUAVs) execute cooperative ISAC for mobile aerial target tracking while dedicated charging UAVs (CUAVs), equipped with solar harvesting panels, replenish low-battery MUAVs via aerial UAV-to-UAV wireless power transfer (WPT). We formulate the joint minimization of the cooperative posterior Cramér-Rao bound (PCRB) over MUAV trajectories, per-slot sensing-communication time splits, WPT scheduling and admission, and CUAV rendezvous trajectories, subject to minimum uplink rate, dual-tier energy causality, WPT proximity, collision-avoidance, and speed constraints, yielding a non-convex mixed-integer program (MIP) that, to the best of our knowledge, is the first to jointly couple cooperative ISAC sensing quality with aerial WPT and dual-tier energy management. To solve it efficiently, we propose Receding-Horizon Alternating Optimization (RHAO), a four-block per-slot algorithm that decomposes the problem into: charging admission via the Hungarian algorithm, MUAV trajectory and time-split via successive convex approximation (SCA), CUAV rendezvous, and WPT power allocation, with monotone convergence guarantees. Simulation results demonstrate that RHAO reduces the mean PCRB by 16.8 times over a fixed-time-split baseline and 5.4 times over a static-trajectory scheme, while the aerial WPT subsystem sustains all MUAVs above the energy-critical threshold throughout the full mission horizon.

0.36

Deep Reinforcement Learning for Optimization of STAR-RIS Phase and Energy Splitting Coefficients in OTFS-NOMA Framework

cs.IT eess.SY ·2026-09-03 ·Rais. J. Gachaba, Manobendu Sarker, Anirban Bhowal
published similarity 0.59
Abstract · Accepted in IEEE ANTS 2026

This paper considers a downlink communication framework comprising a simultaneously transmitting and reflecting reconfigurable intelligent surface (STAR-RIS)-aided by orthogonal time frequency space (OTFS) and non-orthogonal multiple access (NOMA) technologies. Further, delay-Doppler mobility in such frameworks renders classical alternating optimization impractical for per-coherence interval reconfiguration. To mitigate such issues, the STAR-RIS phase-shift and energy-splitting design is formulated as a constrained, non-convex sum-rate maximization problem with closed-form maximum ratio transmission beamforming and fixed NOMA power allocation. To circumvent the per-interval re-optimization burden, a deep reinforcement learning (DRL) approach is adopted that maps observed channel realizations to STAR-RIS configurations through a single forward pass. Specifically, Beta-Space Soft Actor-Critic (SAC-BSE), a maximum entropy DRL agent, is proposed. Simulation results, with two NOMA-multiplexed users on each STAR-RIS branch, confirm rapid convergence, limit the sum-rate degradation to roughly 10\% across a 128-fold user-speed range, and yield consistent gains over OTFS-only, NOMA-only, STAR-RIS-only, fixed-split, and mode-switching baselines as transmit power and the number of STAR-RIS elements increase.

0.27

Hybrid STAR-RIS Architecture for Joint Localization, Communication, and Power Transfer

eess.SP ·2026-08-12 ·Haoran Ni, Mohammadali Mohammadi, Xidong Mu, Hien Quoc Ngo, Michail Matthaiou
top venue similarity 0.59
Abstract · Accepted for publication in IEEE Transactions on Wireless Communications, Aug. 2026

We propose a hybrid simultaneously transmitting and reflecting reconfigurable intelligent surface (STAR-RIS) architecture with dynamically switched active and passive elements to support joint localization, communication, and wireless power transfer (WPT). We first pursue a parallel factor analysis with the alternating least squares (PARAFAC-ALS)-based tensor decomposition approach that decouples the base station (BS)-reconfigurable intelligent surface (RIS) and RIS-user channels, thereby enabling low-overhead channel acquisition. Based on this, we formulate a system energy efficiency (EE) maximization problem, subject to the spectral efficiency (SE) requirements of communication users, sensing signal-to-interference-plus-noise ratio constraints, and the nonlinear energy harvesting requirements of energy-harvesting users. The optimization problem is nonconvex since the transmit power allocation, STAR-RIS coefficients, and active/passive mode assignments are tightly coupled in both the objective and constraints. We address this issue by alternating between two subproblems, and solving them via fractional programming, successive convex approximation and a multi-seed greedy strategy employed as an initialization step. Numerical results demonstrate that selectively activating a small, well-chosen subset of STAR-RIS elements achieves 1.5 to 3 times EE improvements compared with fully passive/active architectures, while satisfying communication, sensing, and power-transfer requirements.

0.63

Two-Timescale Trajectory Control, Task Reassignment and Resource Scheduling for Multi-UAV Cooperative Mobile Edge Computing

eess.SY ·2026-11-07 ·Bin Li, Shiyu Sun, Lei Liu, Zesong Fei
top venue similarity 0.58
Abstract · 16 pages, 10 figures

Uncrewed aerial vehicle (UAV)-assisted mobile edge computing (MEC) is a promising technology, leveraging the advantages of UAVs including flexible deployment, wide coverage, and reliable wireless communication. In this paper, we study the task reassignment and offloading problem in a multi-UAV cooperative operating environment, and consider the real occurrence that the computing tasks arrive more frequently than UAVs make flight decisions. In addition, we also take into account the position offset of the UAV during flight and the unavailability of the UAV due to external interference. We propose a two-timescale optimization framework, where the trajectory of the UAV is carried out on a large timescale, while the task reassignment and computing resource allocation are jointly optimized on a small timescale. The core objective is to maximize the long-term average system gain, which takes both energy consumption and task delay into account. To address the UAV trajectory optimization problem under large timescale constraints, we propose a constrained multi-agent deep reinforcement learning algorithm. For decision-making within small timescale, to jointly optimize task offloading decisions and computing resource allocation, we integrate convex optimization with a heuristic algorithm. Finally, we conduct extensive simulations to evaluate the proposed algorithms against the baseline, achieving a 24% reduction in latency and a 28% reduction in total system cost.

0.33