CS Paper Radar

Packet Loss Analysis Under Doppler Effects and Reinforcement-Learning-Based Resource Allocation for Direct-to-Satellite LoRaWAN

Alireza Maleki, Ebrahim Bedeer, Robert Barton

eess.SP ·submitted 2026-10-16 16:11 UTC · v1

Abstract

Long range wide area network (LoRaWAN) has a long communication range and low power consumption, making it a potential technology for direct-to-satellite (DtS) Internet of Things (IoT) connectivity. However, packet collisions and Doppler impairments brought on by satellite motion can greatly increase the packet loss ratio (PLR) in large-scale DtS-IoT networks. In this paper, we study resource allocation in DtSIoT LoRaWAN by first developing an analytical PLR model that simultaneously takes Doppler impairments and packet collisions in the temporal and frequency domains into account. In order to maximize resource allocation, the generated PLR is then used as the reward function for two reinforcement learning (RL) schemes: deep Q-network (DQN) and proximal policy optimization (PPO). Simulation results validate the analytical PLR model against Monte Carlo simulations and demonstrate significant improvements over random resource allocation. At a target PLR of 3*10^-2, while random allocation supports only 100 end devices (EDs), PPO and DQN support approximately 650 and 690 EDs, respectively, representing nearly a seven-fold increase. Furthermore, for 800 EDs, PPO and DQN increase the total number of transmitted packets by 106.7% and 88.0%, respectively, compared with random allocation.

Closest papers

Nearest neighbours by meaning across the whole index.

Max-Min Throughput in RSMA-Aided SWIPT for Sustainable Internet of Underground Things: A Deep Reinforcement Learning Approach

eess.SY cs.LGeess.SP ·2026-11-15 ·Kaiqiang Lin, Mohamed-Slim Alouini
similarity 0.60
Abstract · 15 pages, 7 figures, and 3 tables

Unmanned aerial vehicle (UAV)-enabled wireless-powered underground sensor networks (WPUSNs) allow underground devices (UDs) to harvest radio-frequency energy from a UAV via wireless energy transfer (WET) techniques, enabling sustainable Internet of underground things (IoUT) applications. This paper integrates rate-splitting multiple access (RSMA)-aided simultaneous wireless information and power transfer (SWIPT) into UAV-enabled WPUSNs to deliver information and energy to UDs. Within this framework, we investigate a max-min fairness problem that jointly optimizes the UAV transmit power, power allocation and message splitting, power-splitting ratios, and time allocation, aiming to maximize the minimum uplink throughput across UDs subject to per-UD downlink throughput requirements and a UAV energy-consumption constraint. To address this non-convex problem under dynamic underground environments, we develop an off-policy deep reinforcement learning approach based on the primal-dual truncated quantile critics (PD-TQC), where a TQC-based reward critic evaluates the fairness objective, cost critics estimate constraint costs, and an actor learns the resource-control policy with adaptive dual-variable updates. Simulations using in-situ soil volumetric water content measurements from a center-pivot irrigation farm demonstrate that PD-TQC achieves the highest annual average minimum uplink throughput compared with four benchmarks while satisfying the per-frame constraints in over 96% of the evaluated frames, and that this throughput advantage is preserved under different Rician factors, numbers of UDs, and downlink throughput thresholds.

0.31

SLA-Aware Task Offloading in the IoT Edge-Cloud Continuum: Class-Weighted Deep Reinforcement Learning Against an Exact Optimum

cs.AI cs.LGcs.NI ·2026-11-07 ·Shilpa Golla, Tharun Kumar Korine Palli, Urmila Bandaru
benchmark similarity 0.59
Abstract

Deep reinforcement learning (RL) is often used to decide where Internet of Things (IoT) tasks with different latency limits run in the edge-cloud continuum, yet some methods give every missed task the same penalty and few compare their agents with an optimal policy. This benchmark study builds four offloading systems small enough to solve exactly by dynamic programming and measures reward and learner against the optimum. A bonus for a met limit makes each miss cost its penalty plus the bonus, which shifts the class weights of published per-class rewards. A class-blind penalty stays 65% to 118% above the optimal cost even with a perfect learner, while a corrected per-class penalty comes within 0.13% of the optimum. With a per-class reward, tuned proximal policy optimization (PPO) agents come within 9% to 11% of the optimum in the smallest system, and the corrected one beats a tuned reservation rule in 9 of 10 seeds. In larger systems the agents stay 41% to 76% above the optimum, and a tuned rule beats their mean. Training ten times longer does not close this gap, and a PPO-Lagrangian agent with reachable targets does no better than the per-class reward.

0.19

Cooperative Dueling DQN SAC Learning for Energy Efficiency in Dynamic OWC Networks

eess.SY ·2026-10-07 ·Walter Zibusiso Ncube, Ahmad Adnan Qidan, Taisir El-Gorashi, Jaafar M. H. Elmirghani
hot direction similarity 0.59
Abstract

Growing wireless traffic is increasing pressure on the congested radio-frequency spectrum. Optical wireless communication (OWC) provides a complementary solution by using the abundant unlicensed optical spectrum. However, indoor OWC networks are dynamic: users move, enter or leave the network, and subscribe to different services. Poorly coordinated resource allocation can consequently waste subcarriers, require excessive transmission power and cause frequent AP reassignments. Energy efficiency (EE), defined as the total delivered data rate divided by the total network power consumption, therefore requires the serving AP, number of allocated subcarriers, and transmission power to be jointly adapted while maintaining QoS. Optimising these in a dynamic time series, multi-service OWC environment produces a complex sequential EE optimisation problem. To address this problem, this work proposes Dual-Agent Resource Allocation using Deep Reinforcement Learning (DARA-DRL). DARA-DRL combines a branching duelling deep Q-network for association and subcarrier allocation with a conditional soft actor-critic agent for continuous power control. The agents are coupled through a common reward and a cooperative value update that evaluates each discrete allocation together with its corresponding power decision. Simulation results show that DARA-DRL remains within 5\% of the optimal solution and, compared with state-of-the-art benchmarks, it improves EE by 28.8\% and QoS satisfaction by 10.5\%, while reducing online decision time by 14.5\%. Results demonstrate that agent specialisation simplifies mixed-action learning, and cooperation outperforms independently trained agents.

0.29

Performance Analysis of LoRa and LR-FHSS in 3GPP LEO Satellite and HAPS Channel Scenarios for Remote Area IoT Coverage

eess.SP ·2026-09-07 ·Jean Michel de Souza Sant'Ana, Nurul Huda Mahmood, Vinicius Pozzobon Borin
published similarity 0.59
Abstract · 5 pages, 5 figures, 2 tables, presented at Wireless Europe 2026, Rimini, Italy, June 2026

In this paper, we analyze and compare the performance of LoRa and LR-FHSS in a remote area Internet-of-Things (IoT) connectivity scenario using a low-earth orbit (LEO) satellites and high-altitude platform station (HAPS)-mounted gateway. We conducted a link budget analysis to evaluate communication stability to assess the ability of the technologies to support the different distances and behaviors using a 3GPP channel model for non-terrestrial networks. Several parameters are considered, such as altitude, minimum elevation angle as well as the impact of different types of loss, such as shadow and fast fading, ionosphere scintillation loss, for example. Our findings highlight the performance gap between LR-FHSS and LoRa in terms of both connectivity. We also highlight how lower HAPS altitudes can benefit certain LoRa settings compared to LEO satellites. We show that HAPS can enable the use of lower LoRa spreading factors, which improves scalability and energy efficiency, while LR-FHSS and a higher spreading factor LoRa remain the solution for LEO satellites.

0.36

Pareto-Aware Hierarchical Reinforcement Learning for Online Resource Allocation in RIS-assisted Large-Scale IoT Systems

cs.NI ·2026-08-13 ·Wenhan Xu, Jiashuo Jiang, Danny H. K. Tsang
similarity 0.58
Abstract

With the rapid evolution of 5G and emerging 6G networks, reconfigurable intelligent surfaces (RIS) have become a critical technology for enhancing wireless communication scenarios. However, optimizing RIS-assisted multi-user systems typically introduces high-dimensional physical layer variables and non-convex Pareto-optimal rate sets, posing severe computational challenges for real-time applications. To address these limitations, this paper proposes a dimension-reduced, hierarchical reinforcement learning (RL) framework, termed Pareto-aware autoencoder-assisted RL (PAAERL), to optimize online resource allocation in RIS-assisted Internet of Things (IoT) networks. Our approach first substitutes high-dimensional continuous RIS beamforming variables with lower-dimensional weight vectors that strictly represent the Pareto-optimal frontier, theoretically avoiding geometric information loss across both convex and non-convex rate regions. To further mitigate the curse of dimensionality in dense networks, an autoencoder architecture is integrated to execute a secondary, data-driven compression phase, mapping the priority space into a highly condensed continuous latent action space. Extensive simulations conducted across practical communication scenarios, including multi-user mobile edge computing (MEC) networks, demonstrate that the proposed PAAERL framework drastically reduces offline training times, accelerates online policy convergence, and significantly decreases overall network costs compared to state-of-the-art benchmarks, underscoring its exceptional scalability and practical viability for next-generation intelligent IoT environments.

0.04

Adaptive Hybrid Optical RF Transmission Based on Deep Reinforcement Learning for Ultra-Reliable Low Latency Communication

eess.SP ·2026-10-03 ·Stella N. Arinze, Isidore U. Uche, Augustine O. Nwajana
similarity 0.57
Abstract · 7 pages, 9 figures, 2 tables

Ultra Reliable Low-Latency Communication (URLLC) demands submillisecond latency and reliability above 99.999%, which are difficult to guarantee under dynamic wireless and atmospheric conditions. Although free space optical (FSO) links provide high-capacity transmission, their performance degrades under turbulence and fog, while radiofrequency (RF) links offer robustness but limited bandwidth. This paper presents a reinforcement learning-based hybrid optical RF framework that adaptively selects transmission modes to satisfy stringent URLLC requirements. The hybrid decision process is modeled as a Markov Decision Process and optimized using a Deep Q Network (DQN) controller. Extensive simulations under varying attenuation and fading scenarios demonstrate up to 35% latency reduction and 25 to 30 % throughput improvement compared to RF-only and static hybrid schemes, while maintaining reliability above 99.999%. A laboratory-scale testbed operating at 1550 nm and 28 GHz further validates the approach, showing less than 6% deviation between simulated and measured results. The proposed framework demonstrates the practical feasibility of intelligent hybrid transmission for mission-critical next generation wireless networks.

0.37

DRL-Based AoI Minimization for RSMA in Finite-Blocklength MU-MISO

cs.IT ·2026-10-08 ·Enes Kaya, Mehmet Alp Demircioğlu, Elif Tugce Ceran, Melda Yuksel
publishedbenchmark similarity 0.57
Abstract

This letter investigates age-of-information (AoI) minimization in multi-user wireless networks operating in the finite-blocklength (FBL) regime, which is critical for low-latency transmission of short state-update packets. While rate-splitting multiple access (RSMA) provides a powerful and flexible framework for interference management in multi-user FBL systems, the joint optimization of its parameters, such as precoding vectors, power allocation, and rate-splitting ratios, to guarantee information freshness results in analytically intractable complexity. To address this challenge, we propose an actor--critic deep reinforcement learning (DRL) framework to learn dynamic resource-allocation policies in multi-user multiple-input single-output (MU-MISO) broadcast channels. Simulation results show that the proposed RSMA-RL framework achieves consistently lower AoI than the state-of-the-art benchmarks, with substantial gains observed at low signal-to-noise ratio (SNR) and short blocklengths, while matching benchmark performance at high SNR with significantly lower online complexity via a single neural-network forward pass at execution.

0.41

A GNN-Enhanced Reinforcement Learning Framework for Emergency Communications in ORAN-based Non-Terrestrial Networks

eess.SP ·2026-09-06 ·Md. Thouhidur Rahman, Mustapha Benjillali, Halim Yanikomeroglu, Samir Saoudi
published similarity 0.56
Abstract · The paper accepted for presentation in GLOBECOM 2026

During disaster scenarios and periods of extreme data demand in next-generation wireless communications, conventional terrestrial networks (TNs) often become unreliable or fail entirely, leading to critical service disruptions. In such contexts, non-terrestrial networks (NTNs) emerge as a promising solution to ubiquitous and resilient connectivity. Furthermore, the open radio access network (ORAN) paradigm facilitates network disaggregation and flexible functional splitting among its key components, namely the central unit (CU), distributed unit (DU), and radio unit (RU), which can be deployed across heterogeneous NTN platforms according to service requirements. However, this flexibility introduces significant challenges in terms of network complexity and real-time control. To address these challenges, this paper proposes an intelligent ORAN-enabled NTN framework for emergency communication scenarios. The proposed system leverages graph neural networks (GNNs) to model the dynamic network topology and employs a reinforcement learning (RL)-based Q-learning algorithm, formulated as a Markov decision process (MDP), to enable adaptive and real-time network control. In this framework, network nodes are treated as states, and optimal decisions are learned based on system dynamics. The spatial distribution of user equipment (UE) is modeled using an inhomogeneous Poisson point process (IPPP) with a rejection sampling technique, capturing realistic user density variations. Simulation results demonstrate that the proposed GNN-enhanced RL approach significantly improves network performance in terms of latency and service reliability, thereby enabling efficient and robust operation under emergency conditions.

0.23