CS Paper Radar

PRISM: RL-Based Rate Control for Low Latency and High Data Rate in Mobile Edge Networks

Hamid Hassani, Staji Wilson, Kishor C. Joshi, Sonia M. Heemstra, Ignas G. Niemegeers, George Exarchakos

cs.NI ·submitted 2026-11-01 16:25 UTC · v1

Abstract

Emerging delay-sensitive interactive services, such as extended reality and remote operation, demand advanced congestion control algorithms (CCAs) capable of maintaining high data rates while keeping latency low in mobile networks. Existing CCAs typically rely on congestion signals such as packet loss, delay, or explicit congestion notification (ECN) marks, which can be delayed, imprecise, or require extensive upgrades to the network infrastructure. To address these limitations, physical resource block (PRB) utilization has recently been proposed as a reliable early congestion signal in mobile networks [1]. This paper introduces PRISM, a reinforcement-learning-based CCA that uses peak PRB utilization to regulate the send rate under challenging mobility and fading conditions. NS3 simulation results show that, in a mobility scenario where two PRISM flows coexist with two TCP Cubic flows and one TCP BBR flow, PRISM maintains a per-packet mean one-way delay (OWD) of 6.3ms and a $p_{99}$ OWD of 44.6ms, with negligible (0.02%) packet loss, over a 20min high-contention interval. However, over the same interval, the coexisting TCP flows experience 60x higher mean OWDs of 371-390ms and $p_{99}$ OWDs of 563-578ms, with 0.1% packet loss. PRISM achieves a 31x improvement in goodput-over-latency performance, indicating a favorable tradeoff for delay-sensitive applications.

Closest papers

Nearest neighbours by meaning across the whole index.

RAPID: Proactive Rate Control for Enabling High Data Rate and Low Latency in 5G Edge Networks

cs.NI ·2026-10-09 ·Hamid Hassani, Sonia M. Heemstra de Groot, Ignas G. Niemegeers, Kishor C. Joshi, George Exarchakos
top venuehighly cited similarity 0.71
Abstract

Many 6G use cases such as tactile Internet and eXtended reality applications would simultaneously require a high data rate and low latency wireless connectivity.It is increasingly being realized that the current transport protocols relying on packet loss and delay are insufficient to satisfy the data rate and latency requirements of such applications. To address this problem, we propose RAPID, a transport layer solution designed for private 5G edge networks, where the bottleneck is located at the base station. We show that by regulating the send rate to maintain a target physical resource block utilization, we can achieve high data rate, low latency communication. We design a simple yet effective policy that adapts to the dynamic nature of wireless channel conditions. In a multi-UE scenario with two RAPID flows and one TCP Cubic flow, our testbed results show that RAPID flows achieve significant improvements in one-way delay, i.e., 72x and 55x lower compared to TCP Cubic, with negligible packet loss at the cost of modest goodput reductions of 16% and 27%, respectively.

0.73

One-Way Delay Model for 5G Low Latency, High Data Rate Communications

cs.NI ·2026-10-09 ·Hamid Hassani, Sonia M. Heemstra de Groot, Ignas G. Niemegeers, Kishor C. Joshi, George Exarchakos
publishedhighly cited similarity 0.63
Abstract

Achieving low delay and high data rate communication in 5G requires preventing persistent queue backlogs at path bottlenecks. A key indicator of queue buildup is an increase in one-way delay (OWD) of packets. However, accurately measuring OWD is challenging due to synchronization issues between the sender and receiver. Moreover, using OWD to infer the onset of queueing can be inefficient. For instance, congestion control mechanisms that rely on latency as a congestion signal may result in cellular network underutilization, see, e.g., [1]. Thus, to develop more efficient rate control approaches, it is crucial not only to estimate OWD accurately but also to perform a more fine-grained analysis that provides detailed insights into the queue status. This paper presents a framework for modeling OWD in 5G edge networks, where the wireless link is typically the path bottleneck. %, by modeling it through measurable delay components. We demonstrate that OWD is dominated by queueing delay (QD), particularly at high data rates. We analyze QD by decomposing it into two main components: aggregation delay and channel access time. Aggregation delay can be accurately measured at the user equipment (UE), and channel access time can be estimated based on network conditions. Our key contribution shows that QD, while challenging to measure directly at the base station (BS), can be closely approximated by combining these components. We validate this model through NS3 simulations under varying network loads and single- and multi-UE scenarios. This framework provides a foundation for developing advanced mechanisms for congestion control and bottleneck detection in 5G networks.

0.67

Delay and Throughput Analysis of Computation Offloading in Mobile Edge Computing: A Queueing Network Approach

cs.NI ·2026-09-05 ·Amirparsa Bahrami, Farid Ashtiani
similarity 0.62
Abstract

Mobile edge computing (MEC) enables mobile devices to offload computation to nearby edge servers and to the cloud in order to reduce end-to-end delay for different applications. In this paper, we study static computation offloading when each task consists of multiple dependent subtasks represented by a rooted directed tree. We develop a product-form queueing-network (PFQN) model with an approximation to capture the computation and communication dynamics of tree-structured task execution in a multi-tier MEC system. Based on this model, we derive closed-form expressions for server utilizations and waiting times, and then construct a recursive algorithm for evaluating the average delay of general tree-structured tasks. We formulate the static offloading design problem as the minimization of the rate-weighted average task delay over the routing probabilities, and solve it through a differentiable optimization framework based on softmax parameterization, log-sum-exp smoothing, and a stability barrier on server utilizations. Numerical results show that the proposed PFQN approximation provides accurate delay estimates and that the delay-optimized static policy consistently outperforms the considered baseline algorithms in terms of both average task delay and maximum stable throughput.

0.19

QueueTrack: Framework for Detecting the Onset of Queueing in Mobile Networks

cs.NI ·2026-11-01 ·Hamid Hassani, Anudeep Karnam, Kishor Joshi, Sonia M. Heemstra, Ignas G. Niemegeers +1 more
published similarity 0.60
Abstract

In mobile networks, timely and accurate detection of the onset of queueing at path bottlenecks remains challenging for end-to-end congestion control algorithms (CCAs), where end hosts have limited visibility into queue status. Traditional congestion signals, such as packet loss, round-trip time (RTT), and one-way delay (OWD), have well-known limitations for early queue buildup detection. This paper presents QueueTrack, a practical end-host framework to detect the onset of queueing in mobile networks. QueueTrack computes a queue buildup indicator, denoted QBI, from endpoint-observable packet-level timing statistics, without requiring tight synchronization between end hosts or modifications to the existing network infrastructure. We develop and assess the complete QueueTrack machine learning (ML) pipeline, including data collection, labeling, model training, and testing, on a 5G testbed built on the OpenAirInterface platform, under a range of scenarios with competing TCP traffic. The experimental results show that QueueTrack can reliably detect the onset of queueing at the 5G base station using low-complexity classification models such as logistic regression. For example, QueueTrack achieves an F1 score of approximately 80% in a challenging mixed TCP/UDP scenario. These findings confirm that QueueTrack can serve as a practical framework for developing CCAs that target low delay, as well as for network telemetry and network monitoring in mobile networks.

0.26

Deadline-Aware Multi-Agent Reinforcement Learning for TSN-Based Vehicular Edge Networks

cs.NI cs.AI ·2026-10-07 ·Bernardo A. C. Pereira, Marcos Carvalho, Fatih Temiz, Shavbo Salehi, Melike Erol-Kantarci +3 more
similarity 0.60
Abstract

Vehicular edge computing (VEC) enables latency-sensitive applications by bringing computing and networking resources closer to vehicles. However, existing approaches often overlook network contention among co-located services with heterogeneous and dynamic latency requirements. While time-sensitive networking (TSN) provides bounded-latency communication, conventional and reinforcement learning-based schedulers struggle to adapt to highly dynamic vehicular environments and inter-queue dependencies. To address these limitations, we propose a multi-agent reinforcement learning (MARL) approach for queue-level scheduling in TSN-enabled VEC. Each TSN queue is assigned an autonomous agent that jointly learns the queue service order and time-slot duration to minimize deadline misses under speed-dependent latency requirements. We employ multi-agent proximal policy optimization (MAPPO) to enable coordinated yet autonomous scheduling decisions. Evaluation against single-agent, multi-agent, and non-learning-based baselines shows that MAPPO provides robust performance across different traffic profiles. Compared with centralized single-agent methods, it reduces service latency by up to 66.2% and improves reliability by up to 271.8%. Furthermore, unlike urgency-based heuristics, MAPPO ensures balanced scheduling while achieving lower inference times compared to other MARL methods.

0.21

A mechanism for TCP-aware Active Queue Management in packet-forwarding devices

cs.NI ·2026-10-17 ·Swarnarup Bhunia, Somit Gond, Vayun Goel, Sreelakshmi Manjunath, Padmanabhan Rajan
similarity 0.60
Abstract

The deployment of Active Queue Management (AQM) policies is known to be a promising solution to bufferbloat, the problem of persistently-full large buffers in Internet routers. However, most AQMs involve tunable parameters, and some require awareness of the characteristics of the transport-layer protocol implemented at the end systems, thereby rendering their deployment infeasible. We consider one such AQM-- a threshold-based queue policy which requires the packet-dropping threshold to be co-designed with relevant TCP parameters. We propose a mechanism that detects network congestion, estimates the congestion window evolution in the end hosts, estimates the required TCP parameter, and produces an optimal value of the packet-dropping threshold. Arguments based on analysis of the TCP fluid model are presented to substantiate the proposed mechanism. A simulation-based performance evaluation reveals the effectiveness of the proposed mechanism, compared to some widely implemented queue policies, in terms of various user- and system-oriented metrics. The proposed mechanism is particularly well-suited for implementation in Software Defined Networks (SDN) where the algorithms can run in the SDN controller and the packet-dropping threshold can be implemented in the data-plane switches through open interfaces.

0.15

From Prior-Guided Heuristics to Deployable Agents: Accelerating Demonstration-Driven Reinforcement Learning for Deadline-Constrained Network Control

cs.NI cs.AI ·2026-09-03 ·Vincenzo Norman Vitale, Mohammad Solki, Antonia Maria Tulino, Andreas F. Molisch, Jaime Llorca
similarity 0.60
Abstract

Timely delivery of delay-sensitive information over dynamic, heterogeneous networks is essential for NextG interactive applications, yet providing strict End-to-End (E2E) peak latency guarantees remains an open challenge. Two obstacles limit the adoption of learning-based network control in this setting: traditional volume-based routing metrics, while highly effective for general traffic management, are not designed to capture traffic urgency; and Deep Reinforcement Learning (DRL) controllers trained from scratch suffer from sample inefficiency, long training times, and early-stage exploration volatility. This paper introduces a deployment-focused network control framework that addresses both obstacles. First, we present Effective Congestion (EC), a deadline-aware metric family that quantifies interface congestion by packet urgency and proactively filters non-viable traffic, coupled with a Uniform Path Grouping (UPG) distribution heuristic promoting robust load-balancing; the resulting policies are embedded into Multi-Agent Deep Reinforcement Learning Effective Congestion ($p^*$) (MADRL EC ($p^*$)), a hybrid architecture combining a distributed scheduler with a centralized RL-based router. Second, we introduce a unified training objective that generalizes existing policy-learning paradigms---behavioral cloning, offline Reinforcement Learning (RL), online RL, and offline-to-online schemes---as special cases, combining a live-reward term, a pre-collected-reward term, and a policy-imitation term. From this objective, we derive the Model-Guided Annealed Reinforcement Learning (MGA-RL) protocol, instantiated on a Deep Deterministic Policy Gradient (DDPG) backbone: a deployment-oriented, demonstration-driven training approach that generalizes conventional Offline-to-Online (O2O) schemes, in which trajectories from a lightweight [...]

0.10

Traffic Congestion Awareness and On-Demand Distribution in Vehicular Delay-Tolerant Networks in California I-210 Freeway

cs.NI ·2026-09-28 ·Xiaofei Liu, Milena Radenkovic
similarity 0.58
Abstract

In vehicular networks under edge computing environments, vehicle-to-vehicle delay-tolerant networking (V-DTN) can disseminate congestion warnings to other vehicles via a store-carry-forward mechanism, helping them proactively choose suitable routes. However, most existing in-vehicle information dissemination methods rely on flooding or limited flooding strategies, broadcasting alerts across the entire network whenever congestion is detected. This leads to excessive redundant copies and consumes node cache space. To address this issue, this paper proposes a congestion-event- aware on-demand message dissemination mechanism. By considering the recurrence and duration of congestion, the mechanism suppresses broadcasts of short-lived, self-dissipating congestion events. Based on real-world PeMS data from California's I-210 corridor, we construct an I-210 Freeway Traffic Congestion Use Case. Experiments show that predicting congestion recurrence heavily relies on historical free-flow speed data of lanes. Without incorporating additional feature dimensions, the accuracy of modeling and comparing lane free-flow speeds across different day types outweighs the choice of machine learning models, and such patterns are difficult to reproduce in simulators. Meanwhile, congestion duration prediction serves effectively as the basis for dynamic-threshold on-demand dissemination in V-DTN, which demonstrate that machine learning-based congestion awareness combined with dynamic-threshold on-demand dissemination significantly reduces network resource consumption and network-layer congestion, enhances delivery reliability, and lowers delivery latency.

0.21