CS Paper Radar

MINT: Modeling GenAI Impact on Network Traffic

Andrew Nguyen, Samson Kempiak, Agrim Gupta, Koushik Kar, Ish Kumar Jain

cs.NI eess.SY ·submitted 2026-09-28 17:54 UTC · v1

Abstract

Generative AI (GenAI) is becoming a mainstream network workload, yet packet-level simulators lack measure\-ment-driven GenAI traffic models. Currently researchers must approximate GenAI services using traditional sources such as file transfer and video streaming, limiting realistic network evaluation of scheduling and capacity planning. We present MINT, a measurement and modeling framework for GenAI network traffic. Using an isolated net\-work-namespace capture pipeline, we collect client-side traces from three LLM providers across four modalities, cloud and edge servers, and wired and wireless network access points. We find that GenAI modalities exhibit distinct upload/download asymmetry and burst structures that differ from traditional applications. MINT clusters and models these burst regimes and validate empirical burst timing distribution behavior in ns-3 with normalized Wasserstein distances of 2--25\%. Our results also reveal that realistic packet bursts have significantly more variability than constant token generator models. MINT open-sources the first measurement-driven GenAI traffic model for packet-level network simulation.

Comment
10 pages, 12 figures, including 1 page of references and 1 page of supplemental material. Accepted to ACM WiNTECH 2026
DOI
10.1145/3831662.3844175

Closest papers

Nearest neighbours by meaning across the whole index.

Characterizing AI Service Traffic for 6G: An Open Testbed and Initial Results from 3GPP SA4

cs.NI ·2026-11-04 ·Imed Bouazizi
similarity 0.65
Abstract · 19 pages

The design of sixth generation (6G) mobile systems requires measurements of artificial intelligence (AI) service traffic under controlled network conditions. The 3rd Generation Partnership Project (3GPP) Service and System Aspects Working Group 4 (SA4) documents such measurements in draft Technical Report 26.870. In this paper, we describe the open testbed used for the study and analyze the results recorded in version 0.6.2 and its companion workbook. The testbed combines network emulation, packet capture, application measurements, and scenario execution against hosted and self-hosted models. The reported uplink to downlink volume ratios span more than six orders of magnitude. A personal assistant agent has a ratio of 0.007 at its local control interface and 0.50 on its wide-area egress. Deterministic agent signaling follows the configured round-trip delay. In a tokenized video experiment with 125 questions per profile, the number of correct answers changes by at most three through 10% independent uplink loss. Larger losses reduce accuracy, but the available repetitions do not establish a tolerance threshold. We also analyze emulator behavior that affects the interpretation of the study. Per-packet jitter introduces reordering, correlated random-loss settings suppress rare loss events, and a Gilbert-Elliott parameter mapping changes the stationary loss rate. The results support characterization by scenario, measurement layer, and versioned network configuration.

0.24

QueueTrack: Framework for Detecting the Onset of Queueing in Mobile Networks

cs.NI ·2026-11-01 ·Hamid Hassani, Anudeep Karnam, Kishor Joshi, Sonia M. Heemstra, Ignas G. Niemegeers +1 more
published similarity 0.60
Abstract

In mobile networks, timely and accurate detection of the onset of queueing at path bottlenecks remains challenging for end-to-end congestion control algorithms (CCAs), where end hosts have limited visibility into queue status. Traditional congestion signals, such as packet loss, round-trip time (RTT), and one-way delay (OWD), have well-known limitations for early queue buildup detection. This paper presents QueueTrack, a practical end-host framework to detect the onset of queueing in mobile networks. QueueTrack computes a queue buildup indicator, denoted QBI, from endpoint-observable packet-level timing statistics, without requiring tight synchronization between end hosts or modifications to the existing network infrastructure. We develop and assess the complete QueueTrack machine learning (ML) pipeline, including data collection, labeling, model training, and testing, on a 5G testbed built on the OpenAirInterface platform, under a range of scenarios with competing TCP traffic. The experimental results show that QueueTrack can reliably detect the onset of queueing at the 5G base station using low-complexity classification models such as logistic regression. For example, QueueTrack achieves an F1 score of approximately 80% in a challenging mixed TCP/UDP scenario. These findings confirm that QueueTrack can serve as a practical framework for developing CCAs that target low delay, as well as for network telemetry and network monitoring in mobile networks.

0.26

DLB: Distributed Load Balancing at Scale for Generative AI Inference

cs.DC eess.SY ·2026-09-17 ·Santiago R. Balseiro, Bartek Wydrowski, Sameer Agarwal, David Applegate, Aaron Archer +9 more
similarity 0.57
Abstract

The reliance on scarce and expensive accelerators such as GPUs and TPUs in modern datacenters places unprecedented demands on backend infrastructure. For workloads characterized by heterogeneous service times and complex multi-stage processing, such as Generative AI, conventional load balancing techniques are often inadequate, relying heavily on costly overprovisioning to maintain service level objectives. This paper introduces DLB, the Distributed Load Balancer, a novel system designed to minimize end-to-end user latency for large-scale, heterogeneous workloads. DLB employs a scalable, distributed design with peer-to-peer probing to maintain real-time visibility into server capacity across large-scale, geographically distributed infrastructure. The system continuously learns latency models to estimate the latency impact of routing decisions, allowing it to effectively manage heterogeneous hardware and diverse model architectures. We provide a novel theoretical analysis of our routing algorithms that establishes their stability and global performance guarantees over time. We also evaluate DLB through extensive simulations, which show substantial gains compared to state-of-the-art load balancing algorithms. Finally, following a 22-month deployment of DLB at Google, where it facilitates large-scale Generative AI inference for thousands of different machine learning models and millions of requests per second, we detail the design choices and practical experiences gained from the system in production. Analysis of production migrations demonstrates that DLB yields statistically significant latency reductions compared to the legacy baseline, including a 17\% decrease in median latency and a 13\% decrease at the p95 tail.

0.22

Unified AI Gateway: A Framework for Joint Model Routing and KV Cache Management

cs.DC ·2026-09-07 ·Jiaxun Lu, Xiang Zhang, Yunfeng Shao
similarity 0.57
Abstract · 15 pages, 5 figures

Large language model (LLM) inference increasingly spans models that differ in size, capability, price, and provider. This shift creates two costs for developers. One is the integration cost of choosing among and switching between many models. The other is the inference cost of rebuilding a KV cache when it is unavailable or incompatible with the selected model. We define and analyze the Unified AI Gateway as a system setting for an edge-deployed AI traffic hub. It coordinates model routing, KV cache management, and compute placement across end devices, edge resources, and cloud model services. At request time, the gateway jointly selects a target model, an execution site, and a KV cache action under task-quality, latency, cost, and resource constraints. In parallel, background cache-management actions optimize KV cache placement, replication, retrieval, and lifecycle decisions for subsequent requests. We synthesize existing evidence on KV cache reuse, compression, cross-model mapping, distributed storage, and transfer, and discuss the remaining challenges of integrating these capabilities into one system. Across eight typical workload profiles, our workload-level analytical simulation reports TTFT speedups of 1.25$\times$--13.28$\times$ and input-cost benefits of 1.20$\times$--6.16$\times$.

0.39

Network-Aware Forecasting on Wireless Access Points

cs.NI cs.LG ·2026-09-02 ·Niloo Bahadori, Swadhin Pradhan, Peiman Amini
similarity 0.57
Abstract · 5 pages, 2 figures, 1 table

Enterprise wireless access points (APs) are promising platforms for predictive machine learning (ML), but their primary responsibility remains providing wireless connectivity and network services. Predictive inference must therefore share an AP's CPU and memory with packet processing, Wi-Fi and IoT radio operations, and client management. This resource contention creates two risks: a model that performs well on proxy hardware may be too slow on the target AP, while a model that fits in isolation may still degrade network services under load. We define \textit{network-aware deployability} using two gates: qualification of the model and its execution path on the target AP, followed by validation of its execution profile under packet-service and forecasting constraints. Our benchmarks show that edge testbeds do not reliably capture target behavior. Across matched artifacts and serving settings, five model implementations run 6.1--19.1$\times$ slower on an AP than on a Raspberry Pi~5, while peak memory usage differs by up to 22\%. Moreover, two forecasting foundation models of similar size differ in AP latency by 19$\times$. When serving a smaller model across 13 parallel streams at a 30~s cadence under network saturation, default execution increases p99 round-trip time (RTT) by 76\% and reduces throughput by 7.06\%. Understanding these trade-offs is essential for live deployment if we aim to use APs for both networking and ML workloads.

0.28

An Empirical Evaluation of a Weighted PALU Model for Internet Traffic Networks

cs.NI ·2026-11-06 ·Wood Moore, Hayden Jananthan, Jeremy Kepner
unusual similarity 0.56
Abstract · 5 pages, 1 figure, IEEE MIT URTC 2026

The PALU model is a hybrid power law generative framework that decomposes Internet traffic graphs into three structural components: a preferential attachment core, degree one leaf nodes, and disconnected satellite clusters. Although the original PALU formulation provided a theoretical basis for this decomposition, it was never validated against real traffic data and was restricted to unweighted networks. This work presents the first empirical evaluation of PALU against real Internet traffic, using packet traces from the MAWI WIDE samplepoint F dataset. We introduce a weighted extension of the model incorporating strength degree scaling, and develop a packet-to-graph pipeline for parameter estimation across multiple observation window sizes. Results show that the power law degree exponent $α\approx 2.0$ remains stable across observation scales from $10^5$ to $3 \times 10^6$ packets, consistent with the PALU structural prediction. However, the satellite cluster parameter $λ$ and the weighted scaling parameter $θ$ exhibit systematic dependence on observation scale, and the Poisson star assumption for unattached components is formally rejected at all tested window sizes. These results indicate that PALU captures important aspects of Internet traffic structure but requires an explicit observation model to fully account for finite sampling effects.

0.27

One-Way Delay Model for 5G Low Latency, High Data Rate Communications

cs.NI ·2026-10-09 ·Hamid Hassani, Sonia M. Heemstra de Groot, Ignas G. Niemegeers, Kishor C. Joshi, George Exarchakos
publishedhighly cited similarity 0.56
Abstract

Achieving low delay and high data rate communication in 5G requires preventing persistent queue backlogs at path bottlenecks. A key indicator of queue buildup is an increase in one-way delay (OWD) of packets. However, accurately measuring OWD is challenging due to synchronization issues between the sender and receiver. Moreover, using OWD to infer the onset of queueing can be inefficient. For instance, congestion control mechanisms that rely on latency as a congestion signal may result in cellular network underutilization, see, e.g., [1]. Thus, to develop more efficient rate control approaches, it is crucial not only to estimate OWD accurately but also to perform a more fine-grained analysis that provides detailed insights into the queue status. This paper presents a framework for modeling OWD in 5G edge networks, where the wireless link is typically the path bottleneck. %, by modeling it through measurable delay components. We demonstrate that OWD is dominated by queueing delay (QD), particularly at high data rates. We analyze QD by decomposing it into two main components: aggregation delay and channel access time. Aggregation delay can be accurately measured at the user equipment (UE), and channel access time can be estimated based on network conditions. Our key contribution shows that QD, while challenging to measure directly at the base station (BS), can be closely approximated by combining these components. We validate this model through NS3 simulations under varying network loads and single- and multi-UE scenarios. This framework provides a foundation for developing advanced mechanisms for congestion control and bottleneck detection in 5G networks.

0.67

Towards Traffic Modelling of Multi-Agent Systems: The Role of Coordination Topology

cs.NI cs.AIcs.MA ·2026-08-20 ·Davide Lamagna, Albert Cabellos, Alberto Rodriguez-Natal, Gábor Rétvári, Berta Serracanta
top venuecode/data similarity 0.56
Abstract · 7 pages, 5 figures, 4 tables. Published at the ACM SIGCOMM Workshop on Networks for AI Computing (NAIC '26)

Multi-agent LLM systems are an emerging networked workload whose rapid deployment raises questions about the traffic patterns they generate. Compared to conventional applications, these systems generate requests internally: a single user task can induce a structured sequence of model calls whose timing is governed by coordination logic rather than by user arrival rate. It is not clear whether classical traffic models, designed for human-driven workloads, apply to this setting. We present an empirical characterisation of LLM-call interarrival time distributions across sequential, star, and full-mesh agentic coordination topologies, using a multi-layer measurement framework over 500 repeated runs per topology. We find that topology fundamentally shapes the arrival process of requests to the LLM backend: fan-out coordination introduces a structural bimodality absent in sequential execution, and the reasoningphase component is best described by a log-normal distribution, with the Poisson exponential null model decisively rejected across all topologies. These differences propagate to inference and network level metrics. The framework and analysis pipeline are released openly at https://github.com/dlamagna/agentraffic.

0.65