CS Paper Radar

Stackelberg Game with Multi-Agent Transformer for ISRS-Aware Resource Re-optimization in Multi-Band Optical Networks

Jiaxin Liu, Rentao Gu, Miao Zhu, Zeguang Zou, Hui Li, Yuefeng Ji

cs.NI physics.data-anphysics.optics ·submitted 2026-10-10 11:47 UTC · v1
top venue

Abstract

The rapid expansion of generative AI is driving computing infrastructures toward interconnected AI data centers. Multi-band optical networks have become the backbone of such connectivity. To accommodate increasingly dynamic traffic demands, these networks require continual resource re-optimization to improve resource utilization and reduce service blocking. However, multi-band transmission amplifies inter-channel stimulated Raman scattering(ISRS), inducing nonlinear coupling among services. This coupling complicates re-optimization, as local adjustments perturb the global power profile, creating interdependent optimization decisions across services. Moreover, the nonlinear interactions vary with the subset of services selected for re-optimization, and inappropriate selection may reduce re-optimization effectiveness or diminish achievable benefits. To address these challenges, we propose a Stackelberg Game with Multi-Agent Transformer (SG-MAT) approach for ISRS-aware resource re-optimization. SG-MAT employs a leader-follower structure, in which the MAT-based follower models nonlinear coupling and generates coordinated channel reallocations, feeding the utilization improvements to the leader. Using this feedback, the leader identifies critical service subsets, approximating a Stackelberg equilibrium to guide global decisions and enabling consistent and efficient re-optimization. Simulation results show that SG-MAT achieves the highest utilization improvement and reduces the blocking ratio by approximately 30% under moderate traffic loads, with computational complexity comparable to benchmarks.

DOI
10.1109/TCCN.2026.3732526

Closest papers

Nearest neighbours by meaning across the whole index.

Toward Agentic Optical Networks: A Vision of LLM Agent-Driven Autonomous Lifecycle Management

cs.NI cs.AI ·2026-09-26 ·Yao Zhang, Shengnan Li, Yuchen Song, Yidi Wang, Yue Pang +9 more
published similarity 0.60
Abstract

As optical networks continue to expand in scale, complexity, and service diversity, the implementation of automation has become essential for ensuring agility, efficiency, and reliability in lifecycle management (LCM) of optical networks. Large language model (LLM) Agent, distinguished by its progressively sophisticated capabilities in logical reasoning, adaptive decision-making, complex problem solving, and multi-task orchestration, presents great opportunities to advance network automation beyond traditional AI techniques. Nevertheless, the application of LLM Agent in optical networks remains in its early exploratory stage, challenged by the lack of multi-task coordination, high computational demands, data dependence, and reliability concerns. In this paper, we envision a conceptual roadmap toward Agentic Optical Networks (AONs) by integrating LLM Agents throughout the LCM with high-level autonomy. First, we trace the evolution from manual operations to AI-empowered frameworks and distill key technologies in Agent, providing actionable insights into leveraging its strengths for addressing practical network automation challenges. A core contribution of this paper is the proposal of a hierarchical multi-Agent framework, which is specifically developed to manage every phase in LCM of AONs, including planning, deployment, operation, maintenance, upgrade, and decommission, thereby enabling more cohesive and comprehensive automation throughout the entire lifecycle. In addition, future directions and underlying challenges are also discussed at the intersection of LLM and optical networks. By aligning the LLM Agent with the specialized requirements of AONs, this work aims to explore the potential for the evolution of optical networks moving from task-level semi-automatic execution toward lifecycle-level full autonomy.

0.36

RL-based Network Slice Embedding over Space Division Multiplexed Elastic Optical Networks

cs.NI ·2026-08-29 ·Divya Khanure, Riti Gour†, Congzhou Li, Jason P. Jue
similarity 0.59
Abstract · 6 pages

Network slicing over space-division-multiplexed elastic optical networks (SDM-EONs) requires jointly managing spectrum, spatial cores, and compute resources, a coupling that many existing studies ignore by treating compute placement independently from routing and spectrum decisions. This disconnect can cause the spectrum to be allocated along a path, only for the request to fail due to insufficient compute resources along the path, or may result in compute resources being allocated without consideration for spectrum resource availability on the path between compute nodes. We propose a path-constrained reinforcement learning framework that addresses compute node selection and RMCSA, being aware of both resources, restricting the RL agent's action space to nodes along $k$-shortest paths between request endpoints. Training incorporates reward shaping to improve robustness under high load. We propose PPO-Full (Proximal Policy Optimization-Full), which jointly selects compute nodes and routing paths via a multi-dimensional action space, against distance-based heuristics, a greedy baseline, and a decoupled VONE-DRL baseline on a 24-node USNET topology under hotspot traffic conditions. Results demonstrate consistent improvements in acceptance rate over all baselines at high load, with gains becoming more pronounced as traffic intensity increases.

0.28

Cooperative Dueling DQN SAC Learning for Energy Efficiency in Dynamic OWC Networks

eess.SY ·2026-10-07 ·Walter Zibusiso Ncube, Ahmad Adnan Qidan, Taisir El-Gorashi, Jaafar M. H. Elmirghani
hot direction similarity 0.57
Abstract

Growing wireless traffic is increasing pressure on the congested radio-frequency spectrum. Optical wireless communication (OWC) provides a complementary solution by using the abundant unlicensed optical spectrum. However, indoor OWC networks are dynamic: users move, enter or leave the network, and subscribe to different services. Poorly coordinated resource allocation can consequently waste subcarriers, require excessive transmission power and cause frequent AP reassignments. Energy efficiency (EE), defined as the total delivered data rate divided by the total network power consumption, therefore requires the serving AP, number of allocated subcarriers, and transmission power to be jointly adapted while maintaining QoS. Optimising these in a dynamic time series, multi-service OWC environment produces a complex sequential EE optimisation problem. To address this problem, this work proposes Dual-Agent Resource Allocation using Deep Reinforcement Learning (DARA-DRL). DARA-DRL combines a branching duelling deep Q-network for association and subcarrier allocation with a conditional soft actor-critic agent for continuous power control. The agents are coupled through a common reward and a cooperative value update that evaluates each discrete allocation together with its corresponding power decision. Simulation results show that DARA-DRL remains within 5\% of the optimal solution and, compared with state-of-the-art benchmarks, it improves EE by 28.8\% and QoS satisfaction by 10.5\%, while reducing online decision time by 14.5\%. Results demonstrate that agent specialisation simplifies mixed-action learning, and cooperation outperforms independently trained agents.

0.29

RAMA: Retrieval-Augmented Multi-Agent Routing with Episodic Memory for LEO Satellite Networks

cs.NI cs.LG ·2026-10-30 ·Xin Ming Li, Peng Hu
similarity 0.56
Abstract

Low-Earth orbit (LEO) satellite networks present a challenging routing environment due to rapidly changing topology, traffic, and link conditions. Existing deep reinforcement learning (DRL) routing methods typically rely on current observations and information encoded in network weights, limiting their ability to exploit successful past experiences. We propose RAMA, a retrieval-augmented multi-agent DRL framework with Approximate Information State (AIS), in which each satellite combines its local observation, recent routing history, neighboring state information, and retrieved entries from a per-satellite episodic memory. Retrieved experiences are integrated through a Transformer-based decision network trained with AIS-based auxiliary objectives. With weights frozen in a 140-satellite Kepler constellation, RAMA reduces mean end-to-end latency by 13.4% and 99th-percentile latency by 66.7% relative to the state-of-theart double deep Q-network (DDQN) routing method, mainly by avoiding long detours. Updated online, RAMA remains stable while DDQN degrades. On the 1,584-satellite Starlink shell 1, the reduction in mean latency grows to 93.2%, and updating RAMA online lowers its mean latency by a further 25.5%. These results demonstrate the effectiveness of retrieval-augmented memory for scalable decentralized routing in LEO satellite networks.

0.24

THz-SynC: Collective Synthesis with Contextual-Bandit-Assisted Coordination for Reconfigurable Hybrid Optical-THz AI Datacenters

eess.SP ·2026-09-03 ·Jingting Jiang, Chong Han
similarity 0.55
Abstract

Terahertz (THz) wireless interconnects offer high-capacity, low-latency, and energy-efficient rack-to-rack links capable of on-demand connectivity reconfiguration, serving as a promising complement to optical fabrics for communication-intensive distributed AI training datacenters. However, co-optimizing optical and THz resources to minimize collective completion time and transmission energy remains challenging due to dynamic optical congestion, THz channel fluctuations, and heterogeneous compute stragglers. Existing reconfigurable data-center designs predominantly optimize network topology and traffic routing, with limited consideration of collective communication semantics in distributed AI workloads over hybrid fabrics. To address these challenges, we propose THz-SynC, a novel framework that integrates collective synthesis with contextual-bandit-assisted hybrid-fabric coordination to optimize the tradeoff between collective completion time and transmission energy. By exploiting collective-specific semantics, THz-SynC synthesizes tailored communication topologies for All-to-All and AllReduce patterns while dynamically allocating THz resources. Furthermore, a contextual-bandit coordinator adaptively routes communication chunks across optical and THz links and selects rack power budgets leveraging real-time observations of network states and collective semantics. Trace-driven evaluations show that THz-SynC outperforms wired-only, wireless-only, and hybrid baselines, achieving a superior delay-energy Pareto frontier under dynamic network conditions.

0.49

Adaptive E2E Monitoring Path Selection with Deep Reinforcement Learning in Multi-domain Optical Networks

cs.NI ·2026-10-07 ·Soham Choudhury, Martin Bojinov, Jason P. Jue, Genya Ishigaki
published similarity 0.55
Abstract · To be published in Journal of Optical Communications and Networking

Network slicing over multi-domain optical networks enables resource isolation for high-bandwidth, virtually-dedicated networks. However, guaranteeing end-to-end (E2E) performance remains challenging when domains withhold internal topology and performance metrics from external entities. Under this limited visibility, a control function (slice coordinator) needs to select E2E monitoring paths to detect and localize link failures. This paper formulates two complementary optimization problems, the initial and progressive monitoring path selection problems, which together realize closed-loop autonomous monitoring at the slice coordinator level. The initial problem maximizes failure coverage without prior information, while the progressive problem concentrates additional paths around suspected failure locations identified from prior monitoring. We propose a deep reinforcement learning (DRL) algorithm that adaptively selects an optimal set of monitoring paths for each phase. Experiments using the GNPy optical network simulator demonstrate that our approach outperforms baseline algorithms for both problems and achieves near-optimal localization in the initial selection, suggesting the feasibility of AI-driven closed-loop failure localization in future multi-domain optical network architectures.

0.27

Mission-critical spectrum sharing with decentralized Multi-Agent Reinforcement Learning

eess.SY cs.ITmath.OC ·2026-10-06 ·Dimitrios Pylorof, Imtiaz Nasim, Humberto E. Garcia, Vivek Agarwal, Jasni A. Mannil +1 more
published similarity 0.54
Abstract · Accepted for publication in the proceedings of IEEE CCNC 2027

Motivated by emerging mission-critical applications and an increasingly congested spectrum, we develop a decentralized multi-agent reinforcement learning (MARL) model for dynamic spectrum access. The model enables secondary users to learn effective transmission strategies across shared frequency bands while minimizing collisions with high-priority primary users and among themselves. We design the agent-level learners following a Markov potential game approach, connecting independent local updates to system-level improvement. We instantiate this design using lightweight linear actor-critic learners suitable for resource-constrained edge devices, rather than computationally intensive centralized or deep multi-agent architectures. Across spectrum environments with different incumbent activities, the learned policies adapt their transmission policy and waiting behavior to preserve throughput while greatly reducing transmission collisions relative to random and forecast-aware heuristic baselines. The results establish the value of decentralized MARL and shows up to 96.8% reduction in overall collisions.

0.32

OrbitWeaver: LLM Agent Planning with Simulation Feedback for Optically Interconnected Orbital GPU Clusters

cs.DC eess.SY ·2026-11-13 ·Pengcheng Luo, Bowen Zhang
similarity 0.54
Abstract

Space-based data-center designs increasingly consider GPU computing formations connected by inter-satellite optical links. With limited neighboring connections, jobs assigned disjoint GPUs can still contend on shared relay paths. Rank placement and communication priorities jointly affect this contention and the readiness of downstream computation. We present OrbitWeaver, an offline large language model (LLM) agent planner that jointly optimizes rank placement and communication order. Guided by communication structure, execution dependencies, and simulation feedback, the agent constructs and refines plans that coordinate shared-link access with computation progress. This coordination reduces contention and dependency blocking, shortening mean job completion time (JCT). Simulation experiments on optically interconnected orbital GPU clusters show that OrbitWeaver reduces aggregate mean JCT by 6.2-33.5% relative to the state-of-the-art baselines CASSINI, Crux, and Symphony. These results demonstrate the value of LLM-guided planning for efficient concurrent computing in orbital GPU clusters.

0.23