CS Paper Radar

Halley: A Predictive Control Plane for Optical AI Data Center Networks

Manav Mishra, Krishna M. Sivalingam

cs.NI cs.DC ·submitted 2026-11-03 06:45 UTC · v1

Abstract

A frontier AI model is trained in an AI data center, on tens of thousands of accelerators joined by a dedicated network, and every training step ends with all of them exchanging data at once. Between racks, that network is optical, and each of its four layers, from lasers to switches, runs a fixed or after-the-fact policy. Lasers sharing an enclosure, cooling, and power can fail together. At a fixed spare ratio, correlated failure provably caps a pool's availability however large it grows. In this paper, we present a comprehensive predictive control plane framework, called Halley, that reads each resource's next state and acts before the failure occurs. It has four components, each carrying a formal guarantee: LightReserve that sizes the laser pool to provide a coverage bound, FoldFit that schedules the switch within $11/9$ of the optimal, ThermaLead that holds a microring with one-step-ahead control, and TriageGuard that protects the highest-risk modules first. Halley gives each layer a predictive controller that defers to the deployed policy when unsure. Composed from simulations at that point, effective goodput, the share of ideal throughput kept, rises from 65.2\% to 76.5\% if a window that exhausts its spares is lost. If only the dark channels' bandwidth is lost, it reaches 67.4\%. Per megawatt, that is up to 1.03--1.17 times the training; for the same training, up to 3.3--14.7\% less data center capacity. \textsf{Halley}'s fallback circuits are formally verified and are shown to achieve close timing on a commercial FPGA, and pass a 130~nm signoff.

Comment
24 pages, 18 figures

Closest papers

Nearest neighbours by meaning across the whole index.

Adaptive E2E Monitoring Path Selection with Deep Reinforcement Learning in Multi-domain Optical Networks

cs.NI ·2026-10-07 ·Soham Choudhury, Martin Bojinov, Jason P. Jue, Genya Ishigaki
published similarity 0.60
Abstract · To be published in Journal of Optical Communications and Networking

Network slicing over multi-domain optical networks enables resource isolation for high-bandwidth, virtually-dedicated networks. However, guaranteeing end-to-end (E2E) performance remains challenging when domains withhold internal topology and performance metrics from external entities. Under this limited visibility, a control function (slice coordinator) needs to select E2E monitoring paths to detect and localize link failures. This paper formulates two complementary optimization problems, the initial and progressive monitoring path selection problems, which together realize closed-loop autonomous monitoring at the slice coordinator level. The initial problem maximizes failure coverage without prior information, while the progressive problem concentrates additional paths around suspected failure locations identified from prior monitoring. We propose a deep reinforcement learning (DRL) algorithm that adaptively selects an optimal set of monitoring paths for each phase. Experiments using the GNPy optical network simulator demonstrate that our approach outperforms baseline algorithms for both problems and achieves near-optimal localization in the initial selection, suggesting the feasibility of AI-driven closed-loop failure localization in future multi-domain optical network architectures.

0.27

Capturing Electrical Windows Through Reconfigurable Optical Networks: Transfer-aware Scheduling of Multi-Region AI Data Centers

cs.DC ·2026-10-09 ·Xi Tong, Zijian Li, Xiaoyi Fan, Cong Zhang, Ershun Du +1 more
benchmark similarity 0.58
Abstract · 10 pages, 12 figures

Artificial-intelligence data centers (AIDCs) can provide spatiotemporal load flexibility by migrating training workloads in response to regional electricity prices and renewable-energy (RE) availability. However, transfer-blind scheduling may overestimate migration benefits by overlooking transfer time or prevent training from resuming within renewable-rich or low-price windows when considering transfer time. This paper proposes a transfer-aware compute-electricity-network scheduling framework that coordinates training placement, checkpoint transmission, and optical circuit switching (OCS) to improve local RE utilization and reduce grid-purchase cost. A compact compute-electricity master problem generates candidate schedules using estimated transfer delays. The framework then schedules optical circuits, verifies checkpoint delivery under shared-link capacity constraints, and revises infeasible schedules using updated delay estimates. It integrates day-ahead planning, event-triggered intraday updates, and real-time dispatch. In a five-AIDC benchmark with equal completed work and network resources, the proposed method reduces the real-time grid purchase cost by 12.50% and increases the local RE utilization by 2.724 percentage points relative to static optical operation. Sensitivity and ablation analyses indicate that OCS is particularly beneficial when renewable-rich or low-price windows shift across sites and network bottlenecks hinder timely checkpoint delivery.

0.20

Generative World Models Enable Predictive Control of Laser Melt Pool Dynamics

cs.LG ·2026-10-05 ·Yiyang Yan, Markus Bambach, Mohamadreza Afrasiabi
similarity 0.57
Abstract

World models, which learn how environments respond to actions, are emerging as a powerful paradigm for planning through imagined futures, transforming decision-making across games, robotics and autonomous driving. Bringing this capability to manufacturing could enable process decisions on timescales inaccessible to high-fidelity simulation. Here we introduce a generative world model for localized highly dynamic laser melt pool that predicts evolution from histories of temperature and phase morphology under candidate actions. Its generative latent dynamics capture the effects of unresolved melt flow, enabling more accurate recursive rollouts than deterministic regressors under transient laser inputs. Because the learned dynamics are differentiable, the model can serve directly as a predictive control plant. Gradients through imagined futures optimize laser schedules that regulate melt-pool depth over previously unseen geometry, path, initialization. We further distil this optimization into an amortized policy that produces control actions in a single forward pass, providing a proof of concept for real deployment on machines.

0.22

AID: A Framework for AI Infrastructure Dynamics

cs.DC cs.LGcs.PFeess.SY ·2026-10-03 ·Abi Aryan
theory similarity 0.57
Abstract · 14 pages, 3 figures

A useful model of AI inference infrastructure must specify the system state, the information available to an observer, and the decisions the model is intended to support. We introduce AID (AI Infrastructure Dynamics), a framework for describing this learning problem across coupled physical, computational, networking, and serving processes. The formulation allows structured and variable-size state, asynchronous observations, multiple physical timescales, and demand that responds to service. We distinguish representations that support prediction under an existing policy from those that preserve service outcomes under changed actions, and separate both from identifying intervention responses. Two analytical results describe a lower bound on prediction error when available observations cannot distinguish models and a sufficient condition for exact controlled state reduction. These results apply established information and state-abstraction principles to AI infrastructure. We then describe a validation protocol for cache representations, workload histories, measurement availability, and imposed actions.

0.29

Risk-Aware Online Conformal State Probing

eess.SP cs.AI ·2026-09-22 ·Pietro Talli, Petar Popovski, Osvaldo Simeone
similarity 0.55
Abstract

AI-based autonomous agents, typically hosted at data centers, must acquire state information from robots or edge devices in order to issue informed control decisions. Managing uncertainty about the state is particularly consequential in safety-critical settings, in which average-case guarantees are insufficient. In this context, we study a sequential decision maker process that jointly decides which actions to take and when to probe given access to an arbitrary state prediction model. We propose online conformal state probing (OCSP), an action and probing policy that certifies worst-case reliability levels without relying on distributional assumptions. OCSP is designed to provably control the missed query error (MQE), i.e., the fraction of instances where probing would have been beneficial, while minimizing the probing rate. OCSP can be applied to existing pre-trained value-based control policies without requiring retraining or fine-tuning. We validate OCSP through numerical simulations to verify theoretical guarantees and to assess performance trade-offs as a function of the calibration of the state predictor.

0.21

Infrastructure-Aware Runtime Protection of Co-Deployed AI Services at the Industrial Edge

eess.SY ·2026-10-13 ·Nitya Sathyavageeswaran, Dibyajyoti Nath, Ziran Min, Pavan Athreya Narasimha Murthy
similarity 0.54
Abstract

In modern production lines, a single edge device simultaneously runs multiple AI services like a torque-control model, a vision inspector, a predictive maintenance routine. All these services run on the same CPU and same shared network segment. When the shared network segment saturates, the services do not crash. The services just produce outputs that are inaccurate or stale, and no longer reflect the plant's conditions. Our paper targets this class of silent, partial failure scenarios in Industrial Edge Systems. We treat each co-deployed service as an autonomous agent. We introduce the Runtime Criticality Score (RCS), which each service agent uses to express at any moment, its intrinsic utility and survival urgency under resource constraints. The score is computed from six normalized dimensions covering physical consequence, inference quality, input freshness, recent availability stress, actuator coupling, and available protective actions on the host. Its dimension weights are adjusted online through a lightweight Bayesian update driven by the type of disturbance currently observed, so the same service is ranked differently under a network delay than under thermal throttling. Agents publish their RCS to peers over an open, peer-to-peer discovery channel, and use it to negotiate three things without a central controller: (i) local threshold enforcement on their own host, (ii) migration to a willing peer when the current host can no longer protect them, (iii) reassignment of the coordination role when the incumbent coordinator is itself impaired. Beyond the immediate benefit of catching silent degradation, the framework contributes a concrete instance of decentralized, physically grounded agent coordination. Agents belonging to different owners can advertise capabilities, bid for protection, and reorganize across an open network.

0.14

Grid-Oriented Probabilistic Load Forecasting for AI Data Centers

eess.SY cs.LG ·2026-11-06 ·Qingyi Yao, Ding Lin, Tianqiao Zhao, Meng Yue, Jianhui Wang
benchmark similarity 0.53
Abstract

Probabilistic load forecasts for AI data centers need to represent both uncertainty under changing workloads and temporal dependence to support grid operations. This paper develops an open, grid-oriented benchmark using measured GPU power from a 448-GPU AI cluster. Forecasts are evaluated through four stages: probabilistic prediction, online uncertainty calibration, temporal scenario generation, and horizon-wide reserve sizing. Following a change in cluster utilization, a quantile LightGBM forecast achieves only 63.4% coverage for a nominal 90% interval, while online regime-conditioned calibration increases coverage to 87.3%. Even with well-calibrated marginal forecasts, independent sampling produces unrealistic ramp distributions and excessive reserve procurement. Reconstructing temporal dependence from historical forecast errors reduces the discrepancy in ramp statistics and lowers realized reserve cost by 7.4-10.6% across three forecasting tasks. These findings show that marginal forecast quality alone is insufficient for operational decisions and motivate joint evaluation of calibration, temporal structure, and decision outcomes.

0.22

ContinuumBench: Benchmarking Joint Autoscaling and Placement Across Evaluation Regimes in the Cloud-Edge Continuum

cs.DC ·2026-09-08 ·Lanpei Li, Antonino Vaccarella, Vincenzo Lomonaco, Massimo Coppola
benchmark similarity 0.53
Abstract · This work was accepted and presented at the 6th workshop on Flexible Resource and Application Management on the Edge (FRAME) 2026, co-locate…

Cloud-edge controllers coordinate service placement, replica scaling, and resource pre-warming to keep end-to-end latency within application deadlines. But evaluations often obscure the source of a reported gain: placement and scaling are studied separately; workload, connectivity, and calibration assumptions remain implicit; and metrics over completed tasks hide unfinished work. We present ContinuumBench, a benchmark that controls these factors. Its completion-aware accounting treats late, unfinished, and discarded tasks as deadline misses. A common protocol compares placement-only and scale-capable controllers under declared regimes and stressors. Built on the ECLYPSE simulator, ContinuumBench adds arrivals, worker elasticity, intermittent transport, buffering, and failures to close the control loop. We evaluate nine controllers across four scenarios and two regimes. The studied regimes are capacity-bound: elastic capacity, not placement sophistication, drives completion, and once capacity suffices, the choice of autoscaling policy decides how much of that work arrives on time. Placement re-planning has no measurable effect without relocation, while cost-free migration defines the observed exception. Consequently, scale-capable controllers approach an over-provisioned reference while placement-only controllers degrade with load; and placement quality separates controllers only once capacity is exhausted. Finally, the accounting choice itself changes the reported result: completion-only and completion-aware scoring can rank controllers differently.

0.22