Halley: A Predictive Control Plane for Optical AI Data Center Networks
Abstract
Halley is a predictive control framework for AI data center optical networks that improves effective throughput and reduces capacity needs by forecasting failures and controlling resources with formal guarantees.
A frontier AI model is trained in an AI data center, on tens of thousands of accelerators joined by a dedicated network, and every training step ends with all of them exchanging data at once. Between racks, that network is optical, and each of its four layers, from lasers to switches, runs a fixed or after-the-fact policy. Lasers sharing an enclosure, cooling, and power can fail together. At a fixed spare ratio, correlated failure provably caps a pool's availability however large it grows. In this paper, we present a comprehensive predictive control plane framework, called Halley, that reads each resource's next state and acts before the failure occurs. It has four components, each carrying a formal guarantee: LightReserve that sizes the laser pool to provide a coverage bound, FoldFit that schedules the switch within 11/9 of the optimal, ThermaLead that holds a microring with one-step-ahead control, and TriageGuard that protects the highest-risk modules first. Halley gives each layer a predictive controller that defers to the deployed policy when unsure. Composed from simulations at that point, effective goodput, the share of ideal throughput kept, rises from 65.2\% to 76.5\% if a window that exhausts its spares is lost. If only the dark channels' bandwidth is lost, it reaches 67.4\%. Per megawatt, that is up to 1.03--1.17 times the training; for the same training, up to 3.3--14.7\% less data center capacity. Halley's fallback circuits are formally verified and are shown to achieve close timing on a commercial FPGA, and pass a 130~nm signoff.
Community
Halley is a predictive control plane for optical networks in AI training clusters. It anticipates failures across four layers, from shared laser pools to optical switches, and falls back to the deployed policy when predictions are uncertain. In simulation, effective goodput increased from 65.2% to 76.5% when spare exhaustion caused the whole window to be lost, and to 67.4% when only the affected channels lost bandwidth.
This is an automated message from the Librarian Bot. I found the following papers similar to this paper.
The following papers were recommended by the Semantic Scholar API
- Phase-Decoupled, Model-Calibrated Power Control for Disaggregated LLM Serving (2026)
- The Unexpired Plan: A Free Monitor for Accelerated Diffusion Policies (2026)
- An Optical KV Cache Network for Disaggregated LLM Serving (2026)
- JointServe: Serving Multi-Model Agents on Memory-Constrained GPUs (2026)
- Network-in-the-Loop at Scale: GPU-Batched 5G Simulation for Massively Parallel Robot Learning (2026)
- FALCON: FPGA-Accelerated Latency-Certifiable Occupancy Networks for Camera-Based Autonomous Driving (2026)
- Toward Agentic AI for the 6G Physical Layer: From Algorithm Discovery to Verified Baseband Silicon (2026)
Please give a thumbs up to this comment if you found it helpful!
If you want recommendations for any Paper on Hugging Face checkout this Space
You can directly ask Librarian Bot for paper recommendations by tagging it in a comment: @librarian-bot recommend
Models citing this paper 0
No model linking this paper
Datasets citing this paper 0
No dataset linking this paper
Spaces citing this paper 0
No Space linking this paper
Collections including this paper 0
No Collection including this paper