CS Paper Radar

Locked In: Multi-Objective RL for the AI Data Center Build-Out

Satyapragnya Kar, Rajarshi Das, PR Panigrahi

cs.LG cs.AI ·submitted 2026-10-26 10:14 UTC · v1
published

Abstract

AI data center build-out is a multi-trillion-dollar, multi-decade infrastructure program. Yet siting, power procurement, and cooling decisions are still made with static, single-point scoring tools. These tools are evaluated once, on day-zero numbers. This is a poor fit. A site's water, power, and carbon profile drifts substantially over the 10 to 20 year asset life. The governing decisions are also irreversible, and they bind capital and physical plant for years. We formalize long-horizon build-out as a tiered multi-objective Markov decision process. Strategic commitments are gated to discrete windows, incur switching costs, and energize only after source-dependent lead times. Operational dispatch is restricted to capacity that physically exists. We solve the problem with a preference-conditioned multi-objective agent that has a semi-Markov manager and worker hierarchy. The agent recovers a family of policies that a planner can steer across cost, carbon, water, and reliability at inference time. We validate long-horizon dynamics with a lightweight counterfactual rollout model. Across three commitment regimes (irreversible, reversible, and commit-once) on real site data, preference conditioning yields a confirmed, steerable trade-off on both objective pairs in every regime. Imposing lock-in produces a more evenly covered frontier and a far more consistent rate of anticipatory retrofit ahead of a binding water-stress constraint than a freely reversible formulation. Finally, a compact counterfactual dynamics model tracks slow-moving state well. It is measurably outperformed by simple persistence on the water-stress axis. We report this limitation rather than obscure it. We release the environment, agents, baselines, and evaluation harness. All of them are grounded in real interconnection-queue, water-stress, and grid-emissions data.

Comment
Tackling Climate Change with Machine Learning Workshop at NeurIPS 2026

Closest papers

Nearest neighbours by meaning across the whole index.

Toward a Time-Aware Assessment Framework for the Carbon Cost of AI-Enabled Decarbonization

cs.CY ·2026-09-16 ·Chenrui Xu, Burcu Akinci, Christopher McComb
published similarity 0.65
Abstract · Accepted for publication in the proceedings of the 2026 ASCE International Conference on Computing in Civil Engineering (i3CE 2026). 8 pages…

AI is increasingly used to support decarbonization decisions across the built environment, yet the development, training, and use of AI consume energy and induce CO2e emissions. However, existing assessments often report physical-system savings while omitting AI-side emissions. Moreover, they rarely account for the mismatch between when AI costs occur and when decarbonization benefits materialize, which may be substantial for infrastructure-scale projects. To address these issues, we present a time-aware assessment framework that models avoided emissions and AI-induced emissions as discrete-time streams over a finite time horizon. In demonstrating this process, we seek to show that time-aware assessment can support temporal decision-making, identify cases in which accounting for time value of carbon can change preferred rankings relative to time-invariant totals, and explore how decisions may vary with slightly different governance priorities. Using four representative interventions with intentionally different temporal profiles (multi-project low-carbon concrete design support, AI-assisted construction logistics, agentic HVAC control, and predictive maintenance), we demonstrate how discounting can change preferred rankings relative to time-invariant totals and supports ranking sensitivity analysis, discounted payback screening, and break-even discount-rate analysis. We also provide decision guidelines that support go/no-go screening, timing decisions, and minimum "bang-for-your-buck" thresholds. Ultimately, this work contributes a lightweight framework for deciding whether and when to deploy AI-enabled interventions for decarbonization under explicit time preference.

0.28

Environmental Impact of Generative and Agentic AI: An in-Depth Analysis and Green Solutions

cs.CY cs.AI ·2026-09-26 ·Abderaouf Bahi, Amel Ourici, Ibtissem Gasmi
similarity 0.61
Abstract

The proliferation of generative and agentic artificial intelligence (AI) systems has introduced computational demands whose environmental consequences are substantial yet underexamined. This paper examines the environmental footprint of modern AI systems across energy consumption, carbon emissions, water usage, and electronic waste over the full lifecycle of large language models, multimodal foundation models, and agentic workflows, from hardware fabrication and training through fine-tuning and inference to end-of-life disposal. This work provides a conceptual analysis, utilizing order-of-magnitude estimations based on published data, without conducting original physical measurements. We contribute a lifecycle taxonomy that crosses lifecycle phases with five impact dimensions and emission scopes; a Sustainability Assessment Framework for AI Systems (SAFIA) comprising nine indicators; a comparative analysis of traditional, generative, and agentic AI; seven open challenges; policy recommendations for regulators, cloud providers, hardware manufacturers, and AI developers; and a research roadmap to 2035. The analysis indicates that inference can rival or exceed training energy over a deployment lifetime, that agentic workflows can multiply the energy of equivalent single-pass inference by one to several orders of magnitude depending on the number of model and tool calls, that indirect water use and embodied carbon are systematically underreported, and that measurement tools, disclosure practices, and regulation have not kept pace with agentic deployment. These findings call for agent-aware energy measurement, lifecycle-based carbon and water accounting, and mandatory disclosure for large-scale AI training and deployment.

0.19

World-Model Policy Arbiter for Goal-Conditioned Reinforcement Learning

cs.LG ·2026-10-07 ·Junwei Quan, Evgenii Opryshko, Nicholas Rhinehart, Igor Gilitschenski
code/data similarity 0.61
Abstract · 22 pages, 3 figures, 14 tables. Project page: https://junwei0102.github.io/wmpa-webpage/ Code: https://github.com/junwei0102/World-Model-Pol…

Offline goal-conditioned reinforcement learning (GCRL) has produced a diverse set of goal-reaching algorithms, yet no single algorithm performs best across environments, goals, and even different phases of the same task. Rather than deploying only the best-performing policy, we ask whether a set of frozen goal-conditioned policies can be used collectively as a portfolio, deciding at every state which policy should act. Choosing a policy at each state is not straightforward. The policies' own value functions cannot be compared directly: they may use different scales, and some policies have no value function. We need to judge each policy by the states it is likely to reach, even though we can execute only one policy at a time. We also need to avoid switching so often that control becomes unstable. To address these challenges, we introduce World-Model Policy Arbiter (WMPA), a test-time framework that, given a set of frozen policies as input, rolls out each frozen policy in a learned state-space world model, evaluates the imagined futures with a shared goal-conditioned value function, and executes the highest-scoring policy for a short commitment interval before the next round of arbitration (policy selection). WMPA assumes access to a bank of frozen goal-conditioned policies and requires neither policy retraining nor privileged task-specific knowledge. Under the official OGBench evaluation protocol on 18 state-based datasets spanning maze navigation as well as cube, scene, and puzzle manipulation, WMPA improves the macro-average success rate from the 44% achieved by the best policy selected per dataset to 58%, with statistically significant gains on 12 datasets. These gains include +33 percentage points on cube-double-play and +36 percentage points on scene-play.

0.39

Artificial Intelligence for Energy Optimization in Data Centers

cs.AI cs.LG ·2026-09-03 ·Mohammed Basharath Ullah, Summaiya Unnisa Begum, Mohammed Nadeem Ullah
code/data similarity 0.61
Abstract · 11 pages, 6 figures, 7 tables

Data centers are increasingly optimized by artificial intelligence and, at the same time, increasingly loaded by it. The literature treats these as two unrelated problems: control studies model workload as an exogenous arrival process, while sustainability studies model infrastructure as a fixed multiplier. We screen roughly 194 papers retrieved through a documented protocol, code 63 of them, and report what the coding shows. Of 28 primary control-oriented studies, 18 are validated in simulation alone and 5 reach physical hardware or a production facility; none account for water withdrawal, and none account for embodied carbon. Reported savings intervals across four technique families overlap almost completely, which means the field cannot presently rank its own methods. Ten recurring gaps are scored for consequence and tractability, and we set out CLEAR-DC, a framework coupling a control-policy branch to a workload-demand branch through an explicit elasticity term, reads out net rather than direct benefit, and emits a schema-conformant record covering energy, carbon, water, embodied share and validation venue. The framework is an architectural and methodological proposal, not a trained system; the contribution we defend empirically is the corpus analysis and the reporting schema derived from it. Coding sheet, derived statistics and all result artifacts: https://github.com/Kimalice/AI-for-Energy-Optimization-in-Data-Centers-Closing-the-Optimizer-Load-Loop

0.45

Uncertainty-Aware Resource Orchestration for Agentic AI Systems

cs.AI cs.DCcs.LGcs.MA+1 ·2026-09-14 ·Masoud Shokrnezhad, Tarik Taleb
published similarity 0.60
Abstract · 6 pages, 2 figures. Accepted to IEEE MECOM 2026, Marrakech, Morocco, 2-4 November 2026

Agentic artificial intelligence (AI) systems powered by large language models (LLMs) execute as autonomous multi-step pipelines that dynamically invoke tools, integrate observations into memory, and iterate until a task is resolved or a resource budget is exhausted. Unlike classical workflows with fixed graphs, the aggregate compute, bandwidth, and end-to-end latency demands of such pipelines are unknown at dispatch time: they emerge at runtime from intermediate observations and stochastic token sampling, yielding heavy-tailed, multi-modal random variables. This unpredictability forces infrastructure orchestrators into a dilemma: under-provisioning risks mid-execution throttling and deadline violations, while over-provisioning wastes scarce edge or cloud capacity. Existing schedulers require a fully known pipeline graph, while edge resource-management methods rely on parametric or stationary demand models, and neither fits the unknown, non-stationary profiles of agentic pipelines. We formalize this setting as the uncertainty-aware agentic orchestration problem, where the goal is to reserve, at dispatch time, compute and bandwidth allocations that cover actual pipeline demands, and to verify that the pipeline can meet its deadline, each with a prescribed probability. We then propose Conformal Reservation for Orchestration (CRO), an online algorithm that translates a sliding window of past execution traces into dispatch-time resource allocations with finite-sample, distribution-free coverage guarantees via conformal prediction. Simulations over heterogeneous task mixes with multi-modal and heavy-tailed profiles show that CRO is the only evaluated method that simultaneously satisfies target probabilistic coverage across all risk levels while, among coverage-feasible methods, attaining the lowest over-reservation, roughly halving the resource waste of the Chebyshev-bound baseline.

0.31

AlgoWorlds: Benchmarking Tool Use for Global Optimization in Algorithmic Worlds

cs.CL ·2026-08-29 ·Zixiang Xu, Jiaan Wang, Fandong Meng
benchmarkcode/data similarity 0.60
Abstract · Homepage: https://xzx34.github.io/AlgoWorlds/ Code: https://github.com/xzx34/AlgoWorlds

Tool-use benchmarks generally evaluate whether an agent completes a workflow using appropriate tools and valid arguments. However, feasibility alone is insufficient in real-world decision settings such as route planning and fleet dispatch. Individual choices interact through shared constraints and costs, so a feasible solution may still be substantially suboptimal. This raises a harder question: can an agent turn information gathered through tools into a globally optimal decision? We introduce AlgoWorlds, a benchmark that transforms formally specified combinatorial optimization problems into partially observed decision environments with verifiable global optima. Each environment contains a hidden instance observed only through task-specific information tools, after which the agent commits to one structured decision evaluated for feasibility and optimality. AlgoWorlds contains 240 environments covering ten combinatorial optimization families and four workload levels. Family-specific deterministic programs generate the instances, exact algorithms certify their optima and determine workload levels, and two structurally different tool interfaces present each underlying instance. We evaluate seven leading LLMs, including Claude Opus 4.8 and GPT-5.6 Sol. Achieving global optimality remains highly challenging: although leading models produce feasible decisions in most cases, the best-performing model reaches exact optimality in only 38.61% of cases. Even when agents collect sufficient information to reconstruct the hidden instance, most failures end in feasible but suboptimal decisions. The challenge therefore extends beyond information acquisition to information integration, global constraint reasoning, and decision verification. The project homepage is available at https://xzx34.github.io/AlgoWorlds/, and the code is available at https://github.com/xzx34/AlgoWorlds.

0.52

Autonomous agents for electricity-system planning

cs.AI cs.CL ·2026-11-04 ·Yoon Pyo Lee, Samrendra Roy, Jay Phil Yoo, Kazuma Kobayashi, Souvik Chakraborty +1 more
similarity 0.60
Abstract

Planning electricity systems requires repeated decisions that connect regional resources, investment, operation and network constraints. Here we present an autonomous planning framework that carries prepared regional scenarios through proposal, numerical evaluation, feedback interpretation, redesign and final plan selection. Agents propose investment bounds, storage operating conditions and feeder interventions, interpret numerical feedback, and decide how to revise designs and when to stop. The framework automatically executes annual investment-and-dispatch optimization and representative-feeder verification, applies fixed acceptance criteria and retains the lowest-cost accepted candidate. We evaluate forty carbon-constrained trajectories across ten system-year scenarios in five electricity systems and four countries, using two model deployments and single- and multi-agent architectures. All forty retain candidates satisfying the implemented physical and fixed annual operational carbon-budget checks. Twenty-eight of forty matched reference designs exceed the new scenario ceilings. A separate archive of ninety-six trajectories under a common 1,000 Mt annual ceiling provides matched references and broader regional coverage. The results demonstrate autonomous planning under explicit emissions constraints using public regional data and published institutional demand outlooks.

0.20

SAGE-HAP: Sustainability-Certified Agentic Communication and Computing at a Solar-Powered High-Altitude Platform

cs.NI ·2026-10-20 ·Haoxiang Luo, Bang Huang, Mohamed-Slim Alouini
similarity 0.60
Abstract

The solar-powered High-Altitude Platforms (HAP) can provide persistent communication and computing services beyond terrestrial coverage. However, changing mission priorities, coupled resource demands, and uncertain solar supply complicate sustainable scheduling, while large language model proposals require independent feasibility checks. This paper proposes SAGE, a Sustainability-certified Agentic Ground-service Engine for a HAP. We formulate an energy-causal stochastic optimization problem incorporating semantic modes, multi-user interference, channel aging, essential platform loads, and battery stress. An agent translates operator intent into typed admission, mode, and grouping candidates, while deterministic convex refinement and an action shield verify resource and reserve feasibility using calibrated solar lower bounds before execution. Agent proposals and deterministic fallbacks share the same certification path. Residual-based forecasting and memory-assisted replanning close the control loop. We establish fixed-candidate convexity, reserve safety under calibrated solar coverage and bounded actuation error, and an online utility bound accounting for candidate-generation error. At nominal load, simulations show 2.38 percentage points higher completion and 5.27% greater useful-workload energy efficiency than energy-harvesting Lyapunov control. Under stressed load and solar uncertainty, reserve violations occur in 1/50 runs, versus 47/50 without energy certification. A 600-record calibrated inference replay further shows 23.5--36.5% utility gains over deterministic-only candidates under compound stress.

0.16