CS Paper Radar

Beyond State-of-the-Art: Standardising Environmental Impact Metrics for AI Research

Lachlan McGinness, Dan Pagendam, Robert Offner

cs.AI ·submitted 2026-10-01 05:56 UTC · v1

Abstract

As the capabilities and ubiquity of Large Language Models (LLMs) grow, so does their environmental footprint. Despite calls for responsible AI, the machine learning community lacks standardised practices for carbon accounting. Our automated literature review of the 5,285 papers accepted to NeurIPS 2025 reveals that reporting of environmental impact is nearly non-existent. To catalyse a shift toward sustainable AI, we define standardised sustainability metrics for evaluating model training efficiency, accompanied by simple heuristics to estimate the carbon cost of LLM inference. We implement these metrics in carbonbenchmark, a drop-in software solution for tracking and reporting emissions. Finally, to combat the pursuit of marginal accuracy gains at disproportionate environmental costs, we formalise the `Smallest Model that Achieves the Job' (SMAJ), a framework which challenges the field to prioritise computational efficiency and environmental accountability alongside traditional `State-of-the-Art' (SotA) accuracy.

Closest papers

Nearest neighbours by meaning across the whole index.

A Checklist to assess the energy and carbon impacts of ML/AI applications in Earth System Modeling

cs.AI physics.ao-phcs.LG ·2026-09-01 ·Filippo Dainelli, Amirpasha Mozaffari, Marina Castaño, Aina Gaya i Àvila, Lluís Palma Garcia +3 more
similarity 0.76
Abstract · 12 pages, 1 figure, 2 tables; Submitted and presented at the GREEN-AI workshop of the ECML PKDD 2026 conference in Naples

As machine learning and artificial intelligence find their way into nearly every aspect of climate, weather, and Earth system modeling, it is worth pausing to consider what our design decisions imply for the science and for the computational resources we consume. A growing body of literature addresses the ethical and sustainable development of ML/AI, yet translating these principles into day-to-day research practice remains a challenge as most of best practices are dispersed across multiple studies and commentaries. Here, we distill these discussions into a practical checklist that ML/AI and Earth system science practitioners can use to assess and reduce the environmental footprint of their own applications, organised around the successive stages of the model development pipeline. We complement the checklist with a selection of metrics drawn from the literature for estimating the energy consumption and carbon footprint of a project. For each question, we point to concrete examples and actionable suggestions from recent literature, aiming to bridge the gap between aspirational principles and the decisions researchers face at every stage of the development cycle.

0.37

Environmental Impact of Generative and Agentic AI: An in-Depth Analysis and Green Solutions

cs.CY cs.AI ·2026-09-26 ·Abderaouf Bahi, Amel Ourici, Ibtissem Gasmi
similarity 0.74
Abstract

The proliferation of generative and agentic artificial intelligence (AI) systems has introduced computational demands whose environmental consequences are substantial yet underexamined. This paper examines the environmental footprint of modern AI systems across energy consumption, carbon emissions, water usage, and electronic waste over the full lifecycle of large language models, multimodal foundation models, and agentic workflows, from hardware fabrication and training through fine-tuning and inference to end-of-life disposal. This work provides a conceptual analysis, utilizing order-of-magnitude estimations based on published data, without conducting original physical measurements. We contribute a lifecycle taxonomy that crosses lifecycle phases with five impact dimensions and emission scopes; a Sustainability Assessment Framework for AI Systems (SAFIA) comprising nine indicators; a comparative analysis of traditional, generative, and agentic AI; seven open challenges; policy recommendations for regulators, cloud providers, hardware manufacturers, and AI developers; and a research roadmap to 2035. The analysis indicates that inference can rival or exceed training energy over a deployment lifetime, that agentic workflows can multiply the energy of equivalent single-pass inference by one to several orders of magnitude depending on the number of model and tool calls, that indirect water use and embodied carbon are systematically underreported, and that measurement tools, disclosure practices, and regulation have not kept pace with agentic deployment. These findings call for agent-aware energy measurement, lifecycle-based carbon and water accounting, and mandatory disclosure for large-scale AI training and deployment.

0.19

PCFBench: A Diagnostic Benchmark for Product Carbon Footprint Estimation

cs.AI ·2026-08-27 ·Krishna Rao, Andrew Dumit, Shaena Ulissi, Jacob Feintzeig, P. James Joyce +5 more
benchmarkdataset similarity 0.70
Abstract

AI systems are being deployed on high-stakes, domain-specific workflows that demand correctness not just in the final output, but at every intermediate step. One such workflow is estimating a product carbon footprint (PCF), the greenhouse-gas emissions attributable to a physical product. AI agents are increasingly being used to generate PCFs, but existing evaluations score either total emissions (hiding error sources and cancelling mistakes) or sub-tasks in isolation (missing compositional interactions). We introduce PCFBench, the first benchmark to carve PCF modeling into independently-evaluable tasks that require decomposition, retrieval, ontology matching, and numerical extraction. It comprises 614 expert-labelled items across six tasks. Together they probe reasoning under under-specification, conflicting context, and numerical constraints. Across eight frontier LLMs from four providers, no single model dominates. Although the strongest models estimate total product emissions within 2 times of declared totals on 77% of products, this rate drops to 37-58% when the PCF is generated step by step, with only 45-75% obeying mass conservation. These failures undermine the transparency practitioners need to compare products and drive decarbonization. We release the dataset and evaluation harness to support targeted progress.

0.25

Right Model, Right Task: Capability-Constrained Carbon Labeling to Decarbonize Generative AI

eess.SY ·2026-10-26 ·Jiawei Qu, Kai Hou, Hongjie Jia, Jinyue Yan
position similarity 0.70
Abstract

The carbon footprint of generative-AI inference depends not only on hardware efficiency and electricity supply, but also on whether the selected model is appropriate for the task. A frontier model may expend unnecessary computation on a routine request, whereas an under-capable model may increase energy use through failure, retries, extended reasoning and escalation. However, a standardized evaluation framework that accounts for task-specific capability requirements and the carbon emissions associated with successful task remains lacking. In this Perspective, we argue for a capability-constrained carbon labeling framework that shifts environmental assessment from carbon intensity per inference towards the expected carbon emissions per successfully completed task at the required capability level. Under this framework, models would first be assessed against task-specific capability requirements, and only models capable of meeting those requirements would be compared on their expected energy use and operational carbon emissions. By linking service quality to carbon cost, this approach could enable more informed matching of the right model to the right task, offering a demand-side pathway to reducing emissions associated with generative-AI token use. Realizing this vision will require standardized capability-based service assessments, comprehensive energy accounting and transparent carbon disclosures.

0.27

Toward Explainable and Policy-Aware AI for Carbon Credit Price Prediction: A Research Framework for Emerging Carbon Markets

cs.LG ·2026-09-01 ·Summaiya Unnisa Begum, Mohammed Nadeem Ullah, Mohammed Abdul Ghani Khan
code/data similarity 0.70
Abstract · 7 pages, 4 figures, 7 tables

Carbon markets put a price on emissions, yet that price remains hard to forecast. Work in this area clusters on the EU and Chinese schemes, compresses regulatory text into a sentiment score, and reports accuracy without calibration or explanation stability. We distil ten recurring gaps into an impact-feasibility matrix and propose EPA-CarbonNet, a six-layer architecture that fuses market series with policy text by cross-attention and calibrated intervals alongside policy-attributed explanations. We then build and test it on eleven years of daily S and P carbon index data. The findings are largely negative, and reported as measured: a random walk beats the model on five-day RMSE (0.0365 against 0.0475), SHAP rankings agree at rho = 0.54 across resampled backgrounds, and policy attention never coincides with documented regulatory events. Directional accuracy, at 58.6 percent, leads every baseline. Code, data documentation and all result artifacts are available at https://github.com/Kimalice/Toward-Explainable-and-Policy-Aware-AI-for-Carbon-Credit-Price-Prediction

0.46

Toward a Time-Aware Assessment Framework for the Carbon Cost of AI-Enabled Decarbonization

cs.CY ·2026-09-16 ·Chenrui Xu, Burcu Akinci, Christopher McComb
published similarity 0.70
Abstract · Accepted for publication in the proceedings of the 2026 ASCE International Conference on Computing in Civil Engineering (i3CE 2026). 8 pages…

AI is increasingly used to support decarbonization decisions across the built environment, yet the development, training, and use of AI consume energy and induce CO2e emissions. However, existing assessments often report physical-system savings while omitting AI-side emissions. Moreover, they rarely account for the mismatch between when AI costs occur and when decarbonization benefits materialize, which may be substantial for infrastructure-scale projects. To address these issues, we present a time-aware assessment framework that models avoided emissions and AI-induced emissions as discrete-time streams over a finite time horizon. In demonstrating this process, we seek to show that time-aware assessment can support temporal decision-making, identify cases in which accounting for time value of carbon can change preferred rankings relative to time-invariant totals, and explore how decisions may vary with slightly different governance priorities. Using four representative interventions with intentionally different temporal profiles (multi-project low-carbon concrete design support, AI-assisted construction logistics, agentic HVAC control, and predictive maintenance), we demonstrate how discounting can change preferred rankings relative to time-invariant totals and supports ranking sensitivity analysis, discounted payback screening, and break-even discount-rate analysis. We also provide decision guidelines that support go/no-go screening, timing decisions, and minimum "bang-for-your-buck" thresholds. Ultimately, this work contributes a lightweight framework for deciding whether and when to deploy AI-enabled interventions for decarbonization under explicit time preference.

0.28

Beyond the Last Truffula Tree: SustainAI - A Water-Aware, Closed-Loop Framework for Environmentally Accountable AI

cs.CY cs.AIcs.DCcs.HC ·2026-09-25 ·Farnaz Farid, Tashfia Towkee, Sania Nasreen, Sami bin Azad
similarity 0.69
Abstract · 10 pages, 2 Figures

As artificial intelligence (AI) becomes embedded in everyday life, its environmental footprint, particularly water consumption remains largely invisible. While energy and carbon impacts are widely recognized, the substantial freshwater demands of data center cooling and electricity generation receive little attention. To address this gap, we introduce SustainAI, a water-aware, closed-loop framework incorporating environmental accountability into AI deployment. SustainAI integrates real-time water metering, a hallucination-aware penalty model, and a water-aware routing algorithm that accounts for regional water stress. Evaluated via Small Language Models (SLMs) extracting health misinformation, results reveal an 11-fold variation in water footprint across geographically distributed data centers (0.0477 mL to 0.5360 mL per inference). Across 1,335 inference runs, the system consumed approximately 399 mL of water but produced only 240 correct outputs, demonstrating that substantial resources are spent on inaccurate responses. Crucially, SustainAI extends beyond technical optimization through a Care by Design lens, framing AI sustainability around relational ethics, regional equity, and ecological stewardship. By combining water monitoring, adaptive accountability, and Care by Design principles, SustainAI provides a practical foundation for integrating ethical care and environmental responsibility into AI infrastructure design and lifecycle management.

0.28

A Holistic Assessment of the Carbon Footprint of Noor, a Very Large Arabic Language Model

cs.CL ·2026-09-22 ·Imad Lakim, Ebtesam Almazrouei, Ibrahim Abu Alhaol, Merouane Debbah, Julien Launay
publishedhighly cited similarity 0.67
Abstract · 11 pages, 3 figures, 2 tables. Published in Proceedings of BigScience Episode #5 -- Workshop on Challenges & Perspectives in Creating Large …

As ever larger language models grow more ubiquitous, it is crucial to consider their environmental impact. Characterised by extreme size and resource use, recent generations of models have been criticised for their voracious appetite for compute, and thus significant carbon footprint. Although reporting of carbon impact has grown more common in machine learning papers, this reporting is usually limited to compute resources used strictly for training. In this work, we propose a holistic assessment of the footprint of an extreme-scale language model, Noor. Noor is an ongoing project aiming to develop the largest multi-task Arabic language models -- with up to 13B parameters -- leveraging zero-shot generalisation to enable a wide range of downstream tasks via natural language instructions. We assess the total carbon bill of the entire project: starting with data collection and storage costs, including research and development budgets, pretraining costs, future serving estimates, and other exogenous costs necessary for this international cooperation. Notably, we find that inference costs and exogenous factors can have a significant impact on total budget. Finally, we discuss pathways to reduce the carbon footprint of extreme-scale models.

0.60