CS Paper Radar

Which Buildings Are Artificial Intelligence-Ready? A Measurement-Based Assessment Framework for AI Question Answering and Actuation

Wooyoung Jung

cs.AI ·submitted 2026-10-06 21:12 UTC · v1

Abstract

Agentic artificial intelligence (AI) systems are becoming the interface to buildings, answering questions and controlling operations, but a building's readiness for them has not been systematically assessed. This study proposes a framework to quantify it. First, a building's knowledge graph sets two ceilings. The answerable-readiness ceiling is the share of operational questions its data could answer, and the actuation-readiness ceiling is the share of control actions it exposes. Second, a reference AI agent's accuracy on a fixed set of these questions shows how much of the ceilings is realized. On a simulated office, the agent realizes 0.62 of a 0.64 answerable ceiling, so missing data, not the AI, limit readiness, except in naming a fault's cause. Across 37 public real-building graphs, the median answerable ceiling is 0.16, and in 15 of 45, unlinked sensors lower it. The framework turns "is this building AI-ready?" into an auditable, ranked retrofit question.

Comment
47 pages, 11 figures, 23 tables. Code, results and data supplement: https://doi.org/10.5281/zenodo.23197610

Closest papers

Nearest neighbours by meaning across the whole index.

How ready is the United States commercial building stock for artificial intelligence? A national estimate from energy codes and survey data

cs.CY ·2026-11-15 ·Wooyoung Jung
similarity 0.78
Abstract · 48 pages, 9 figures, 17 tables. HUBS Lab Paper No. 2026-011. Code and data: doi:10.5281/zenodo.23966090

Buildings serve as platforms for artificial intelligence (AI) through the data they generate, but the building stock's readiness as an AI platform has not been assessed. A recent framework measures a building's AI readiness as the share of 76 answer levels, across 31 types of operators' questions, that its recorded data could reach, and has so far been applied only to individual buildings. This study applies it to the 2018 U.S. commercial building stock. It combines 6,436 records of the Commercial Buildings Energy Consumption Survey with ASHRAE 90.1's data requirements, state code adoption, advanced-meter statistics and 45 buildings' knowledge graphs, imputing each building's code edition and data recording. Weighted by floor area, the stock could answer on average 0.145 (95% interval 0.127-0.163) of these answer levels. For 92.0% of floor area its data answer less than half of the questions about current status, and most floor area stays below that mark under every tested assumption about compliance, description and the reference buildings. More than half of what installed equipment could answer is lost in recording, mostly because conventional thermostats store nothing and meters lack interval readings. Readiness rises with size, from 0.073 in buildings of at most 5,000 ft$^2$ to 0.173 at 25,000 ft$^2$ or more. Only 1.6% of floor area was built under a code edition requiring recording, introduced in 90.1-2013 for large buildings. The study gives the first national baseline of commercial-building AI readiness and a public-data method that can be reapplied to each new survey to track the stock.

0.18

Software Engineering for AI-driven Building Operation

cs.SE cs.AI ·2026-08-17 ·Philipp Zech, Sascha Hammes, Johannes Weninger, Jürgen Pannosch, Gernot Steidl
published similarity 0.68
Abstract

Building operations are energy-inefficient. Artificial Intelligence (AI)-driven control systems promise benefits through optimization and predictive control, but deploying them in real buildings reveals a significant software engineering (SE) challenge. SE for AI practices assume digital environments where failures mean poor user experience. Buildings are different. A bad control decision wastes energy irreversibly, violates occupant comfort, or accelerates equipment wear. Although actual safety-critical failures are rare, as real building automation systems are inherently fault-tolerant, the physical and lasting nature of even minor failures fundamentally changes SE4AI requirements. Rooted in two interdisciplinary research projects in civil engineering and computer science that target the AI-driven optimization of building operations, we identify the missing perspectives in SE4AI that currently stymie the successful deployment of AI-based systems for building operations. We further share lessons learned and best practices, and discuss broader implications for engineering AI-driven building operations and cyber-physical systems more generally. Our work proposes a foundation for SE4AI in systems where failure has physical consequences - one the research agenda below will need to validate.

0.57

Assessing the AI Readiness of Construction Datasets: A Multidimensional Operational Framework

cs.AI ·2026-10-18 ·Xiaoyu Hou, Bo Xiao, Abdolmajid Erfani, Ronghua Xu, Yu Cai
similarity 0.63
Abstract

The rapid growth of artificial intelligence (AI) applications in construction has increased the demand for datasets suitable for reliable model development, evaluation, and reuse. However, construction datasets vary widely in documentation, quality, governance, and evaluation support, and consistent criteria for assessing AI readiness remain limited. This study develops a Construction Dataset AI Readiness Framework with 30 attributes across four dimensions: Metadata Completeness, Data Quality and Representativeness, Data Governance and Accessibility, and AI Utility. The framework uses attribute-specific scoring, applicability screening, and automated and manual verification. It was evaluated using 21 publicly available datasets across seven data-type groups. Overall readiness scores ranged from 0.720 to 0.964, with a mean of 0.879. Hybrid verification achieved 90.5% agreement between automated suggestions and manually verified scores. The framework supports consistent assessment of heterogeneous construction datasets and identification of readiness gaps.

0.17

The Computational Assessment Stack: An Architecture for AI-Native Measurement

cs.SE stat.AP ·2026-10-24 ·Alina A. von Davier
similarity 0.59
Abstract · 4 figures

Test development is shifting toward automation and agentic artificial intelligence (AI), in which autonomous systems draft items at scale, assemble test forms, administer adaptive assessments, score complex responses, and monitor test quality. As autonomous systems take on more of this work, the architecture underlying test development must change to preserve assessment quality under the new paradigm. This paper proposes the Computational Assessment Stack (CAS), a four-layer architecture for AI-native measurement where every stage of the assessment lifecycle shares a unifying computational construct representation as its base layer. This representation is a machine-readable, modular, and versioned knowledge graph. Three layers are built above it: computational content generation that builds on the knowledge graph; computational psychometrics that derives substantive structure directly from the knowledge graph; an orchestration layer in which agentic systems operationalize the stack under human governance. The paper's core contribution is architectural. Building on foundational psychometric frameworks, the CAS provides a persistent representation that unifies the four layers. Unlike the descriptive prose traditionally used to define constructs in test development, the proposed architecture renders measurement assumptions inspectable and their consequences empirically testable.

0.18

Defining AI Agents: A Compendium of Criteria, Metrics, and Benchmarks

cs.AI cs.MA ·2026-09-10 ·Mia Lassiter, Brinnae Bent
survey similarity 0.58
Abstract · Agent Compendium: agent.duketrustlab.com

The term agent in artificial intelligence lacks a standard definition, complicating the evaluation, comparison, and reproducibility of AI agent research. We address this ambiguity through a survey organized around five dimensions of agenticness: environmental interaction, learning and adaptation, autonomy, goal-directed behavior, and temporal coherence. For each dimension, we examine how the underlying capability has been conceptualized across prior work and synthesize the metrics, benchmarks, and evaluation frameworks used to assess it. This review provides a structured account of the current landscape of agent evaluation, highlighting both established approaches and areas where evaluation remains limited or inconsistent. We additionally introduce the Agent Compendium, a public-facing digital resource that organizes and extends the evaluation methods identified through this review. Together, the survey and compendium provide a common structure for evaluating and comparing agent capabilities across AI systems, supporting more reproducible research, clearer communication, and more systematic study of artificial agents.

0.21

Where Can a Decision Model Diagnose HVAC Faults? Reasoning Demand, Physical Representation, and Robustness Under Shift

cs.AI ·2026-10-07 ·Wooyoung Jung
similarity 0.57
Abstract · 58 pages, 4 figures, 12 tables. Submitted to Energy and Buildings

Artificial intelligence supports building operations in several forms, each with its own barrier. Expert rules must be tuned for every system, supervised models need labeled data that buildings rarely record, and language models return free text that requires human-in-the-loop checking, since their stated confidence is unreliable. A newer kind of pretrained model, here called a decision model, returns a probability for every allowed answer, so one model could serve many decisions without training. This study answers three open questions for fault diagnosis in heating, ventilation, and air-conditioning systems: which decisions such a model can make, what input it needs, and whether its probabilities hold when conditions change. On 128 fault days from four public datasets of real equipment, faults are graded by the reasoning their diagnosis demands, with data given raw, as physical features, or with Brick topology. The decision model Jev, open language models, and a supervised model face nine tests that change season, control configuration, or building. Given physical features, Jev and the larger open model diagnosed faults whose evidence one feature carries, but not faults that need operating context. Under shift they kept their accuracy and calibration, while the supervised model lost 0.33 macro-F1 yet led or tied within a building. Their probabilities still needed correction, and detection was weak. The study maps which faults a decision model can diagnose and from what input, and supports a division of work in which code computes the physics and the model ranks candidate faults for an operator.

0.63

Bringing AI to Autonomous Systems -- From Cognition to Collective Intelligence

cs.AI ·2026-09-11 ·Joseph Sifakis
similarity 0.56
Abstract

The purpose of this article is to highlight the central role of autonomous systems as the ultimate stage in the development of AI, to explain the underlying technical challenges that require a combination of connectionist AI and symbolic AI, and to integrate AI and systems engineering. We present a comprehensive framework for the design and evaluation of autonomous systems, based on a generic agent architecture that characterizes their behavior as the composition of cognitive functions organized around a long-term memory containing the agent's evolving knowledge. We address the challenges posed by the implementation of the fundamental features of the agent architecture, in particular the link between sensory data and structured data stored in memory, decision-making related to the achievement of the agent's goals and their planning, as well as the coordination of agents to combine individual and collective intelligence. We explain that agent trustworthiness, unlike that of traditional systems, is not limited to behavioral properties. It includes an essential dimension related to cognitive properties, the validity of which depends on how the agent uses its knowledge in decision-making. We present avenues for the development of methods for evaluating agent trustworthiness. We conclude with a critical assessment of the substantial gap between the aspirational vision of autonomous multi-agent systems and the current state of the art.

0.22

Toward Agentic AI-Ready Workflows in Built Environment Organizations: Knowledge Structures and Interoperability Challenges

cs.AI ·2026-11-01 ·Ahmet Bahaddin Ersoz, Justin McHenry, Yevgeniya Kovalchuk, Edward Barrett, Mandana Sarey Khanie
published similarity 0.56
Abstract

The rise of agentic artificial intelligence (AI) in the built environment is shifting attention from isolated AI tools toward autonomous systems that reason, plan, and act across project and organizational workflows. The effectiveness of such systems depends not only on large language model capabilities, but also on the readiness of heterogeneous data environments across the Architecture, Engineering, and Construction (AEC) sector. These environments combine structured sources, such as CAD and BIM models, schedules, cost databases, and asset registers, with unstructured ones, including technical reports, design narratives, planning and policy documents, contracts, meeting minutes, and risk registers. This paper reviews how built environment data can be organized to support agentic AI-ready workflows, focusing on knowledge structures, interoperability, and access and integration mechanisms such as retrieval-augmented generation (RAG) and the Model Context Protocol (MCP). Drawing on existing literature, it examines approaches proposed to organize structured and unstructured data and considers how such data can be contextualized and made accessible to AI agents in a reliable manner. The paper synthesizes current perspectives, highlights challenges around fragmentation and interoperability, and identifies open questions for future research on AI-compatible information management in the built environment.

0.31