CS Paper Radar

Assessing the AI Readiness of Construction Datasets: A Multidimensional Operational Framework

Xiaoyu Hou, Bo Xiao, Abdolmajid Erfani, Ronghua Xu, Yu Cai

cs.AI ·submitted 2026-10-18 19:38 UTC · v1

Abstract

The rapid growth of artificial intelligence (AI) applications in construction has increased the demand for datasets suitable for reliable model development, evaluation, and reuse. However, construction datasets vary widely in documentation, quality, governance, and evaluation support, and consistent criteria for assessing AI readiness remain limited. This study develops a Construction Dataset AI Readiness Framework with 30 attributes across four dimensions: Metadata Completeness, Data Quality and Representativeness, Data Governance and Accessibility, and AI Utility. The framework uses attribute-specific scoring, applicability screening, and automated and manual verification. It was evaluated using 21 publicly available datasets across seven data-type groups. Overall readiness scores ranged from 0.720 to 0.964, with a mean of 0.879. Hybrid verification achieved 90.5% agreement between automated suggestions and manually verified scores. The framework supports consistent assessment of heterogeneous construction datasets and identification of readiness gaps.

Closest papers

Nearest neighbours by meaning across the whole index.

RAIL: An Automatic Classifier of the Artificial Intelligence Readiness Level

cs.AI ·2026-08-13 ·Juan Irving Vasquez, Juan Terven, Laura-Ivoone Garay-Jimenez
similarity 0.66
Abstract · Under review at journal

Assessing the maturity of artificial intelligence technologies is essential for investment decisions, project management, and policy monitoring, yet the available readiness frameworks are heterogeneous and difficult to apply automatically: the adaptation of Technology Readiness Levels to AI lacks AI-specific gating criteria, the Machine Learning Technology Readiness Levels presuppose access to internal process artifacts, and AI/data readiness dimension models employ scales that resist direct comparison. This paper makes two contributions. First, we unify these three frameworks into the Unified AI Readiness Level (AIRL), a nine-level ordinal scale built on an environmental evidence ladder and complemented by dimensional caps (covering specification, data existence, data quality, data legality, expert knowledge, and algorithmic maturity) together with a generality-anchoring rule and explicit assignment disciplines, so that a readiness level becomes decidable from a natural-language description of the work alone. Second, we propose RAIL (Readiness Assessment via Independent LLM-experts), a panel-of-experts classifier that operationalizes the scale: one evidence agent and six independent dimension agents, each a large language model with a narrowly scoped mandate, deliver verdicts that a deterministic minimum rule aggregates and a chief expert reviews under asymmetric authority, confirming or lowering the panel's recommendation but never raising it above the caps. The method was tested in the analysis of several research works showing consistency and avoiding overestimation from monolithic LLM classifiers.

0.06

How ready is the United States commercial building stock for artificial intelligence? A national estimate from energy codes and survey data

cs.CY ·2026-11-15 ·Wooyoung Jung
similarity 0.63
Abstract · 48 pages, 9 figures, 17 tables. HUBS Lab Paper No. 2026-011. Code and data: doi:10.5281/zenodo.23966090

Buildings serve as platforms for artificial intelligence (AI) through the data they generate, but the building stock's readiness as an AI platform has not been assessed. A recent framework measures a building's AI readiness as the share of 76 answer levels, across 31 types of operators' questions, that its recorded data could reach, and has so far been applied only to individual buildings. This study applies it to the 2018 U.S. commercial building stock. It combines 6,436 records of the Commercial Buildings Energy Consumption Survey with ASHRAE 90.1's data requirements, state code adoption, advanced-meter statistics and 45 buildings' knowledge graphs, imputing each building's code edition and data recording. Weighted by floor area, the stock could answer on average 0.145 (95% interval 0.127-0.163) of these answer levels. For 92.0% of floor area its data answer less than half of the questions about current status, and most floor area stays below that mark under every tested assumption about compliance, description and the reference buildings. More than half of what installed equipment could answer is lost in recording, mostly because conventional thermostats store nothing and meters lack interval readings. Readiness rises with size, from 0.073 in buildings of at most 5,000 ft$^2$ to 0.173 at 25,000 ft$^2$ or more. Only 1.6% of floor area was built under a code edition requiring recording, introduced in 90.1-2013 for large buildings. The study gives the first national baseline of commercial-building AI readiness and a public-data method that can be reapplied to each new survey to track the stock.

0.18

Which Buildings Are Artificial Intelligence-Ready? A Measurement-Based Assessment Framework for AI Question Answering and Actuation

cs.AI ·2026-10-06 ·Wooyoung Jung
similarity 0.63
Abstract · 47 pages, 11 figures, 23 tables. Code, results and data supplement: https://doi.org/10.5281/zenodo.23197610

Agentic artificial intelligence (AI) systems are becoming the interface to buildings, answering questions and controlling operations, but a building's readiness for them has not been systematically assessed. This study proposes a framework to quantify it. First, a building's knowledge graph sets two ceilings. The answerable-readiness ceiling is the share of operational questions its data could answer, and the actuation-readiness ceiling is the share of control actions it exposes. Second, a reference AI agent's accuracy on a fixed set of these questions shows how much of the ceilings is realized. On a simulated office, the agent realizes 0.62 of a 0.64 answerable ceiling, so missing data, not the AI, limit readiness, except in naming a fault's cause. Across 37 public real-building graphs, the median answerable ceiling is 0.16, and in 15 of 45, unlinked sensors lower it. The framework turns "is this building AI-ready?" into an auditable, ranked retrofit question.

0.31

PermitGPT: A Unified Generative-AI Pipeline for Construction Hazard Forecasting, Permit Prediction, and Community Impact

cs.AI ·2026-08-28 ·Mohd Ruhul Ameen, Farjana Aktar, Akif Islam, Momen Khandoker Ope, Abu Saleh Musa Miah +1 more
published similarity 0.62
Abstract · 1 figure, 3 tables, Accepted at 2026 International Conference on Power, Electronics, Communications, Computing, and Intelligent Infrastructu…

Urban construction governance requires early decisions that connect workplace safety, permitting requirements, and community impact, yet the relevant evidence is often scattered across separate municipal and regulatory data sources. This paper presents PermitGPT, a unified generative artificial intelligence framework for converting unstructured construction permit descriptions into structured decision-support outputs across three domains: safety hazard identification, permit requirement specification, and community impact assessment. To address data fragmentation, we spatially and temporally align records from the New York City Department of Buildings, Occupational Safety and Health Administration, and NYC 311 service requests, producing 90,000 structured prompt-response pairs derived through rule-based alignment and domain-informed spot checking. We fine-tune three open-weight language models using parameter-efficient adaptation and evaluate them on 2,833 held-out test cases. The results show complementary model behavior: Gemma-3-1B provides the most efficient inference at 3.07 samples per second with low memory usage, Llama-3.2-3B gives the highest lexical overlap for regulatory-style outputs with a BLEU score of 0.0091, and 4-bit Mistral-7B-Instruct-v0.3 achieves the strongest semantic alignment with a BERTScore-F1 of 0.7747. Because the task involves open-ended structured generation, low BLEU values are interpreted alongside semantic metrics and qualitative output structure rather than as standalone indicators of utility. Overall, PermitGPT provides an initial step toward AI-assisted construction governance while identifying directions for stronger task-level evaluation and real-world validation.

0.33

CARES: A Conversational AI System for Regulation-Grounded Safety Reporting in Construction Education

cs.HC ·2026-09-16 ·Fan Yang, Jiabin Wu, Yuan Tian, Jiansong Zhang
similarity 0.57
Abstract

Construction safety reporting often relies on manual logs and static templates that provide limited feedback and leave daily activities disconnected from relevant regulations. This paper introduces CARES (Conversational AI Reporting for Enhanced Safety), a conversational AI system that integrates regulatory guidance into daily reporting to support construction safety education. CARES combines proactive multi-agent dialogue, retrieval-augmented generation (RAG), and automated report generation. The system guides users through reporting tasks, retrieves relevant regulatory passages using hybrid retrieval, and converts conversations into structured daily reports. Regulatory sources and the evolving report are displayed alongside the dialogue to support user review and correction. A preliminary evaluation involving 15 construction management students assessed retrieval quality, response faithfulness, and conversational relevance. CARES achieved an overall faithfulness score of 0.74 and an answer relevance score of 1.00, while initial retrieval ranking remained an area for improvement. These results provide preliminary evidence of the technical feasibility of regulation-grounded conversational reporting. The study highlights opportunities to integrate regulatory knowledge into routine documentation, with future work needed to evaluate effects on report quality, safety awareness, and learning outcomes.

0.15

Whose readiness counts? Disagreement within and between sectors in perceived AI and robotics preparedness

cs.CY ·2026-08-24 ·Peng Wang
similarity 0.56
Abstract · 33 pages, 12 figures, 8 tables

AI and Industry 4.0 readiness assessments often summarise preparedness using a single score for an organisation, application domain or sector. Those summaries can conceal disagreement about the same technology and variation among applications grouped under one sector label. We test how much information is lost through this aggregation using a card-based survey in which 982 respondents provided 15,200 readiness evaluations across 17 named AI and robotics challenges. Readiness is perceived community preparedness and available resources, not personal willingness or audited organisational capability. Respondents frequently disagreed about identical challenges, with card-level readiness standard deviations of $1.03$-$1.26$ on a five-point scale. A crossed decomposition attributes 32.7% of observed variation to stable respondent differences, 7.3% to differences among challenges, and 60.0% to response-level variation that also contains measurement error. Differences among challenge-family means account for only about 2% of variation, with substantially more variation among people, applications and person-family judgements. Manufacturing has the highest mean readiness, yet shop-floor robotics, process-optimisation AI and general decision-support applications are judged differently. Computer-science and AI/ML respondents report higher readiness than non-technical respondents across challenge families, whereas engineering respondents do not report higher Manufacturing readiness. Sector rankings are therefore best used as portfolio summaries rather than evidence that an industry is uniformly ready or behind. Readiness reporting should retain application-level disagreement, disclose whose judgements form the average, and consider ethics, cyber security, literacy and capability needs without collapsing them into a single score.

0.14

Toward Agentic AI-Ready Workflows in Built Environment Organizations: Knowledge Structures and Interoperability Challenges

cs.AI ·2026-11-01 ·Ahmet Bahaddin Ersoz, Justin McHenry, Yevgeniya Kovalchuk, Edward Barrett, Mandana Sarey Khanie
published similarity 0.55
Abstract

The rise of agentic artificial intelligence (AI) in the built environment is shifting attention from isolated AI tools toward autonomous systems that reason, plan, and act across project and organizational workflows. The effectiveness of such systems depends not only on large language model capabilities, but also on the readiness of heterogeneous data environments across the Architecture, Engineering, and Construction (AEC) sector. These environments combine structured sources, such as CAD and BIM models, schedules, cost databases, and asset registers, with unstructured ones, including technical reports, design narratives, planning and policy documents, contracts, meeting minutes, and risk registers. This paper reviews how built environment data can be organized to support agentic AI-ready workflows, focusing on knowledge structures, interoperability, and access and integration mechanisms such as retrieval-augmented generation (RAG) and the Model Context Protocol (MCP). Drawing on existing literature, it examines approaches proposed to organize structured and unstructured data and considers how such data can be contextualized and made accessible to AI agents in a reliable manner. The paper synthesizes current perspectives, highlights challenges around fragmentation and interoperability, and identifies open questions for future research on AI-compatible information management in the built environment.

0.31

Software Engineering for AI-driven Building Operation

cs.SE cs.AI ·2026-08-17 ·Philipp Zech, Sascha Hammes, Johannes Weninger, Jürgen Pannosch, Gernot Steidl
published similarity 0.54
Abstract

Building operations are energy-inefficient. Artificial Intelligence (AI)-driven control systems promise benefits through optimization and predictive control, but deploying them in real buildings reveals a significant software engineering (SE) challenge. SE for AI practices assume digital environments where failures mean poor user experience. Buildings are different. A bad control decision wastes energy irreversibly, violates occupant comfort, or accelerates equipment wear. Although actual safety-critical failures are rare, as real building automation systems are inherently fault-tolerant, the physical and lasting nature of even minor failures fundamentally changes SE4AI requirements. Rooted in two interdisciplinary research projects in civil engineering and computer science that target the AI-driven optimization of building operations, we identify the missing perspectives in SE4AI that currently stymie the successful deployment of AI-based systems for building operations. We further share lessons learned and best practices, and discuss broader implications for engineering AI-driven building operations and cyber-physical systems more generally. Our work proposes a foundation for SE4AI in systems where failure has physical consequences - one the research agenda below will need to validate.

0.57