CS Paper Radar

Whose readiness counts? Disagreement within and between sectors in perceived AI and robotics preparedness

Peng Wang

cs.CY ·submitted 2026-08-24 15:52 UTC · v1

Abstract

AI and Industry 4.0 readiness assessments often summarise preparedness using a single score for an organisation, application domain or sector. Those summaries can conceal disagreement about the same technology and variation among applications grouped under one sector label. We test how much information is lost through this aggregation using a card-based survey in which 982 respondents provided 15,200 readiness evaluations across 17 named AI and robotics challenges. Readiness is perceived community preparedness and available resources, not personal willingness or audited organisational capability. Respondents frequently disagreed about identical challenges, with card-level readiness standard deviations of $1.03$-$1.26$ on a five-point scale. A crossed decomposition attributes 32.7% of observed variation to stable respondent differences, 7.3% to differences among challenges, and 60.0% to response-level variation that also contains measurement error. Differences among challenge-family means account for only about 2% of variation, with substantially more variation among people, applications and person-family judgements. Manufacturing has the highest mean readiness, yet shop-floor robotics, process-optimisation AI and general decision-support applications are judged differently. Computer-science and AI/ML respondents report higher readiness than non-technical respondents across challenge families, whereas engineering respondents do not report higher Manufacturing readiness. Sector rankings are therefore best used as portfolio summaries rather than evidence that an industry is uniformly ready or behind. Readiness reporting should retain application-level disagreement, disclose whose judgements form the average, and consider ethics, cyber security, literacy and capability needs without collapsing them into a single score.

Comment
33 pages, 12 figures, 8 tables

Closest papers

Nearest neighbours by meaning across the whole index.

Ready for What? Rethinking AI and Robotics Preparedness for Adoption and Policy

cs.CY ·2026-08-18 ·Peng Wang, Naomi Adel, Amy E. Morgan, Folayo Aina, Demos Parapanos +2 more
similarity 0.82
Abstract · 33 pages, including supplementary. 8 tables, 5 figures

Efforts to accelerate AI and robotics adoption require evidence about where communities are ready to act and where support is still needed. Yet averages across stakeholder groups can obscure relationships that emerge when the same person evaluates different challenges. We analyse a repeated card-based survey in which 982 participants provided 15,200 evaluations of 17 AI and robotics challenges. Each challenge was rated on 1-5 measures of significance, complexity and readiness, where readiness refers to perceived community preparedness and available resources rather than personal competence or realised adoption. Because participants evaluated multiple challenges, the design separates stable between-person differences from challenge-specific within-person deviations. Within the same respondent, a challenge rated one point more complex than usual is associated with about 0.21 points lower readiness (p less than 0.001). By contrast, respondents who generally rate challenges as more complex do not systematically report lower readiness (p=0.29). Significance is positively associated with readiness, while unusually high complexity modestly weakens this alignment. These relationships vary across challenge families, and professional background remains associated with adjusted preparedness. On applied cards, confidence, trust and related perceptions add substantial information about readiness, including for held-out participants. For policymakers and organisations, averaging across stakeholders can hide challenge-specific barriers. Readiness assessments should preserve both differences between stakeholder groups and variation within the same stakeholders across challenges. Effective adoption and literacy strategies should ask not only who appears ready, but which challenges they find unusually difficult and whether the likely constraint concerns implementation, capability, assurance or resources.

0.53

A Conceptual Framework for Enhancing Workforce Readiness for Smart Manufacturing in the AI Era

eess.SY cs.AIcs.CY ·2026-08-12 ·Dalton Ross Smith, Wilburn Whittington, Alejandro Martinez, Aidan Duncan, Gang Li
similarity 0.61
Abstract · 30 pages, 11 figures, submission for ASEE Journal of Engineering Education

The convergence of artificial intelligence (AI), Industrial Internet of Things, cyber-physical systems, and advanced robotics is reshaping manufacturing faster than engineering curricula can adapt, widening the gap between the competencies required on the shop floor and those delivered by traditional engineering and technology education. This paper proposes a Workforce Readiness Level (WRL) framework, which adapts the Technology Readiness Level scale into nine progressive competency stages and a four-pillar rubric, digital and AI literacy, cyber-physical systems fluency, human-machine collaboration, and data-driven decision making, aggregated through a composite stage score and a cohort-level workforce-readiness index under a ``no-thin-pillar'' rule. The framework is instantiated at a university smart-manufacturing teaching laboratory and draws on 89 sponsored capstone projects delivered over four semesters, four of which are analyzed in depth. Four pillars jointly span the relevant ABET student outcomes. Across the highlighted cohorts the workforce-readiness index ranged from 5.2 to 6.4, and the no-thin-pillar rule was diagnostically informative in three of the four cases and the binding certification constraint in one, repeatedly surfacing cyber-physical and data-driven-decision gaps concealed behind strong analytics profiles; advancement to the highest stages was gated by industry-embedded experience rather than additional coursework. WRL offers educators, accreditation bodies, and regional workforce systems a common, evidence-based instrument for diagnosing and advancing workforce readiness; future work will calibrate pillar weights and test reliability and predictive validity.

0.10

Assessing the AI Readiness of Construction Datasets: A Multidimensional Operational Framework

cs.AI ·2026-10-18 ·Xiaoyu Hou, Bo Xiao, Abdolmajid Erfani, Ronghua Xu, Yu Cai
similarity 0.56
Abstract

The rapid growth of artificial intelligence (AI) applications in construction has increased the demand for datasets suitable for reliable model development, evaluation, and reuse. However, construction datasets vary widely in documentation, quality, governance, and evaluation support, and consistent criteria for assessing AI readiness remain limited. This study develops a Construction Dataset AI Readiness Framework with 30 attributes across four dimensions: Metadata Completeness, Data Quality and Representativeness, Data Governance and Accessibility, and AI Utility. The framework uses attribute-specific scoring, applicability screening, and automated and manual verification. It was evaluated using 21 publicly available datasets across seven data-type groups. Overall readiness scores ranged from 0.720 to 0.964, with a mean of 0.879. Hybrid verification achieved 90.5% agreement between automated suggestions and manually verified scores. The framework supports consistent assessment of heterogeneous construction datasets and identification of readiness gaps.

0.17

Which Buildings Are Artificial Intelligence-Ready? A Measurement-Based Assessment Framework for AI Question Answering and Actuation

cs.AI ·2026-10-06 ·Wooyoung Jung
similarity 0.55
Abstract · 47 pages, 11 figures, 23 tables. Code, results and data supplement: https://doi.org/10.5281/zenodo.23197610

Agentic artificial intelligence (AI) systems are becoming the interface to buildings, answering questions and controlling operations, but a building's readiness for them has not been systematically assessed. This study proposes a framework to quantify it. First, a building's knowledge graph sets two ceilings. The answerable-readiness ceiling is the share of operational questions its data could answer, and the actuation-readiness ceiling is the share of control actions it exposes. Second, a reference AI agent's accuracy on a fixed set of these questions shows how much of the ceilings is realized. On a simulated office, the agent realizes 0.62 of a 0.64 answerable ceiling, so missing data, not the AI, limit readiness, except in naming a fault's cause. Across 37 public real-building graphs, the median answerable ceiling is 0.16, and in 15 of 45, unlinked sensors lower it. The framework turns "is this building AI-ready?" into an auditable, ranked retrofit question.

0.53

Uneven Self-Reported AI Use: An Embedded Case Study Across Eleven Teams in a Software Organization

cs.HC cs.CY ·2026-11-10 ·Daniele Veri'
similarity 0.55
Abstract · 11 pages, 1 figure, 4 tables

This paper presents a descriptive, embedded single-case study examining self-reported AI use within a software organization. The study draws on 98 structured interview records collected across 11 teams, using ten standardized team-level instruments (n = 65) and one instrument with distinct response anchors (n = 33). Among respondents assessed using standardized instruments, 36 of 65 (55.4%) reported AI-use frequency scores of 4 or 5 on a five-point scale. Team-level proportions varied from 20.0% (1/5) to 71.4% (5/7). A record-level cross-tabulation revealed limited awareness or understanding of organizational AI policies across both frequency groups: 86.1% (31/36) of respondents scoring 4-5 and 96.6% (28/29) of those scoring 0-3 reported either no policy awareness or uncertainty about policy details. In the group assessed using the distinct instrument, 31 of 33 respondents (93.9%) scored 4 or 5. Although the pooled proportion reached 68.4% (67/98), differences in response anchors limit direct comparability, making the standardized-instrument results the primary analytical reference. Interviewer-recorded observations provide qualitative context on reported practices and constraints but do not support estimates of their prevalence or causal explanations for differences in AI-use frequency. The findings characterize AI-use patterns and policy awareness within the interviewed sample, without supporting inferences about organization-wide adoption, policy compliance, or the effectiveness of AI use. The study contributes an empirically grounded organizational case and an explicit account of the methodological boundaries of cross-team comparisons using heterogeneous interview instruments.

0.49

How ready is the United States commercial building stock for artificial intelligence? A national estimate from energy codes and survey data

cs.CY ·2026-11-15 ·Wooyoung Jung
similarity 0.54
Abstract · 48 pages, 9 figures, 17 tables. HUBS Lab Paper No. 2026-011. Code and data: doi:10.5281/zenodo.23966090

Buildings serve as platforms for artificial intelligence (AI) through the data they generate, but the building stock's readiness as an AI platform has not been assessed. A recent framework measures a building's AI readiness as the share of 76 answer levels, across 31 types of operators' questions, that its recorded data could reach, and has so far been applied only to individual buildings. This study applies it to the 2018 U.S. commercial building stock. It combines 6,436 records of the Commercial Buildings Energy Consumption Survey with ASHRAE 90.1's data requirements, state code adoption, advanced-meter statistics and 45 buildings' knowledge graphs, imputing each building's code edition and data recording. Weighted by floor area, the stock could answer on average 0.145 (95% interval 0.127-0.163) of these answer levels. For 92.0% of floor area its data answer less than half of the questions about current status, and most floor area stays below that mark under every tested assumption about compliance, description and the reference buildings. More than half of what installed equipment could answer is lost in recording, mostly because conventional thermostats store nothing and meters lack interval readings. Readiness rises with size, from 0.073 in buildings of at most 5,000 ft$^2$ to 0.173 at 25,000 ft$^2$ or more. Only 1.6% of floor area was built under a code edition requiring recording, introduced in 90.1-2013 for large buildings. The study gives the first national baseline of commercial-building AI readiness and a public-data method that can be reapplied to each new survey to track the stock.

0.18

The Customer Is the Builder: How AI Coding Agents Are Rewriting the Economics of Software

cs.SE cs.CYecon.GN ·2026-10-21 ·Ripon Chandra Malo, Zimeng Yu, Tong Qiu
benchmarkcode/datahot direction similarity 0.54
Abstract · 37 pages, 24 figures, 7 tables. Code and data: https://github.com/riponcm/The-Customer-Is-the-Builder. Archived release: https://doi.org/10.…

AI coding agents could change whether organizations buy software or build the functionality they need. We focus on organizations and professional buyers whose domain knowledge can help them specify and evaluate tools for their work. We define the software substitution frontier as the functions customers could build and maintain at an acceptable standard for less than buying them. Using public data, we compare growing capacity to build with indicators of market change. Since 2023, the length of benchmark tasks that leading agents can complete at 50 percent success, measured in human working time, has doubled about every 129 days. A broad search identified 575 potential open-source alternatives to selected commercial products, although some functional matches still require independent validation. The Craft suite produced 12 application repositories over 12.0 days of public development, but these remain early versions with unverified completeness and reliability. Market evidence is mixed: purchased software gained US investment share and tracked commercial installations grew. Yet 32 percent of respondents to an organizational survey reported forgoing at least one software purchase because their organization could build the functionality with coding agents. These self-reports do not establish the spending displaced or the reliability of the resulting tools. The gap motivates a warning: customers' capacity to build could affect individual buying decisions before a broad purchasing shift becomes visible. We examine this possibility using benchmark projections and observable market tests. The projections are an extrapolation, not a forecast of customer switching.

0.43

Understanding Operator Attitudes Toward AI-Supported Decision Making in Maritime Operations

cs.HC cs.AI ·2026-09-10 ·Doreen Jirak, Armeen Saroukanoff, Dirk van Rooy
surveyhot direction similarity 0.53
Abstract · 11 figures

Maritime Autonomous Surface Ships (MASS) and AI- supported decision assistants are expected to transform maritime operations, but their safe integration depends on how maritime professionals perceive and trust such systems. This paper presents a survey study on maritime stakeholders' attitudes toward an AI-supported assistant in collision-avoidance scenarios. Participants evaluated technology anxiety, trust in automation, and explanation quality using established and adapted questionnaires, complemented by sentiment and thematic analysis of open-ended responses Results indicate a generally positive disposition toward maritime technology, no clear age-related differences in openness, stable trust across scenarios, and more scenario-sensitive, multidimensional explanation ratings. Open responses showed that participants valued support for decision-making, situation awareness, and confidence-building, while raising concerns about AI reliability, over- reliance and loss of expertise. The findings suggest that maritime AI systems should not focus solely on increasing automation or trust, but on supporting calibrated reliance through transparent, reliable, and operationally meaningful design with domain experts in the loop.

0.27