CS Paper Radar

Helpful but Fallible: Developer Experiences of AI Tools Under a Coordinated Industrial Roll-out

Andreas Bexell, Rushali Gupta, Lo Gullstrand Heander, Emma Söderberg, Per Runeson, Sigrid Eldh, Wei Shi, Konstantin Malysh

cs.SE ·submitted 2026-09-17 18:30 UTC · v1

Abstract

AI-enabled software development tools (AI-devtools) are being industrially adopted under strong expectations of productivity gains, yet developers' experiences of such roll-outs are underexplored. Organizations commit budgets, evaluate staff, and revise practice on a partial picture, since the evidence base is mainly tool evaluations, productivity metrics, and surveys, with few qualitative in-situ accounts of ongoing, coordinated roll-outs. We report a case study of a coordinated roll-out of AI-devtools at a large Swedish telecommunications company, investigating how developers experience the roll-out and how they anticipate their profession will change. We conducted semi-structured interviews with 12 software professionals across three sites, analyzed with process coding and thematic analysis, and interpreted through the extended Technology Acceptance Model (TAM2) as a post-hoc analytical lens. Our findings on use cases, productivity, frustrations, and tool limitations corroborate prior survey work. Beyond corroboration, the interviews surface a management-developer expectation gap that maps onto the TAM2 constructs of subjective norm and voluntariness, and show that participants weigh perceived risk heavily, a factor that TAM2 and similar acceptance models do not represent. AI-devtools emerge as helpful but fallible assistants whose value is shaped by organizational expectations, system scale, and developers' skills.

Closest papers

Nearest neighbours by meaning across the whole index.

The Psychological Costs of Artificial Intelligence Adoption in Software Engineering

cs.SE cs.AI ·2026-09-03 ·Adam Alami, Elda Paja, Abhishek Tiwari
similarity 0.76
Abstract

Artificial intelligence (AI) is increasingly used to augment software engineering (SE) workflows. While code generation remains the main use case, organizations are actively seeking AI integration in other practices such as test cases generation and code reviews. Organizational AI adoption strategies seem to focus on tangible outcomes such as productivity. However, AI is a disruptive force, introduced into settings where role identity, team norms, and the sources of job satisfaction were well established before the recent advances in generative AI. Historically, technological disruptions have caused psychological and social strains in workplaces, ranging from anxiety and eroded meaning to deskilling and disrupted professional identities. The assumption that AI for SE is cost-free may not be accurate. Therefore, in this study we sought to understand the psychological costs software professionals experience during organizational AI adoption. We carried out a case study in a large software development services company, one year after the company launched its AI adoption. We collected qualitative data through meetings and semi-structured interviews (N = 21). We found that software professionals experience accountability anxiety, craft identity disruption, meaning and satisfaction erosion, cognitive and workload intensification, and uncertainty distress. Practitioners manage these costs through practices that restore control, mitigate them through protective and identity-preserving adaptations, or absorb them, carrying what neither can resolve. We contribute to AI-human collaboration in SE by repositioning AI adoption as a human transition, not only a technological and organizational one.

0.15

Understanding LLM Usage Among Early-Career Software Engineers in Practice

cs.SE ·2026-08-24 ·Julia Alencar, Ronnie de Souza Santos, Italo Santos, Cleyton Magalhaes, Danilo Monteiro Ribeiro
similarity 0.64
Abstract

Despite the rapid adoption of Large Language Models in professional software engineering, limited research has investigated how early career professionals develop effective AI assisted work practices during their transition into industry. We report findings from a mixed methods survey with 75 novice software engineers who actively use LLM supported tools in their daily work. Our results show that LLMs are embedded in routine software engineering activities, including coding, debugging, testing, documentation, and problem solving. Effective use depends on traditional software engineering competencies, such as debugging, testing, and architectural reasoning, together with critical thinking, output verification, prompt engineering, and continuous human oversight. We also identify a gap between workplace expectations and university preparation, with most participants reporting limited formal education on practical LLM use. These findings have implications for software engineering education, organizational onboarding, and workforce development in AI assisted software engineering.

0.31

AI Tools Adoption across the Double Diamond Workflow: Phase, Mode, and Barriers in Designer Practice

cs.HC ·2026-09-28 ·Sepideh Tajarmakan, Khashayar Hojjati Emami
similarity 0.64
Abstract

Designers are adopting AI faster than the tools built for them can keep up. General-purpose conversational AI led AI use among designers in three of the four phases of design work, ahead of tools built for design. We surveyed 443 designers from at least 43 countries about AI use in each phase of the Double Diamond: Discover, Define, Develop and Deliver. Tools were classified by output and function. Of these designers, 79.7% confirmed AI use in at least one phase. Adopters used AI in a mean of 2.89 phases, and only 35.1% used it in all four. They added phases in workflow order, from Discover onward. Conversational tools led in Discover, Define and Deliver. AI-native image generation led in Develop, where AI-native tools peaked at 57.6% of tool picks. Embedded AI features in existing design software peaked later, in Deliver (37.5%). Fewer designers used AI in later phases, from 318 in Discover to 182 in Deliver. Those who did named a similar number of tools per phase. Low perceived usefulness was the only barrier that separated non-adopters (40.5%) from adopters (16.4%) after correction for multiple tests. Concern about accuracy was similar in both groups.

0.09

Empirical Insights from AI-Powered Software Engineering in Practice

cs.SE ·2026-10-16 ·Tina Mersch, Jack Johns, Steffen Klepke, Hanya Elhashemy, Artur Signell +2 more
similarity 0.63
Abstract · Submitted to IEEE Software

Generative Artificial Intelligence (GenAI) is becoming indispensable in future software engineering. Its application spans a wide spectrum - from assisted development to autonomous software engineering, requiring organizations to address associated risks and challenges. This paper investigates these issues through three case studies, highlighting practical problems encountered during GenAI integration. Based on these findings, it provides targeted recommendations for managing risks and ensuring reliable outcomes. This paper provides guidance for effective and responsible GenAI adoption in software engineering based on empirical insights.

0.11

Technostress in the Age of AI: A Preliminary Study with Software Professionals

cs.SE ·2026-09-14 ·Ronnie de Souza Santos, Italo Santos, Cleyton Magalhaes, Zixuan Feng
survey similarity 0.62
Abstract

The rapid adoption and evolution of AI are changing software engineering work and requiring professionals to repeatedly adapt their knowledge, practices, and skills. Although technological adaptation has long characterized software development, less is known about how these new and recurring pressures manifest as technostress. This preliminary exploratory study investigates AI related technostress among software professionals. We conducted a survey and performed a thematic analysis of responses from 121 software professionals across 26 countries reporting their recent experiences with AI at work. Our findings suggest that AI related technostress emerges not only from adapting to rapidly changing technologies, but also from having to manage the work, technical responsibilities, and professional changes that accompany their adoption. This characterization shows that AI introduces pressures beyond learning and using new tools, affecting how software professionals perform and remain accountable for technical work and how they prepare for the future of their careers.

0.24

Factors Impacting Developer Efficiency: Results from an Adaptive Longitudinal Study

cs.SE ·2026-08-17 ·Danilo Ribeiro, Breno Alves, Gabriel Souza, César França, Alberto Souza
similarity 0.62
Abstract

Context: Developer efficiency is driven by technical, organizational, and personal factors, yet few longitudinal studies explore how these factors evolve over time. Objective: This study investigates the primary factors hindering the perceived efficiency of developers in a consulting and professional development context, analyzing how these factors vary across recurring data collection cycles and how they are described qualitatively. Method: We conducted a mixed-methods longitudinal case study applying the Adaptive Developer Efficiency Monitoring Method (ADEMM) to 27 external software developers, combining twelve waves of periodic surveys with eighteen semi-structured interviews, analyzed through statistical and thematic analysis. Results: The most frequent bottlenecks were organizational dependencies and waiting for external validation, which stayed structurally stable, followed by technical knowledge gaps, which declined as developers adapted. A generative AI usage barrier emerged qualitatively nine waves into the study, was incorporated into the survey instrument, and became the most frequently coded interview theme. Interviews corroborated the quantitative findings, with insufficient requirements documentation and organizational dependencies as the most recurrent themes alongside AI-related challenges. Conclusions: Perceived developer efficiency is highly dynamic and cannot be accurately captured through a single cross-sectional measurement. Adaptive monitoring via ADEMM identified an emerging factor, generative AI usage barriers, that a fixed instrument would have missed, and informed a concrete organizational intervention during the study. For organizations managing external developers, actions should target external dependencies, communication channels, and developers' evolving use of AI tools.

0.22

The Vibe Shift in Software Engineering: Evaluating AI-Led Conversational Programming for Performance, Cognition, and Responsible Adoption

cs.SE cs.AIcs.ET ·2026-09-09 ·Sales G. Aribe, Louie Jay S. Labastida
published similarity 0.61
Abstract · 14 pages, 4 figures, 5 tables, Published by International Journal on Advanced Science, Engineering and Information Technology (IJASEIT)

This study evaluates Vibe Coding, an emerging AI-led conversational programming paradigm that enables developers to generate software through natural-language interaction with large language models. Using a mixed-methods design, the study assessed performance efficiency, cognitive implications, and responsible adoption in comparison with traditional and AI-assisted coding environments. Thirty participants, including professional developers and advanced computing students, completed equivalent programming tasks under three experimental conditions. Quantitative data were analyzed using descriptive statistics and repeated-measures ANOVA, while qualitative data were examined through thematic analysis. Results show that vibe coding significantly improved development efficiency, reducing task completion time by 27% compared with traditional coding and 12% compared with AI-assisted coding. However, these gains were accompanied by lower maintainability indices and higher security vulnerabilities, indicating trade-offs in software quality. Usability results yielded a good rating (SUS = 71.4), while cognitive workload remained moderate (NASA-TLX = 55.5), reflecting reduced syntactic effort but increased linguistic reasoning. Thematic analysis identified trust calibration, loss of control, cognitive adaptation, and prompt-engineering strategy as key constructs. Notably, perceived loss of control was associated with increased security risks due to reduced transparency and validation of AI-generated outputs. Based on these findings, the study proposes a three-pillar framework for responsible adoption: hybrid integration of human and AI capabilities, human oversight and transparent accountability, and context-aware deployment. Overall, vibe coding enhances productivity but requires critical oversight, reinforcing its role as a transformative yet transitional paradigm in software development.

0.19

Vibe Coding: Practice, Performance, Productivity, and Risk -A State-of-the-Art Review

cs.SE ·2026-08-20 ·Dominik L. Michels, Mutaz Abu Ghazaleh, Francois Lazzari, Nabil Kassem, Jonathan Klein
surveyposition similarity 0.61
Abstract

Vibe coding - AI-assisted software development in which the developer describes intent in natural language and validates results by running rather than reading the generated code - was named by Andrej Karpathy in February 2025 and produced its first body of empirical evidence within seventeen months. This state-of-the-art review assembles that evidence across a cross-disciplinary corpus spanning software engineering, human-computer interaction, labour economics, security research, governance, and education. We survey the model landscape, the tool ecosystem, and the performance record by task type, finding the early benchmarks saturated but task-level capability uneven: reliable code generation alongside weak fault detection and hard-to-audit documentation. The productivity record is at first contradictory: peer-reviewed field experiments report +26% more tasks per week, independent randomised trials measure a 19% slowdown, and team-level telemetry shows code-review time up +441%. We argue these readings are consistent once measurement method, scope, and time horizon are held constant, and identify six patterns behind the dispersion, among them effect-shrinkage under broader measurement, self-report diverging from independent measurement, output volume conflated with productivity, and bold claims walked back once tested over longer horizons. We further document security failures in deployed applications, code-quality degradation visible in large-scale code and developer telemetry, unsettled copyright exposure, and evidence of skill atrophy. The review closes with the open research questions and one falsifiable conjecture: that the gains are real on new code and shrink or reverse on mature codebases, which would account for most of the disagreement in the record.

0.20