CS Paper Radar

Open Questions Towards Skill-Sustaining Reliance in Reflective AI Engagement

Sander de Jong

cs.HC ·submitted 2026-09-23 11:41 UTC · v1

Abstract

As AI systems are increasingly integrated into professional work, reflection strategies such as cognitive forcing and prompts that foster critical engagement have shown promise in reducing overreliance and improving decision quality. However, these strategies have primarily been evaluated as short-term interventions within single sessions. The next challenge is to assess whether such mechanisms sustain human agency and expertise over time. Drawing on prior work in AI-assisted decision-making, metacognition, and reflective AI engagement, we examine the challenges of designing and evaluating reflective mechanisms for long-term skill sustainability, considering individual differences in how users engage with such support, the organisational conditions under which it is implemented, and the gap between short-term evidence and long-term claims. We introduce open questions for the research community about the conditions under which reflective AI engagement can be sustained in practice.

Closest papers

Nearest neighbours by meaning across the whole index.

When Does AI Augment Work? A Workflow-Level Framework for Human-Agent Collaboration

cs.AI cs.CYcs.HC ·2026-09-11 ·CIVIC-AI Collaboration, :, Jiaying Wu, Caleb Ziems, Raymond Chan +18 more
similarity 0.64
Abstract · 8 pages. Whitepaper from the CIVIC-AI 2026 workshop

We aim to characterise the value of artificial intelligence in the workplace. Current studies largely measure this value in terms of the current automation capabilities and public adoption of AI. However, such metrics ignore the greater impacts of human--agent collaboration in transforming the nature of work. To account for this, we must expand the scope of our analysis beyond atomised tasks of today, and instead focus on how AI can augment entire workflows of the future. To ground this analysis, we establish a precise definition of AI augmentation comprising six conditions, spanning durable net value, meaningful human control, accountability and recovery, and long-term human development through learning, career pathways, and job purpose. We elaborate on these conditions and apply the framework in a case study of AI-mediated social surveys. We conclude by outlining how organisations, researchers, and government leaders can use this framework to make sense of the future of work.

0.24

Reflective Computing

cs.HC cs.CY ·2026-10-26 ·Md Haseen Akhtar
similarity 0.63
Abstract · 54 pages, 8 figures, 12 tables

Interactive technology is increasingly built for speed, and generative AI now answers before a question is fully formed. Yet the capacity to pause, interpret and decide for oneself is central to wellbeing, learning and meaningful use. HCI has named paradigms for sensing emotion, changing behavior, calming attention and tracking the self. However, none of them takes human reflection, and the slowing down it requires, as its organizing aim. This article defines that paradigm, reflective computing, and derives it from what thirty years of designs lack. We analyzed 134 interactive systems from 17 ACM venues (1996-2026) in two phases. First, an abductive gap analysis read every system against reflection theory, and seven recurring gaps defined seven dimensions, namely tempo agency, invitational form, interpretive openness, reflective depth, temporal span, protected idleness and ethical non-extraction. Second, two independent coders scored every system with a codebook (Krippendorff's alpha 0.67 to 0.84 for five dimensions; ICC 0.82 for the overall score). The system sets the pace in 51 designs, 74 support only momentary use, only 12 scaffold reflection beyond description, and 56 papers are silent on the inner states they collect. No system expresses all seven dimensions strongly, and only 20 meet the definition. Slow and experience centered design comes closest, whereas persuasive technology and human-AI interaction score lowest. Factor and latent class analyses reveal two cultures of reflection, one working through form and the other through scaffolded thought, which only one system combines. Systems that let people set the pace score markedly higher, even with paradigm and form controlled (odds ratio 13.5). Hence, reflective computing is proposed as a paradigm whose aim is a human capacity rather than a system function, and which treats slowness as valuable only when people choose it.

0.29

Artificial Intelligence Literacy and Sustainable Development: An Ethical Governance and Development Goals Framework

cs.CV ·2026-09-09 ·Md. Masudul Islam, Mirza Niaz Morshed, Md. Shafiqul Islam
publishedsurveyhighly cited similarity 0.61
Abstract

AI literacy provides foundational competencies that support ethical, transparent, and sustainable technological development, although higher-order capabilities such as governance, critical evaluation, and strategic decision-making extend beyond basic literacy into advanced levels of AI competency. This study positions AI literacy as a governance capacity that complements and strengthens all 17 SDGs. It introduces a six-level taxonomy of artificial intelligence reasoning and ethics that extends traditional learning models by incorporating ethical judgement and strategic foresight. This taxonomy forms the foundation of an integrated framework linking education, governance, and sustainable development. A survey of 300 participants from diverse professional backgrounds within a national context which reveals strong technical awareness but limited ethical and governance readiness, highlighting critical gaps in public capacity to manage artificial intelligence responsibly. Findings show that ethical reasoning and reflective thinking are the strongest predictors of sustainable and trustworthy artificial intelligence use. The study proposed to embed literacy-based competencies into curricula, institutional policies, and governance mechanisms to accelerate equitable and responsible progress toward sustainable development goals

0.62

Impact of Expertise and Trust on AI-assisted Work

cs.HC ·2026-10-10 ·Qianou Ma, Pranav Khape, Rock Pang, Ken Koedinger, Tongshuang Wu +2 more
similarity 0.60
Abstract

Artificial intelligence (AI) agents promise to extend what users can accomplish beyond their existing expertise, but they also raise the risk of producing plausible-looking work that users may struggle to evaluate. We ask how task-relevant expertise and trust in AI shape agent-assisted work. To isolate these factors, we conduct a think-aloud study in which 20 professionals with varying data-science expertise use the same agentic tool to complete the same data-science hiring assessment, used at a major U.S. company. We find that surface productivity can come at the expense of understanding: participants who delegated more completed more of the task, but were also more likely to produce invalid solutions. Experts more often resisted this tradeoff, sacrificing completion to decompose the task and scrutinize agent outputs. Our findings call for evaluating agentic assistance not only by how much it accomplishes, but by whether users remain able to evaluate the work they produce.

0.48

Think Once, Reflect Twice: How Feedback Shapes Human-AI Collaboration

cs.HC ·2026-10-14 ·Joshua Holstein, Philipp Spitzer, Sebastian Schäfer, Maximilian Förster, Gerhard Satzger
hot direction similarity 0.60
Abstract

As artificial intelligence (AI) increasingly supports human decision-making in high-stakes domains, designing effective human-AI collaboration becomes critical. Successful collaboration requires humans to reflect on decision-making processes and adjust their strategies accordingly. Current research typically investigates interventions, such as explainable AI, that target reflection during the decision-making process (reflection-in-action). Less attention has been given to retrospective examination of decisions (reflection-on-action). This work explores reflection-on-action by studying the impact of feedback on reliance behavior and human-AI team performance. Specifically, we investigate feedback interventions targeting overrides of AI advice through a behavioral study (N=244). We find that such feedback influences reflection-on-action, while unidirectional feedback risks reducing subsequent reflection-in-action. Furthermore, we identify opposing shifts in reliance behavior that leave overall human-AI team performance unchanged but show context-dependent effects. Balanced feedback did not show these risks, preserving both concurrent and retrospective reflection, offering insights for designing for appropriate reliance on AI.

0.29

What We Know about Responsible AI Practices in Industry: A Half Decade of Empirical Research

cs.HC cs.AI ·2026-08-11 ·Wesley Hanwen Deng, Agathe Balayn, Andrew Selbst, Jason I. Hong, Motahhare Eslami +4 more
similarity 0.60
Abstract

Responsible AI (RAI) has become a central concern for technology companies, regulators, and the public. How industry practitioners interpret, implement, and sustain RAI work directly shapes the design and deployment of AI systems. As empirical scholarship examining RAI practices in industry has rapidly expanded, findings are dispersed across studies that focus on different roles, organizational contexts, and interventions. This work synthesizes current knowledge through a literature review of 161 empirical studies spanning six years, each engaging industry practitioners via interviews, surveys, workshops, ethnographies, and other methods. Our synthesis reveals both meaningful progress and persistent challenges in industry RAI practice. Practitioner awareness has increased, RAI activities have become more professionalized, and interventions such as toolkits and guidelines are more widely adopted. At the same time, practitioners continue to face substantial barriers, including limited training, uneven organizational support, and a lack of interventions tailored to day-to-day work practices. By consolidating and organizing these findings, we provide a more complete account of industry RAI than any single study to date. We conclude by discussing implications for RAI researchers, practitioners seeking to adopt effective practices, and policymakers aiming to ground governance efforts in the realities of industry contexts.

0.04

Beyond Bias: Participatory and Reflective Approaches to Cultural AI

cs.HC ·2026-09-04 ·Archana Prasad, Isha Singh, Tom Simmons
similarity 0.59
Abstract · In Proceedings of The First Reflection in Creative Experience (RiCE) Workshop (RiCE W1) arXiv:2607.24558

Generative AI systems increasingly shape cultural production, yet creative intentions, cultural meanings, and interpretive practices often can't be articulated through computational metrics alone. This paper presents Beyond Bias, a collaboration between Gooey.AI and Goethe-Institut India, as a participatory approach to cultural AI which includes collaborative dataset creation, reflective AI tooling, artist-led model fine-tuning, and co-authored governance practices. Across 9 workshops involving over 200 participants, artists and cultural practitioners engaged with AI systems through experimentation, iteration, and collaborative LoRA training. Participants used their AI-generated outputs and visualizations as reflective interfaces for exploring symbolism, memory, authorship, and cultural contexts. Comparing contemporary generative AI outputs with participant fine-tuned outputs helped participants reflect on cultural details missing in big tech AI systems. This paper contributes reflective AI tooling approaches foregrounding transparency, stewardship, and community participation; findings from participatory workshops examining how generative AI visualizations mediate cultural representation and interpretive practice; and a framework for cultural AI grounded in cultural integrity, and reflective practice.

0.12

"To Boldly Go Where No One Has Gone Before" What Has AI Let Developers Unlock?

cs.HC ·2026-10-16 ·Rudrajit Choudhuri, Jenna L. Butler, Christian Bird, Carmen Badea, Brian Houck +1 more
similarity 0.59
Abstract

Measuring AI by how much faster developers work is like judging electricity by how much faster it spun a steam-era factory. A fuller measure asks what new work becomes possible. We surveyed 331 software developers at Microsoft about what AI lets them do that they could not do before and analyzed their answers using reflexive thematic analysis with a human-in-the-loop, multi-model AI council. Developers described doing familiar work faster (Faster, 45%), undertaking work previously beyond their reach (Further, 36.9%), and taking on new kinds of work centered on building for and directing AI agents (Afresh, 12.4%). Across these accounts, learning and scaffolding ran in both directions: developers learned new skills with AI while externalizing their tacit knowledge as the context and standards that guide AI's work. Drawing on Vygotsky's zone of proximal development, we frame developers and AI as joint learners whose zones meet at the skill-judgment nexus: AI can supply skill faster than it can reliably judge its own work, and developers must continuously bridge that gap. Whether they do sets them on one of two paths. On one, developers' judgment grows alongside AI's skill, and they codify what they learn so the loop keeps turning. On the other, they become hollow orchestrators, approving work they can no longer judge and losing the identity and meaning they once drew from it. Based on our findings, we offer a two-way scaffolding playbook to help developers, teams, and tool builders take the first path.

0.12