CS Paper Radar

Positive Ratings, Hidden Concerns: Employee Voice Disclosure in AI-Mediated Organizational Listening

Thilo Tamme, Michael Saatkamp, Alma Bonte, Daniel Weiss, Anton Hantel, Andrej Levin

cs.AI cs.HC ·submitted 2026-09-30 02:18 UTC · v1
publishedposition

Abstract

Organizations started listening to employees through conversational AI agents alongside structured surveys. Little is known about what these channels change in what employees say when disclosure carries hierarchical risk. We report a field study inside a global management consulting firm whose process pairs a pre-survey with an adaptive AI voice interview on the same themes within one session. Across 44 first-session interviews (132 matched theme observations), 20-41% of sessions showed a favorable rating co-occurring with a substantive concern voiced later, depending on the favorability threshold. The Gioia analysis drew on 158 protective quotes from 65 eligible sessions. Disclosure rarely arrived unguarded: employees softened concerns, deflected accountability, and bounded how far they went, and this protective work tracked the perceived legitimacy of the listening structure. We develop a grounded model of bounded disclosure and derive four propositions for voice, channel and listening research. Silence, we argue, can persist inside expression.

Comment
10 pages, 2 figures, 3 tables. Accepted at the 60th Hawaii International Conference on System Sciences (HICSS-60), 2027

Closest papers

Nearest neighbours by meaning across the whole index.

AI-Mediated Employee Voice and Performance: Disentangling Informational and Affective Pathways

cs.CY cs.HC ·2026-10-18 ·Thilo Tamme, Andrej Levin
published similarity 0.70
Abstract · 10 pages, 1 figure. Research proposal accepted, following double-blind peer review, for presentation at the 46th Annual Conference of the St…

Employee voice -- the discretionary expression of ideas, concerns, and suggestions intended to improve organizational functioning -- creates value inside firms, yet organizations increasingly replace or augment human-led listening with AI-enabled systems that collect, analyze, and route employee input at scale. Whether algorithmic listening replicates the value-creation mechanisms of human voice, and whether it alters the pathways through which voice translates into performance, remains an open question. This research proposal theorizes that traditional voice bundles two distinct functions, knowledge extraction and relational signaling, and that AI mediation may decouple them: strengthening the informational pathway (implemented improvement measures) while weakening the affective pathway (the experience of being heard). We propose a randomized field intervention at a global strategy consulting firm, covering approximately 2,000 client-facing consultants, that varies the form of listening across three conditions -- no structured voice, human-led survey-based voice, and AI-enabled conversational voice -- and links weekly team survey data to longitudinal performance ratings. A dual-mediation model is tested in which voice affects performance through (1) implemented process improvements and (2) affective well-being. The study extends voice theory to knowledge-intensive professional services, disentangles the micro-mechanisms of voice, and provides causal evidence on whether AI can serve as an effective listener.

0.25

Beyond Small Talk: Modeling Disclosure Trajectories in Human-AI Conversation

cs.CL cs.AIcs.HC ·2026-10-21 ·Keith Kwok, Wanting Ning, Tej Deep Pala, Desmond C. Ong, S. Supraja +2 more
code/data similarity 0.65
Abstract · 71 pages, 11 figures. Code available at https://github.com/kwokkeith/Beyond_Small_Talk

Recently, we see a rise in conversational agents as a form of social and emotional support, where disclosure will unfold over time. Yet, current evaluations of these agents typically examine isolated conversational states. In analyses of naturally occurring conversations, disclosure history and current disclosure are confounded which tends to make their effects difficult to isolate. We thus introduce Trajectory-based Disclosure Evaluation (TraDE), an evaluation framework grounded in Social Penetration Theory that utilizes predefined disclosure trajectories and evaluates how preceding disclosure history shapes model behavior under matched current disclosure. Through the use of TraDE, we demonstrate across multiple models and relational behavior benchmarks that responses to disclosures matched on depth can differ depending on the preceding trajectory, particularly in whether models accept or challenge the user's framing. We also observed that these differences track accumulated exposure to deeper disclosure rather than any single moment of vulnerability or the order of disclosures. It also tends to persists for several turns after disclosure returns to shallow levels. For several behaviors, we also demonstrate that models diverge most consistently from human supporters in the Emotional Support Conversation corpus (ESConv) not when users open up but rather when they step back in their disclosure. TraDE thus provides a systematic way to expose history-dependent relational behavior that evaluations of isolated conversational states would otherwise miss.

0.42

Who Bears the Cost of Honesty? A FAccT Workshop Synthesis and Research Agenda for Equitable AI Disclosure

cs.HC ·2026-08-21 ·Runlong Ye, Jessica He, Finola Finn, Angel Hsing-Chi Hwang, Donal Khosrowi +2 more
similarity 0.64
Abstract

AI disclosure is increasingly promoted and sometimes required as a route to transparency, accountability, provenance, and trust. Yet disclosure can also expose AI users to suspicion, stigma (e.g., competence penalties), and surveillance, affecting minoritized groups in particular. This paper reports on Who Bears the Cost of Honesty?, a CRAFT workshop at the 2026 ACM Conference on Fairness, Accountability, and Transparency that used scenario-anchored power mapping and design fiction to explore the benefits, harms, tensions, and power asymmetries that emerge under AI disclosure norms and mandates. We document the workshop design and analyze the disclosure approaches participants co-created, comprising four completed power maps, three context cards, and one interface prototype. These artifacts span education, workplace, politics/journalism, and interpersonal contexts. They depict disclosure as a multi-actor accountability process, surface concerns that the use of accessibility-related AI could be held against workers in performance evaluations, and explore how context-specific, bottom-up disclosures may support transparency while mitigating some risks of stigma and misinterpretation. We contribute (1) a documented two-stage workshop method; (2) an artifact-grounded thematic synthesis; and (3) a diagnostic framework, the Cost-of-Honesty Stack, with provisional design suggestions and research directions.

0.05

DISARM-ing the Hidden Puppetmaster: An Interface for Exposing Manipulative Tactics in Large Language Models

cs.HC ·2026-10-14 ·Kynnedy Simone Smith, Kantwon Rogers, Priyal Shrivastava, Motahhare Eslami, Jocelyn Shen +1 more
similarity 0.63
Abstract · Preprint in submission

Large language models (LLMs) can covertly steer users' beliefs through emotionally manipulative tactics, yet little is known about how interfaces can protect users as such influence unfolds. We investigate whether in-situ disclosures can inoculate users against manipulation during AI conversations. Following a formative study, we developed DISARM, an interface that identifies, explains, and tracks manipulative tactics and hidden incentives. We evaluated our interface in a between-subjects experiment where 488 participants sought advice from an LLM pursuing a harmful hidden objective, with or without disclosures from DISARM. Participants receiving disclosures exhibited 78% less belief shift toward the agent's objective and perceived its advice as more biased and less actionable and the agent as less ethical, reliable, and well-intentioned. An inductive analysis of 1,927 user turns identified 16 response and pushback strategies. We contribute evidence that real-time disclosures can reduce manipulative influence, design recommendations for resistance, and a dataset of categorized responses.

0.09

Toward Meaningful Transparency for AI Chatbots: Disclosing Persuasive Intent Reduces Persuasion

cs.CY cs.AIcs.HC ·2026-08-12 ·Adrian Rauchfleisch, Andreas Jungherr
similarity 0.63
Abstract · 30 pages including Supplementary Information

The growing role of AI-generated content and AI-enabled systems in public communication has led regulators to demand clear disclosure of content provenance and AI involvement. But the effects of such disclosures remain uncertain. We test two disclosure approaches in their impact on an AI chatbot's persuasive appeal. In a preregistered experiment, 1,500 UK adults held a short conversation with a persuasive chatbot about one of 60 policy issues. The chatbot was identical for everyone. We randomized the disclosure that people received: nothing (control), a prominent disclosure that they were interacting with an AI (T1), or that disclosure plus the chatbot's persuasive intent and instructions (T2). The chatbot shifted attitudes by 12.6 points on a 100-point scale in the control group. The AI-identity disclosure was practically equivalent to no disclosure, with a 13.1-point shift, whereas the additional intent disclosure cut the persuasive effect roughly in half to 6.3 points. It also made participants view the campaign's methods as less acceptable and support stronger penalties against it. For direct chatbot interactions, transparency about AI identity alone does not meaningfully impact its influence. While current rules emphasize what a system is, our results show why the regulation of persuasive AI must also address what the system is trying to do.

0.10

When Disability Disclosure Travels: Memory, Privacy, and Contextual Integrity in Conversational AI

cs.HC cs.CY ·2026-09-19 ·Atieh Taheri, Mahya Tazike, Patrick Carrington, Jeffrey P. Bigham
similarity 0.62
Abstract · 16 pages, 1 figure, 3 tables. Under review

Conversational AI assistants remember what people tell them, and for disabled people, that often includes disability. We interviewed 12 adults with disabilities in the United States who use LLM-based assistants such as ChatGPT, Claude, and Gemini about when, how, and why they disclose disability to these systems and how this compares with disclosing to people. Using contextual integrity as an analytic lens, we found that participants disclosed by need rather than by name, translating disability into task-scoped instructions; that the same disclosure was judged against two recipients, a non-judging interlocutor and a data-holding company, producing opposite norms; and that memory features relieved the burden of repeated disclosure while letting disability information drift into contexts where it did not belong. Participants did extensive boundary work to restore context and wanted control over scope, provenance, retention, and access rather than per-utterance toggles. We discuss implications for the design of conversational AI assistants.

0.47

When Is Disclosing Private Conversations with AI to the State Justified? Proactive Referral Policies of Major U.S. AI Companies through the Lens of Contextual Integrity

cs.CY ·2026-10-18 ·Minjong Cheon, Hanseon Joo, Ook Lee, Jongchang Ahn
similarity 0.61
Abstract · 38 pages (22-page main text followed by 16-page supplementary material). Minjong Cheon and Hanseon Joo contributed equally

AI companies engage in "proactive referral," notifying law enforcement of user conversations they judge dangerous without a government request. This poses a dilemma, since referral may expose people who merely confided dangerous thoughts to an AI to investigation, whereas not referring may leave actual violence unprevented. This study asks under what conditions proactive referral can be justified and to what extent companies' public policies disclose those conditions. Drawing on contextual integrity theory and the norms governing exceptional information sharing in confidential counseling, online posts, and private communications, the study develops eight justification criteria classified as required, presumptive, or recommended. Three evaluators analyzed 27 public documents from six major U.S. AI companies using the criteria applicable to corporate policies. No company clarified whether broad sharing provisions or narrower safety notices took precedence, and assessments of referral scope depended on which provisions were given precedence. No company disclosed the specific factual thresholds and exception conditions governing referral decisions, or whether users would be notified afterward. The study turns contextual integrity into a stage-by-stage framework for proactive referral, shows that policy documents must be read in light of their relationships, and proposes policy elements for keeping proactive referral a narrow exception disclosed in advance.

0.34

Human-AI Collaboration at Scale: Task Criticality, Agency, and Friction across 250,000 Conversations

cs.HC ·2026-08-17 ·Yijia Shao, Dora Zhao, Vishakh Padmakumar, Jennifer Wang, Diyi Yang
similarity 0.59
Abstract · 17 pages, 6 figures

AI is increasingly embedded in professional work, yet how people actually collaborate with it at scale remains poorly understood. Drawing on a corpus of 249,834 real-world conversations, we conduct privacy-preserving analysis by asking three questions: what work people bring to AI, what roles humans retain in completing that work, and where human-AI collaboration breaks down. We find that users bring to AI not only trivial tasks but also consequential, hard-to-reverse work, with high criticality delegation concentrating in advisory and professional domains. As stakes rise, users engage more actively with AI output, and conversation length nearly doubles from ephemeral to high-stake tasks. We then examine human agency, the degree of control and responsibility users retain in completing the task. Human-led collaboration dominates overall, but users construct their level of agency through how they prompt and iterate. Across different levels of agency lies a common tension: does working with AI build human capability, or substitute for human effort? We examine this tension through AI-supported learning and upskilling, finding that active teaching is common (67% of conversations) but its benefits are unevenly realized. We further show that friction arises in roughly half of all conversations but it is often productive, and users often employ active strategies to recover from friction when it does occur. Together, these results map how humans and AI work together at scale and when that collaboration makes people more capable, and when it doesn't.

0.50