CS Paper Radar

Sycophancy Through a Five-Level AI Response Validation Framework

Dian Yu, Pei-Luen Patrick Rau

cs.HC ·submitted 2026-09-11 13:58 UTC · v1

Abstract

AI sycophancy, the tendency of AI systems to excessively agree with, flatter, or validate users, is an emerging concern in human-AI interaction. It is especially consequential in problem-sharing contexts, where users may seek both information and emotional validation. This paper conceptualizes AI sycophancy as excessive response validation and introduces a five-level AI Response Validation Framework (ARVF), measured using a six-item Perceived AI Sycophancy Scale (PASS). Across three phases, the study validated the framework with human participants through an online questionnaire, tested LLM-as-evaluators in answering PASS, and examined how ten contemporary LLMs generated and evaluated responses to real-world work and personal conflict scenarios. Results supported the intended progression of perceived sycophancy in ARVF and the reliability of PASS. Trust and perceived competence followed an inverted U-shaped pattern. LLM ratings reproduced the five-level structure but showed calibration differences from human ratings. Based on the LLM ratings, the ten contemporary LLMs were grouped according to their behavioral pattern. Text-based analysis provided further support on the linguistical structure for sycophantic responses generated by LLMs. Findings highlight AI sycophancy as a graded, context-sensitive interactional phenomenon.

Closest papers

Nearest neighbours by meaning across the whole index.

Mind the Accuracy-Approval Gap: How Users Evaluate Sycophantic AI in Everyday Tasks

cs.AI ·2026-11-12 ·Wajiha Naveed, Brandon Fain
benchmark similarity 0.60
Abstract

Large language models (LLMs) often exhibit sycophancy, a tendency to agree with users, flatter or affirm them, and preserve their face, even when independent judgment or critical feedback would be more useful. Prior work has largely evaluated sycophancy through benchmark evaluations, but less is known about how users perceive and respond to sycophantic AI in everyday tasks. We combine benchmark evaluations with two large-scale user studies. We study four personas defined through system prompts: objective (instructed to prioritize accuracy over agreement), soft-sycophantic, hard-sycophantic, and baseline (no persona-specific system prompt). Benchmarks show that even baseline exhibits substantial sycophancy, agreeing with users' stated views 71.7% of the time on NLP Survey, compared with 54.8% for objective and 89.5% for hard-sycophantic. Under conversational pressure on TruthfulQA, accuracy ranged from 81.9% for objective to 59.6% for baseline and 8.7% for hard-sycophantic. Participants were assigned to one of the four personas, and either discussed contested policy topics or collaborated with AI on email writing. Despite its higher accuracy under pressure, objective AI was rated significantly less respectful and satisfying than the other personas, and less trustworthy than baseline. Baseline and sycophantic personas did not differ significantly. Persona did not significantly affect how often participants changed their opinions, although participants who discussed with objective AI had greater odds of reduced confidence. Objective AI prompted greater writing expansion than soft-sycophantic AI, but final writing quality did not differ significantly across personas. These findings highlight a tension between accuracy and user approval: personas with substantially lower accuracy under conversational pressure received more favorable ratings for respect and satisfaction than objective AI.

0.17

Can LLMs identify and repair ruptures? Comparison between clinician practices and LLM behaviors

cs.HC ·2026-09-21 ·Jeongah Lee, Joy Qiuyue Zhong, Drishti Goel, Violeta J. Rodriguez, Dong Whi Yoo +2 more
similarity 0.59
Abstract

Ruptures represent common albeit critical moments in interaction where relational alignment breaks down, making them essential for evaluating AI where trust and engagement matter most. In a scenario-driven empirical study, we examined the performance of three LLMs at identifying and resolving ruptures across 21 mental health conversations and 22 experts' evaluation of the strategies. For identification, LLMs relied on explicit linguistic cues within single turns whereas experts integrated implicit, relational, and contextual information across the conversation. For resolution, LLMs tended to produce more directive and scripted responses whereas experts adopted process-oriented strategies such as validation, open-ended exploration, and psychoeducation. Overall, LLMs showed higher agreement with predefined labels in identification, but not in resolution where experts rated their responses only moderately effective, with consistent limitations in timing, depth, and contextual sensitivity. We discuss implications for the design of mental health conversational agents emphasizing relational awareness, pacing, and human-in-the-loop support.

0.30

How Far Do Capability Cues Travel? Anthropomorphism and Differentiated Trust in a Platform-Embedded AI Assistant

cs.HC ·2026-09-09 ·Chenchen Mao, Hanjing Shi, Haiyan Jia, Dominic DiFranzo
similarity 0.59
Abstract

Visible AI capabilities need not translate into broader judgments of trustworthiness. In a randomized 2 x 2 experiment with 270 U.S.-based Reddit users, an embedded assistant displayed one or three functions, with or without a brief rationale. Displaying three functions increased perceived multifunctionality; no other randomized main effect survived correction across the six outcomes. Rationale availability did not reliably increase perceived intelligence. Exploratory analysis indicated stronger uptake of the functional display at higher objective AI literacy. Among concurrently measured judgments, perceived multifunctionality was associated with perceived intelligence, which was associated with anthropomorphism and all three trust dimensions. After accounting for perceived intelligence, anthropomorphism was positively associated with benevolence, but not reliably with integrity or ability. These findings separate interface effects from relationships among users' perceptions and show why ability, integrity, and benevolence should be evaluated separately.

0.26

Who Trusts AI with Their Emotions? Trust Formation and Sociodemographic Variation in LLM Use for Emotional Support

cs.HC ·2026-08-21 ·Natalia Amat-Lefort, Mert Yazan, Amanda Cercas Curry, Flor Miriam Plaza-del-Arco
similarity 0.59
Abstract

Trust in AI for emotional support is not universal; it is shaped by who users are, where they come from, and what they value. Yet research in this area lacks validated psychometric instruments for assessing user perceptions in affective AI contexts and large-scale evidence on how trust formation varies across user segments. To address these gaps, we develop and validate a seven-construct psychometric scale, test a Structural Equation Model (SEM) linking system attributes to Trust and Perceived Benefits as mediators of Actual System Use, and conduct a Multi-Group Analysis (MGA) across five sociodemographic dimensions (gender, age, education, socioeconomic status, cross-national region), drawing on 1,343 active users from seven countries. We find that users experience empathy and anthropomorphism as a unified "Humanlikeness" construct, and that Privacy, Personalization, and Humanlikeness drive Trust while Perceived Bias degrades it. Notably, adoption logic diverges across groups: Privacy shapes women's trust more than men's, Anglosphere (UK, USA) users respond more positively to Humanlikeness than Europeans, and educated and higher-income users require Trust to engage, whereas older adults and lower socioeconomic groups bypass it entirely, relying on perceived practical benefits (e.g., 24/7 availability, non-judgmental support). Our findings extend technology acceptance theory and inform the equitable design of emotional support AI.

0.24

When AI Says "I Am Unable to Answer": Understanding User Responses to AI Refusals

cs.HC ·2026-09-14 ·Mahjabin Nahar, Eun-Ju Lee, Yujin Heo, Dongwon Lee
similarity 0.58
Abstract

While refusal-based safeguards to mitigate hallucinations in large language models (LLMs) are becoming increasingly common, they may conflict with users' preferences for definitive answers. However, we know little about how users respond to refusals across repeated interactions, when refusals become more or less acceptable, and for whom. In this work, we examine how refusal frequency, explanations, and need for cognitive closure (NFCC) shape responses to AI refusals. Participants (N=599) interacted with an AI system that never refused, refused infrequently, or refused frequently, with refusals either explained or unexplained. Participants were most satisfied with genuine responses, followed by hallucinations and then refusals, despite recognizing hallucinations as less accurate. Explanations increased satisfaction with infrequent, but not frequent, refusals. Higher-NFCC participants evaluated AI systems that refused more negatively. These findings reveal a tension between hallucination avoidance and user satisfaction and highlight the importance of designing balanced refusal strategies.

0.28

Human and Artificial Intelligence - Promoting Trustworthy and Understandable Collaboration

cs.HC ·2026-08-14 ·Gilbert Drzyzga
similarity 0.58
Abstract · Comments: 19 pages, dual-language (English and German)

Methods of Artificial Intelligence (AI) enable the personalization of information for individual user experiences in many domains; however, they can also conflict with established design principles, e.g., due to uncertainties regarding the real world. Building trust and understanding can serve as an approach to create a more balanced relationship between humans and AI. Building upon a pilot study, an online survey was conducted to investigate 12 individual aspects related to the topics of explainability and controllability. The results indicate that both topics, despite their different and numerous facets, are generally perceived as important by respondents; simultaneously, however, a wide dispersion of opinions is frequently observed. This could be an indication that, alongside a fundamental consensus, individual perspectives, technical knowledge and understanding, context-specific factors, or personal experiences play a role in the perception of such systems.

0.10

Affective and Functional Needs in AI Use: User Patterns and Their Relation to Real-Life Support and Well-Being

cs.HC ·2026-10-26 ·Jessy Wang-Sun, Estelle Yiyuan Sun, Hualin Zhang, Zihan Xu
published similarity 0.57
Abstract · 8 pages, 2 figures, including supplementary material. Full paper accepted at the 14th International Conference on Affective Computing and In…

Conversational AI systems are increasingly used to fulfill both functional and affective needs, yet how users perceive the AI-adoption effects varies. Existing research tends to treat these two needs as binary categories and to classify users by a single dominant need. However, this approach fails to capture users who engage with AI for both affective and functional purposes simultaneously, leaving it unclear how these needs combine in real-world AI use. To capture the multifaceted nature of users' AI engagement, we developed the AI-Support measurement with 1,090 participants, grounded in social support theory, which evaluates four dimensions of perceived AI support: emotional/esteem, social companionship, informational, and instrumental support. This study provided (1) an AI-Support Scale developed to measure the perceived support types from human-AI interaction, (2) evidence that users might adopt AI with a high level of both functional and affective use, and (3) exploratory indicators of users' real-life social support and well-being, enabling descriptive results aligning with theoretical expectations. Overall, this study highlights the importance of understanding individual differences in AI affordance use, enabling AI systems to be designed in alignment with different user adoption profiles rather than assuming uniform benefits across all users.

0.33

Available but Unclaimed: An Empirical Study of Human-AI Synergy

cs.HC cs.AI ·2026-09-15 ·Robin Welsch, Michelle Rausch, Pascal Knierim, Thomas Kosch, Jochen Kuhn +2 more
similarity 0.56
Abstract · 31 pages, including appendices

People increasingly reason with large language models (LLMs), yet complementary capabilities do not guarantee outperforming both components. In a between-subjects study, participants (N=535) solved a 40-item battery of matrix reasoning, mental rotation, syllogisms, and letter-string analogies, unaided or with GPT-5.6-Luna, Claude Opus 4.8, Gemini 3.6 Flash, or Kimi K3. Each assisted trial required consultation with the model. Each model answered every item alone 100 times under matched elicitation. The assisted-unaided accuracy difference increased with item-level LLM competence. Deference varied across tasks and increased with competence within tasks. Post-advice confidence distinguished correct from incorrect answers less strongly than unaided confidence. In a reference comparison, about half the increase in LLM accuracy carried through to assisted accuracy. How much of that accuracy gain reached participants differed across the models. These findings motivate evaluating LLMs in interaction with humans and designing support for selective deference that preserves independent reasoning.

0.27