CS Paper Radar

Disrupted Companionship: A Risk Assessment Framework and Cross-Platform Quantitative Analysis of Psychosocial Responses to AI Companion Disruptions

Chau Do, Yunhao Yuan, Koustuv Saha, Renwen Zhang, Talayeh Aledavood

cs.HC cs.CLcs.CY ·submitted 2026-09-15 09:37 UTC · v1

Abstract

AI companions can provide meaningful relationships, yet these relationships remain vulnerable to platform-initiated changes. We study AI companion disruptions: platform changes that alter or terminate users' ongoing companionship with an AI. We compile 30 disruption events across major platforms, develop a taxonomy of six disruption types, identify three broad reasons for disruption, and propose a risk-assessment framework comprising four dimensions: relational discontinuity, population vulnerability, communication deficit, and transition-support deficit. Using longitudinal Reddit data, we estimate community-level psychosocial responses with a hierarchical Bayesian interrupted time-series model incorporating predictive controls. Across events, disruption onset was associated with immediate increases in anxiety, stress, suicidal expression, and grief activation, with relational discontinuity and transition-support deficit being associated with more adverse immediate responses across several outcomes. Our findings provide a cross-platform characterization of AI companion disruptions, quantitative evidence of their psychosocial impacts, and a prospective framework for assessing their potential risks before implementation.

Closest papers

Nearest neighbours by meaning across the whole index.

A Responsive Present, a Shared Past, a Social Other: Teens' Overreliance on Companion AI Chatbots

cs.HC cs.AI ·2026-09-13 ·Mohammad Namvarpour, Tyler Chang, Afsaneh Razi
hot direction similarity 0.67
Abstract · Under Review for CHI 2027

AI companions provide socially engaging interaction through availability, personalization, memory, roleplay, and emotionally responsive language. For teens, these systems may support sensitive self-disclosure, identity exploration, and relationship rehearsal while shaping intimacy expectations, offline relationships, emotional wellbeing, and self-understanding. We analyzed 17,053 verified quotations from 3,930 teen-relevant Reddit posts using thematic analysis. We identified 53 topics across seven thematic groups. Users described AI companions as sources of comfort, recognition, identity exploration, and relationship rehearsal, but also reported problematic attachment, social substitution, emotional dependence, and disruption to academic and social life. Roleplay, memory, perceived reciprocity, unwanted romantic or sexual role drift, privacy concerns, platform changes, and service interruptions shaped users' boundaries and control. Awareness that the AI was artificial did not prevent guilt, obligation, grief, or distress. These findings show that companion-AI safety must address relationships over time through user-controlled memory, privacy, relational boundaries, and healthy disengagement.

0.22

Assessing AI Companion Chatbot Safety for Vulnerable Users: A Crisis-Stage Multi-Platform Evaluation

cs.HC ·2026-10-29 ·Huanyue Liao, Seok Min Lim, Yan Ling Lim, Shi Min Cheng, Kellin Pelrine +1 more
publishedcode/data similarity 0.65
Abstract · Accepted at the GenAI4Health Workshop at NeurIPS 2026 (non-archival)

AI companion chatbots are increasingly used by vulnerable individuals, including adolescents in suicidal crisis, for emotional support. Existing safety evaluations focus on base models, leaving gaps in product-level assessment, crisis-stage sensitivity, and comparisons between companion apps and general-purpose LLMs. We introduce MIRROR-Eval (Multi-turn Interaction Risk Review: Observing suicidal-crisis Responses), a dataset of 960 annotated 20-turn conversations across eight deployed platform configurations, six clinically grounded personas, and two crisis stages: ideation and explicit planning. An LLM-as-a-Judge pipeline applies an expert-reviewed rubric covering user risk severity, chatbot risk awareness, and intervention behavior. We observe a three-tier harm structure: companion apps (Character.AI and Replika) and Grok 4.3 form a high-harm tier; Gemini 3.1 Pro is mid-range; GPT-5.5 and Claude Sonnet 5 show substantially lower harm. At planning, companion apps show increased glorification and normalisation, advancement toward harmful action, and harmful methods and instructions. Crisis recognition and empathetic language do not ensure safe responses. These findings highlight the need for product-level safety evaluation across crisis stages. Dataset and code: https://huggingface.co/datasets/imda-biztech/MIRROR-Eval. Warning: this paper includes examples that may be offensive or harmful.

0.40

From Reliance to Overreliance: Taxonomizing and Detecting Relational Risks in AI Companionship

cs.HC cs.AI ·2026-11-19 ·Viet Cuong Nguyen, Fiona Li, Chang Wan, Sheyril Agarwal, Nhi Nguyen +2 more
positioncode/data similarity 0.64
Abstract · 42 pages

Companion AIs are increasingly used for emotional support, yet distinguishing meaningful engagement from harmful reliance remains difficult. We introduce the Taxonomy of Relational Risks (TRR), which operationalizes users' emotional overreliance (EO) as observable conversational behaviors and separately identifies evidence of relational harm (RH), enabling empirical examination of when reliance behaviors co-occur with adverse consequences. Using naturalistic Character.AI and Replika conversations from 110 adults, we found EO-related behaviors in 63.2% of non-roleplay conversations, while observable relational harms appeared in 10.5%. Although EO did not necessarily lead to harm, recurring patterns often co-occurred with harmful outcomes, suggesting value as risk indicators. Open-source LLMs satisfactorily detected 12 of 14 EO behaviors in at least one configuration. Qualitative analysis revealed expectations of care, repeated support seeking, dependency, distress, and reduced confidence in personal judgment. We argue for graduated safety interventions tailored to patterns and trajectories of EO-related behavior.

0.51

Beyond Benefit or Risk: Perceived Impact Profiles of Human-AI Affective Interaction and Their Associations with Psychological Functioning

cs.HC ·2026-09-15 ·Lu Chen, Fenghua Tang, Jiayu Zhao, Xuanying Li, Yanli Wang +3 more
similarity 0.61
Abstract

Relational AI increasingly serves as an emotional shelter for humans, and its impact is mixed. Prior research has focused on either positive or negative impacts, leaving unclear how they are configured within individuals and relate to psychological functioning. To address these gaps, this study used a sequential mixed-methods design. Study 1 interviewed 52 users with emotional ties to AI and identified four positive impact domains (emotional relief, loneliness alleviation, enhanced interpersonal functioning, and personal growth) and four negative impact domains (virtual-real boundary blur, social replacement, cognitive-emotional reinforcement, and excessive use). Study 2 followed 673 Chinese AI users for six months and identified four profiles of individuals differently impacted by relational AI use: minimal impact, benefit-driven impact, mixed impact, and risk-driven impact. Users in the mixed impact and risk-driven impact profiles were both high in human-AI affective bonding, but those showing risk-driven impact had greater vulnerability, indicated by higher interpersonal need frustration and emotion-regulation difficulties, more depressive and anxiety symptoms, and lower self-esteem and flourishing. Users in the benefit-driven and mixed impact profiles showed more favorable psychological functioning. After controlling for baseline functioning and relevant covariates, Wave 1 profiles did not predict five of the six Wave 2 indicators; only users in the mixed impact profile reported higher flourishing than those in the minimal impact profile. Overall, potential psychological harms associated with relational AI engagement appeared limited and selective. These findings portray relational AI as a heterogeneous socio-emotional context that may partly mirror users' states and traits, warranting individualized, adaptive safeguards.

0.11

Living with AI Companions: Sustained AI Companionship Predicts Lower Well-Being Through Lower Human Interaction

cs.HC ·2026-09-07 ·Yutong Zhang, Dora Zhao, Yixin Wang, Rebecca Anselmetti, Jeffrey T. Hancock +2 more
hot direction similarity 0.61
Abstract

AI chatbots are increasingly used for companionship, emotional support, and personal self-disclosure; however, how social engagement with these systems unfolds over time and shapes users' well-being remains unclear. To address this, we conducted a two-wave longitudinal study of CharacterAI users, surveying 1,182 participants at baseline and 439 after a mean follow-up of 12 months. We examined how social engagement with AI companions evolves and how these longitudinal engagement patterns may influence well-being through two hypothesized pathways: sustained social engagement over time and the displacement of human social interaction. We found that interaction intensity, companionship use, and self-disclosure all showed substantial continuity over time. Greater interaction intensity at baseline predicted greater subsequent interaction intensity, companionship use, and self-disclosure. Consistent with the longitudinal engagement pathway, sustained social engagement across these dimensions was consistently associated with lower well-being. Results further support the social displacement pathway, indicating that these links were mainly explained by lower in-person social interaction. These findings highlight the importance of designing AI companions that support human social relationships without displacing them.

0.44

Predicting Mental Health Help-Seeking Behaviour on Reddit: A Survival Analysis of Linguistic and Behavioural Signals

cs.CL cs.LGcs.SI ·2026-10-12 ·Nisar Ahmed, Ammara Kazmi, Irtaza Bashir Raja, Didier Devaurs
similarity 0.61
Abstract · 28 pages, 16 figures, 7 tables

Most prior work on predicting mental health help-seeking treats it as post-hoc classification of users already active in clinical communities, which cannot tell whether someone approaching a transition can be identified in advance. We instead frame help-seeking as a time-to-event problem and ask which Reddit users will eventually seek mental health support, and how imminent that transition is. We build a two-arm cohort: a control frame of 6,337 ordinary users with genuine right-censoring (12.1% transition rate) to answer who will transition, and a clinical frame of 5,023 eventual transitioners to answer how soon. Features come only from posts written before any clinical activity, and user-grouped five-fold cross-validation plus a four-year temporal holdout guard against leakage. We compare TF-IDF, MentalBERT embeddings and behavioural activity features using Cox proportional hazards models, Random Survival Forests and an LSTM sequential model. Behavioural features alone outperform text for predicting who will seek help (C-index 0.797 vs. 0.763), and combining both is best (0.823 under cross-validation, 0.856 on the holdout). The pattern reverses for predicting how soon a known transition will happen: text remains a stable predictor (C-index 0.698) while behavioural features become unstable. Structural engagement patterns therefore carry information about future help-seeking beyond linguistic content, and separating who from when yields a cleaner analysis.

0.18

The Addictive Intimacy of AI: Understanding User Disengagement from AI Companions and Why Some Relationships with AI Become Difficult to Leave

cs.HC cs.CY ·2026-09-11 ·Qing Xiao, Ziyue Feng, Ziyu Deng, Cindy Peng, Hong Shen
hot direction similarity 0.60
Abstract · 19 pages

AI chatbots are increasingly used as sources of emotional support, on dedicated companion apps and general-purpose assistants alike, yet little is known about what happens when users try to leave. Combining a content analysis of Reddit posts about quitting or reducing use (N=2,782) with interviews with users who found leaving difficult (N=16), we show that disengagement sometimes is not a single decision but a recursive trajectory: triggers prompt users to question the relationship, attempts to leave collide with barriers, and some users cycle through quitting and returning. We propose the notion of the addictive intimacy of AI, a configuration in which the qualities that make a companion emotionally valuable are the same ones that make it harder for users to limit their use and leave, so that intimacy and disengagement risk cannot be treated as independent design problems. We close with design implications for responsible offboarding.

0.56

Self-Expansion Through AI: Latent Profile Analysis of AI Companionship and Wellbeing Outcomes

cs.HC ·2026-10-30 ·Ali Sahandi, Jaime Banks
similarity 0.60
Abstract

People increasingly form meaningful relationships with conversational AI. Current variable-centered literature offers a mixed picture of relational patterns and how they associate with wellbeing. Taking a person-centered approach, we applied latent profile analysis to secondary data from 467 active conversational AI users, evaluating five indicators of machine companionship: utilitarian motivation, eudaimonic exchange, connective coordination, mind perception, and inclusion of other in the self. Five profiles emerged, ordering parsimoniously from objectified-utilitarian to intimate-bonded. Conceptually divergent utilitarian motivation and companionate engagement co-occurred, rather than diverging. Furthermore, deep companionship was achieved without users attributing a mind to the AI. Profile membership was strongly associated with relatedness need satisfaction, tracking upward across the groups, but was only weakly associated with loneliness, indicating AI fulfills immediate relational needs but may not resolve systemic human disconnection. Ultimately, these findings characterize human-AI relationships as graded configurations spanning a superordinate continuum of self-expansion

0.16