CS Paper Radar

"It Wouldn't Have Been So Apparent to Me": Evaluating How Thought-Level Progress Tracking Supports Psychosocial Goals

Shiyu Xu, Ruishi Zou, Anna R. Van Meter, Addie Weaver, Emily Mower Provost, Daniel A. Adler

cs.HC ·submitted 2026-10-19 20:04 UTC · v1

Abstract

We pursue psychosocial goals every day, from coping with anxiety, to pursuing personal growth. While prior research has designed systems for tracking progress towards behavioral goals, fewer studies have focused on progress towards psychosocial goals - and the thinking changes people make to address them. As a first step, we present Thought-GPS, a system that visualizes potential markers of such thought-level progress in-the-moment as users interact with an AI-supported cognitive restructuring intervention. We evaluated Thought-GPS through a mixed-methods single-session study with 30 participants, comparing Thought-GPS with an active control condition without progress markers. We found preliminary evidence that participants using Thought-GPS reported greater clarity about how they might change to pursue their goals, stronger motivation to reflect on goal progress, and greater engagement in that reflection. Participants also reported that progress markers made subtle progress visible, helped them engage in deeper reflection, and connect conversational insights to their personal goals.

Closest papers

Nearest neighbours by meaning across the whole index.

Rewriting the Self: User Perceptions of AI-Mediated Cognitive Reframing

cs.HC ·2026-10-26 ·Yuewen Yang, Olzhas Yessenbayev, Anna R. Van Meter, Tanzeem Choudhury, Daniel A. Adler
similarity 0.58
Abstract · Data collected in summer 2024

Individuals are increasingly using AI for psychological support. One specific paradigm, AI-mediated cognitive reframing (AIM-CR), uses AI to automatically reframe users' negative thoughts ("I failed...") into more adaptive perspectives ("I am learning..."). While prior work suggests that AIM-CR tools reduce users' negative emotions, the complexities of AI automatically modifying users' personal narratives remain underexplored. In this work, we investigated these complexities through a mixed-methods study in which 28 participants engaged with an AIM-CR tool that reframed narratives about their stressors. Our findings suggest that participants had mixed perceptions of AIM-CR: although reframing reduced negative emotions for most participants, participants felt less ownership of, and less authenticity in, the reframed narratives. Participants perceived AIM-CR as a validating "mirror," as "another self" that could motivate or alienate them, or as an external social actor. These perceptions shaped therapeutic dynamics. We conclude by discussing design implications for future AIM-CR tools to better preserve user agency in narrative co-construction and more effectively support mental health and well-being.

0.22

Remembering Is Not Enough: Evaluating Timing and Omission in Longitudinal AI Mental Health Support

cs.CY cs.AI ·2026-11-05 ·Eli Min, Mohit Chandra, Aamogh Sawant, Mengting Tu, Freya Lin +6 more
similarity 0.56
Abstract

Evaluations of large language models (LLMs) for mental health support commonly focus on the clinical appropriateness of individual responses, potentially overlooking failures that emerge across extended interactions. As AI assistants accumulate memory of users' circumstances and prior disclosures, this raises an accountability question: Do AI chatbots provide appropriate support as users' needs evolve? We investigate by analyzing 14,256 longitudinal simulations grounded in donated chatbot histories from 22 users, examining how a memory-equipped assistant responds to suicidal ideation, self-harm, and anxiety crises across recovery trajectories and communication styles. We introduce the Context-Aware and Readiness-Evaluative (CARE) framework, developed with mental health professionals, to assess the timing and quality of advice, including omissions. Advice was less aligned with users' readiness after a crisis than in matched control stretches of the same conversation, largely because of premature recommendations, which were most common when recovery stalled. Revisiting a crisis reduced premature advice but not lagging advice, and users' communication style changed how often and when the assistant gave recommendations. Although explicitly unproductive advice was rare, the assistant frequently omitted clinician-expected support such as follow-up and planning for next steps. These findings show the limits of single response-level safety evaluation and the need to assess timing, omission, and consistency across users when holding AI systems accountable for longitudinal support.

0.07

From Momentary Emotion Inference to Sustained Emotion Support: Evaluating a Companion Agent in a Longitudinal Study

cs.HC cs.AI ·2026-09-14 ·Kexin Quan, Zijian Ding, Jiaye Yong, Qinshi Zhang, Dong Wang +1 more
similarity 0.56
Abstract

Sustained emotional support is a long-horizon interaction task closely tied to human well-being. Recent research demonstrates generative agents' capacity for momentary emotional support, yet how these capabilities sustain support over time remains unclear. To examine this challenge, we deployed PAIR, a theory-based emotion-regulation companion, with 19 participants for 14 days. Across 1,093 sessions, we paired emotion estimates with self-reports before and after guidance and analyzed logs and interviews. Estimates corresponded more closely to self-reported valence and dominance than arousal. Guided conversations were followed by higher valence and state-dependent arousal changes. Participants felt understood through contextual exploration and emotional acknowledgment, acting on guidance suited to their needs and constraints. Perceived helpfulness of guided conversation significantly increased over time. Our findings link memory updates and retained corrections to cross-session personalization, informing future emotional support tools that adapt to evolving needs, learn from prior outcomes, and preserve user control over memory.

0.16

Adapting from Downturns: Prediction of Long-Term Conversational-Skill Development in Mental-Health Crisis Counselors

cs.CL cs.AIcs.CY ·2026-09-03 ·Vivian Nguyen, Lillian Lee, Elizabeth A. Olson, Cristian Danescu-Niculescu-Mizil
top venuecode/data similarity 0.56
Abstract · To be presented at EMNLP 2026. Code available at convokit.cornell.edu

How do people learn to become better conversationalists? This question is especially important in the context of mental-health counseling, where conversational skills are essential, yet volunteer counselors often have limited access to supervision and structured feedback. Understanding how counselors develop their ability to steer conversations toward positive outcomes -- and identifying early which counselors are (not) on track to improve -- can help prioritize support for the counselors who need it most. In this work, we introduce the task of predicting, early in a conversationalist's career, whether they will eventually improve at steering conversations toward positive outcomes, and demonstrate the feasibility of this task in the case of volunteer mental-health crisis counselors. Our central insight is that people may struggle with particular kinds of moments in a conversation, and that what is especially revealing of their likelihood of future improvement is how they learn to handle those moments over time. We operationalize this insight by designing a method that identifies the types of moments a counselor initially struggles with, captures how they adapt their response when they re-encounter similar moments in subsequent conversations, and learns which early adaptations predict improvement months or even years later. While this future-prediction task is challenging, our counselor-adaptation approach yields better results than baselines that learn directly from the conversation transcript.

0.49

Steering the Compass: Aligning Dynamic Psychological Counseling Conversations with Cognitive Behavioral Therapy Strategies

cs.CL ·2026-09-17 ·Zimu Wang, Yiwen Jiang, Xiangyu Zhao, Yaling Shen, Jiahe Liu +8 more
top venuedatasetcode/data similarity 0.56
Abstract · Accepted at EMNLP 2026

Recent advancements in large language models have revolutionized the field of psychological counseling, especially in the context of Cognitive Behavioral Therapy (CBT). While the success of CBT relies heavily on dynamic decision-making informed by the client's real-time mental state, this aspect has often been overlooked in current research, limiting both flexibility and therapeutic outcomes. In this paper, we introduce StratCBT, a dataset specifically designed for psychological counseling conversations with CBT Strategies, consisting of 9,688 sessions and around 256K utterances, with each counselor's response aligned with one of eight distinct strategies. The creation of StratCBT involves modeling clients based on their negative thoughts and generating high-quality counseling conversations through self-chat, incorporating realistic sessions as guidance, thereby significantly surpassing existing datasets in both general counseling and CBT-specific skills. We conduct extensive experiments to demonstrate the effectiveness of strategy-aligned generation and evaluate its efficacy in delivering professional and effective counseling with LLM-simulated clients to reflect real-world scenarios. The dataset can be obtained from https://github.com/zimuwangnlp/StratCBT.

0.50

Open Questions Towards Skill-Sustaining Reliance in Reflective AI Engagement

cs.HC ·2026-09-23 ·Sander de Jong
similarity 0.54
Abstract

As AI systems are increasingly integrated into professional work, reflection strategies such as cognitive forcing and prompts that foster critical engagement have shown promise in reducing overreliance and improving decision quality. However, these strategies have primarily been evaluated as short-term interventions within single sessions. The next challenge is to assess whether such mechanisms sustain human agency and expertise over time. Drawing on prior work in AI-assisted decision-making, metacognition, and reflective AI engagement, we examine the challenges of designing and evaluating reflective mechanisms for long-term skill sustainability, considering individual differences in how users engage with such support, the organisational conditions under which it is implemented, and the gap between short-term evidence and long-term claims. We introduce open questions for the research community about the conditions under which reflective AI engagement can be sustained in practice.

0.14

Benefits and Barriers to Human-AI Teaming for Crisis Counseling

cs.HC cs.CY ·2026-11-16 ·Ivy Pham, Akshay Swaminathan, Sebastian Garcia, Jaimie Lim, Gloria Ye +10 more
similarity 0.54
Abstract

Background: AI systems are increasingly deployed to support mental health clinicians, yet real-world evidence remains limited. In crisis counseling, where clients often seek human connection, understanding whether AI augmentation preserves or undermines meaningful human engagement is essential. Methods: In a mixed-methods study of a counselor-facing AI copilot on a WhatsApp-based crisis hotline in India (Mar.-Oct. 2025), counselors could request, edit, and send AI messages. We analyzed 20 interviews, 8 shadowing sessions, 56 survey responses, and edits in 27,778 copilot messages from 108 counselors via thematic analysis (Technology Acceptance Model 2, plus inductive coding of emergent factors), and survey statistics. Results: Counselors reported high copilot acceptance (survey): 98.2% found it helpful; 89.3% likely to continue use; 80.4% reported efficiency gains. Interviews highlighted sentence scaffolding, empathetic phrasing, stress reduction, catching missed details, and efficiency. Barriers (survey) included repetitive outputs (23.2%), lack of context (17.9%), and authenticity concerns (10.7%). While 69.6% (survey) reported skill enhancement, interviews surfaced skill atrophy concerns. Counselors frequently accepted copilot suggestions, editing to remove questions, adjust tone, or personalize style. Conclusion: In one of the largest real-world deployments of a counselor-facing mental health AI copilot, counselors reported reduced cognitive load, empathetic communication, and greater efficiency, alongside concerns about skill atrophy, authenticity, and over-reliance. In settings like crisis counseling where clients seek human connection, AI tools must balance operational support with preserving clinical skill and genuine therapeutic engagement. Designs soliciting approval or editing of complete drafts may overweight efficiency at the expense of sustained human engagement.

0.32

The First Few Tokens Matter: Understanding Chain-of-Thought Controllability

cs.AI ·2026-10-29 ·Hugh Van Deventer, Dmitrii Troitskii, Laura Ruis
similarity 0.54
Abstract · 20 pages, 15 figures

Chain-of-thought (CoT) monitoring is a promising way to oversee increasingly capable agents. It succeeds in part because current models appear limited in their ability to control what they verbalize in their reasoning traces. We investigate the source of this limitation and link it to an entropy collapse in the first few tokens following the opening thinking tag. We exploit this mechanism to recover CoT controllability through two inference-time interventions on initial tokens: prefilling, where even a single token can substantially increase controllability, and banning frequent opening tokens combined with in-context examples, which improves average compliance by 34-41 percentage points across models. These interventions recover mainly addition and style controllability (adding or transforming information), while suppression controllability (avoiding or removing information) exhibits more varied responses, suggesting distinct underlying mechanisms. Consistent with this, the two groups behave as separate capabilities: across models, performance correlates positively within these groups, while cross-group correlations are mostly negative. Importantly, we find that the relationship with monitorability depends on the evaluation: addition and style controllability more consistently positively correlate with monitorability, while suppression often shows negative associations. Our findings motivate the development of controllability evaluations that distinguish difficulty initiating a specific opening from general limitations of the ability to alter reasoning content, alongside separate reporting of control tasks and categories.

0.13