CS Paper Radar

When2Talk: When Should a Proactive In-Car Agent Talk?

Kaiser Hamid, Peihang Li, Nade Liang

cs.HC cs.CV ·submitted 2026-09-11 07:08 UTC · v1

Abstract

Proactive in-cabin agents can help passengers understand automated-vehicle (AV) behavior, but communicating every ride event may introduce unnecessary interruptions. We investigated how communication should adapt to event priority and passenger activity. In a mixed-methods within-subject study, 41 participants rode as passenger in a VR simulated fully-automated vehicle. We compared an event-triggered (ET) policy that communicated immediately at every event with a context-sensitive (CS) policy that selected \textit{Immediate}, \textit{Delayed}, or \textit{Silent} communications. CS increased communication appropriateness and substantially reduced perceived interruption. Perceived trust did not differ between policies, although baselines dispositional trust differentiated communication preferences. Findings highlight event consequence, passenger activity, continuing information value, and confirmation need as key considerations for selective in-cabin communication.

Closest papers

Nearest neighbours by meaning across the whole index.

Perceived Agency During Agent-Avatar Control Transitions in Virtual Reality

cs.HC cs.AI ·2026-11-09 ·Jingyi Zhang, Ruijun Sun, Klara Brandstatter, Nels Numan, Anthony Steed
similarity 0.61
Abstract

Prior beliefs about whether a virtual human (VH) is controlled by a human or a computer can shape how users interpret and respond to its behaviour. As emerging hybrid VH systems allow control to transfer between human operators and computer programs during an ongoing interaction, it remains unclear whether perceived agency updates with the actual controller or continues to reflect users' prior beliefs and first impressions. We investigated this question in a within-subject VR study with 24 participants across four conditions: always computer-controlled, computer-to-human, human-to-computer, and always human-controlled. We designed an interaction task in which participants acted as interviewers, asking the VHs a fixed set of questions. Before each interaction, participants were informed whether the VH was human- or computer-controlled, matching the actual controller at the beginning, but were unaware of possible control transitions. We found that perceived agency was strongly influenced by the controller presented at the beginning of the interaction, with no evidence of updating following the control transitions. Social evaluations including likeability and co-presence were generally higher in conditions where human control occurred later and covered a greater proportion of the interaction. The results suggest that prior beliefs and first impressions continued to shape perceived agency, whereas social evaluations were more sensitive to the VH's actual behaviour over the interaction.

0.10

Human-Aware Agentic Driving: Rethinking Driver State, Trust, and Intervention

cs.HC ·2026-10-24 ·Lu Feng
similarity 0.59
Abstract

Agentic driving brings goal-directed reasoning, memory, tools, and adaptive interaction into automated vehicles. A vehicle can clarify a request, explain a maneuver, or prepare a driver to take control, then adapt its next action to the response. These capabilities make the vehicle an active participant in shaping the human behavior it observes. We examine how agentic interaction affects driver-state inference, trust and reliance, and human intervention in conditional automation. Established findings on attention, takeover prediction, trust-aware planning, and adaptive warnings provide useful foundations, but their applicability depends on how observations are elicited and how assistance changes the driving task. We distinguish what remains applicable, what changes under flexible interaction, and what remains unresolved across these three areas. The analysis identifies three research priorities: establishing the effects of interventions, jointly designing interaction and driving policies, and maintaining useful adaptation across repeated use and system changes. Progress should be measured through driver comprehension, appropriate reliance, and the ability to perform the required driving action in time.

0.23

User Experience in Human-Machine Interaction: Insights from Field Studies in Autonomous Mobility

cs.HC ·2026-08-31 ·Helen Schneider, Svetlana Pavlitska, J. Marius Zöllner
published similarity 0.57
Abstract · Accepted for publication at ABAW Workshop at ECCV2026

Autonomous vehicles (AVs) promise safer, cleaner, and more inclusive mobility, yet large-scale adoption is hindered by user acceptance rather than by technical challenges. Prior studies on acceptance and user experience largely rely on surveys, simulators or Wizard-of-Oz setups, often over-representing technologically enthusiastic participants and focusing on drivers instead of passengers. We address this gap with real-world field studies with AVs in real traffic, totaling 144 participants. Using multi-modal sensing, we evaluated EGG, heartbeat, breathing, camera and voice signals for affect inference in combination with vehicle data. Our results show that breathing, camera and voice measurements are reliable and pratical in naturalistic passenger contexts. We further contribute a validated study protocol, a self-assessment app for real-time assessment during human-machine interaction, and a tailored questionnaire to capture participant attitudes towards AVs. By grounding UX evaluation in real-world contexts, this work lays a foundation for user-centered design of autonomous mobility systems and robotics in general. Our work bridges the gap between affective computing and technical implementation of autonomous vehicles.

0.14

Sensed but Not Told: Hidden Physiological Adaptation Shapes LLM Persuasion

cs.HC ·2026-11-06 ·Xiaoyan Wei, Yutong Qu, Yutong Li, Haiyi Li, Wei Emma Zhang +1 more
similarity 0.56
Abstract · 15 pages, 5 figures

Wearable sensors, including those embedded in VR headsets, can provide LLM-based chatbots with physiological signals that users do not explicitly communicate. We tested whether such hidden input changes persuasion. In a $2\times2$ within-subjects study ($N=24$), a chatbot argued against participants' self-selected opinions with or without turn-level heart-rate and pupil-diameter features; sensing was disclosed halfway through the study. Before disclosure, sensing increased perceived persuasiveness by 1.42 points. Across the study, sensing was associated with a 0.57-point greater shift toward the chatbot's position and 3.20 times the odds of any movement toward it. Persuasiveness ratings were lower after disclosure, although disclosure was confounded with session order. Dialogue logs suggested a more declarative interaction style when sensing was on: chatbot replies contained question marks less often, and conversations contained fewer turns. These findings motivate making biosignal-driven adaptation inspectable and providing a genuinely non-sensed mode.

0.30

User Perceptions of Deceptive In-Vehicle Infotainment User Interfaces

cs.CR ·2026-11-18 ·Pedram MohajerAnsari, Iwinosa Aideyan, Anna Galeano, Arjun Arunasalam, Bart Knijnenburg +2 more
top venue similarity 0.54
Abstract · Accepted to the Network and Distributed System Security (NDSS) Symposium 2027

Modern vehicles collect extensive data about drivers, passengers, and vehicle use, with privacy and consent decisions increasingly mediated through infotainment software. Although dark patterns have been widely studied in web, mobile, and e-commerce interfaces, little is known about how they appear in automotive infotainment systems or how users perceive them. We study this problem through Android Automotive OS (AAOS), conducting a three-phase empirical analysis. First, 26 HCI and privacy annotators audit four OEM AAOS emulators (Honda, Volvo, GM, and Polestar), documenting 17 dark-pattern types across 65 observations. Second, a user study with 100 participants compares OEM-specific implementations of five dark patterns across GMC, Honda, and Volvo, finding that implementation choices affect user perceptions. Third, an independent study with 49 participants compares automotive and e-commerce dark-pattern clips before and after a brief tutorial, showing that automotive's initial rating advantage largely collapses after instruction. Together, the studies identify a sophistication paradox: subtler dark patterns are less likely to trigger user suspicion and may therefore be harder to identify. These findings indicate that oversight should evaluate not just the presence but also the specific implementation of dark patterns.

0.61

When the Environment Becomes the Interface: Multisensory Environmental Interfaces for Human-AI Interaction in Autonomous Vehicles

cs.HC ·2026-09-26 ·Keqi Chen, Runjia Tan, Xinyi Fu, Shanhe Lou, Kwan Min Lee +1 more
similarity 0.54
Abstract

As AI increasingly assumes operational control, human-computer interaction is shifting from operating systems through explicit interfaces to inhabiting intelligent environments. This raises a fundamental question: when users no longer directly manipulate a system, what mediates their relationship with intelligent technologies? We introduce environmental interfaces: designed environmental conditions that shape human-AI relationships through ambient, holistic, and evaluative pathways rather than explicit functional interaction. Using autonomous vehicle cabins as a revealing context, we conducted a within-subject experiment with 24 participants (216 observations), manipulating lighting and scent in a simulated autonomous driving environment. Three findings emerged. First, perceived atmosphere accounted for 66.5% of the variance in overall journey experience, showing that environmental conditions can function as an interface rather than merely a supporting design element. Second, multisensory processing followed a hierarchical architecture: individual sensory appraisals were initially independent, while cross-modal integration emerged during higher-order environmental evaluation. Third, olfactory stimuli influenced affective responses and experience evaluation more strongly than visual stimuli, challenging the visual dominance of automotive interaction design. Environmental quality and sensory congruency also predicted trust in the autonomous system, suggesting that passengers may use environmental cues as proxy signals when direct assessment of AI competence is difficult. These findings establish environmental interfaces as a distinct interaction modality and point to a broader transition from designing interfaces for operating intelligent systems to designing environments for inhabiting them.

0.30

A revised framework for the assessment of psychological safety in autonomous vehicles

cs.HC ·2026-08-19 ·Yandika Sirgabsou, Benjamin Hardin, François Leblanc, Efi Raili, David Jackson +3 more
similarity 0.53
Abstract

Despite recent technological progress in the development of autonomous vehicles (AVs), their societal acceptability remains a subject of debate as recent research findings point to psychological roadblocks. Concerns arise not only for physical safety but also for potential psychological risks resulting from human interaction with AVs. Psychological concepts such as trust, and perceived safety are well-studied in this context and are found to be determinant factors for the intention to use AVs. Unfortunately, there has been no formalization of the mechanism by which human interaction with AVs may lead to psychological hazards, threatening trust, perceived safety, and acceptability. Furthermore, there has been little prior research that conceptualizes the severity of psychological risk in AVs, and there are no clear guidelines for a systems designer on how to assess and address psychological risk in the AV development context. To address these limitations, this paper extends a theoretical framework for AV psychological safety risk assessment based on an early proposal. The proposed framework consists of an extended risk model for psychological safety including all the key concepts related to psychological safety in AVs, and an assessment method based on the Systems-Theoretic Accident Model and Processes (STAMP). We demonstrate the usefulness of the theoretical framework through a highly automated AV use case scenario, uncovering factors which may lead to psychological risk for an occupant. The use cases provide examples of how to use the framework to extensively evaluate psychological risk and determine vehicle behaviour that could lead to this risk. By developing a theoretical framework for AV psychological safety risk assessment, we provide a foundation and a method that were previously lacking to better enable responsible AV development regarding psychological safety.

0.37

Acceptance and Responsibility Attribution Toward Autonomous Ambulances Across Driving Conditions: A Preliminary Survey of Fire Service Personnel

cs.HC cs.CY ·2026-10-31 ·Hirotake Yamazoe, Shingo Yamaguchi
survey similarity 0.53
Abstract · The 2nd International Workshop on Trust and Blame in Multi-Person Multi-Agent Societies (TBSA_2nd) in conjunction with HAI 2026, 6 pages, 2 …

Traffic incidents involving ambulances and fire engines during emergency-response driving can have serious consequences. Although autonomous driving technologies may reduce workload and improve safety, their introduction into emergency services requires consideration of first responders' trust, willingness to ride (WTR), and perceptions of responsibility. We surveyed 34 fire service personnel from a single fire station in Himeji, Japan, to examine their evaluations of autonomous ambulances and responsibility attribution under non-emergency and emergency driving conditions. Emergency driving was associated with lower perceived usefulness for improving safety, trust, and WTR, as well as greater anxiety. In contrast, responsibility attribution remained largely stable, with 30 participants ($88.2\%$) selecting the same primary responsible party across conditions and the onboard crew most frequently selected in both. Among these 30 participants, 26 ($86.7\%$) also assigned the same responsibility share. Open-ended responses revealed concerns about system reliability, the complexity of emergency driving, and the need for human judgment, as well as considerations regarding operator and organizational responsibility. These findings suggest that acceptance of autonomous ambulances is sensitive to driving conditions, while responsibility judgments may also reflect perceived professional roles and responsibilities.

0.21