CS Paper Radar

A revised framework for the assessment of psychological safety in autonomous vehicles

Yandika Sirgabsou, Benjamin Hardin, François Leblanc, Efi Raili, David Jackson, Pericle Salvini, Lars Kunze, Marina Jirotka

cs.HC ·submitted 2026-08-19 10:57 UTC · v1

Abstract

Despite recent technological progress in the development of autonomous vehicles (AVs), their societal acceptability remains a subject of debate as recent research findings point to psychological roadblocks. Concerns arise not only for physical safety but also for potential psychological risks resulting from human interaction with AVs. Psychological concepts such as trust, and perceived safety are well-studied in this context and are found to be determinant factors for the intention to use AVs. Unfortunately, there has been no formalization of the mechanism by which human interaction with AVs may lead to psychological hazards, threatening trust, perceived safety, and acceptability. Furthermore, there has been little prior research that conceptualizes the severity of psychological risk in AVs, and there are no clear guidelines for a systems designer on how to assess and address psychological risk in the AV development context. To address these limitations, this paper extends a theoretical framework for AV psychological safety risk assessment based on an early proposal. The proposed framework consists of an extended risk model for psychological safety including all the key concepts related to psychological safety in AVs, and an assessment method based on the Systems-Theoretic Accident Model and Processes (STAMP). We demonstrate the usefulness of the theoretical framework through a highly automated AV use case scenario, uncovering factors which may lead to psychological risk for an occupant. The use cases provide examples of how to use the framework to extensively evaluate psychological risk and determine vehicle behaviour that could lead to this risk. By developing a theoretical framework for AV psychological safety risk assessment, we provide a foundation and a method that were previously lacking to better enable responsible AV development regarding psychological safety.

Closest papers

Nearest neighbours by meaning across the whole index.

Engineering Psychological Safety in Autonomous Vehicles: A Systems-Theoretic Framework for Psychological Safety in Autonomous Vehicles and its Validation in Real-World Scenarios

cs.HC cs.RO ·2026-08-19 ·Yandika Sirgabsou, Benjamin Hardin, François Leblanc, Efi Raili, David Jackson +3 more
similarity 0.94
Abstract

Despite rapid technological advances, the societal acceptability of autonomous vehicles (AVs) remains limited by psychological barriers that extend beyond traditional concerns of physical safety. While factors such as trust and perceived safety are known to influence user acceptance, there is a lack of formalized mechanisms and engineering methods to systematically identify, assess, and mitigate psychological risks arising from human-AV interactions. To address this gap, this work proposes and validates a systems-theoretic framework for the assessment of psychological safety in autonomous vehicles. First, a comprehensive psychological safety risk model is defined, extending the Systems-Theoretic Accident Model and Processes (STAMP) to incorporate key psychological constructs such as trust, perceived control, predictability, and perceived support. Based on this model, a hazard analysis method (AV-PsySafe) is developed to systematically identify psychological hazards, unsafe control actions, and loss scenarios, while introducing a Psychological Safety Integrity Level (PsySIL) to support risk prioritization. Second, the applicability and relevance of the framework are evaluated through its deployment in realistic autonomous vehicle scenarios. A structured validation approach is implemented, including a methodological guide, standardized analysis templates, and the collection of analyst feedback. The results demonstrate that the framework can be consistently applied by practitioners, producing meaningful insights into psychological risks. Overall, this work establishes both the theoretical foundations and practical feasibility of a unified approach to co-assessing psychological and physical safety in autonomous systems, contributing to more human-centred and trustworthy AV development.

0.34

Behavioral Safety Assessment towards Large-scale Deployment of Autonomous Vehicles, Part I: Methodology

cs.RO ·2026-10-06 ·Henry X. Liu, Tinghan Wang, Xintao Yan, Haowei Sun, Zhijie Qiao +4 more
code/datahighly cited similarity 0.69
Abstract

Autonomous vehicles (AVs) have significantly advanced in real-world deployment in recent years, yet safety continues to be a critical barrier to widespread adoption. Traditional functional safety approaches, which primarily verify the reliability, robustness, and adequacy of AV hardware and software systems from a vehicle-centric perspective, do not sufficiently address the AV's broader interactions and behavioral impact on the surrounding traffic environment. To overcome this limitation, we propose a paradigm shift toward behavioral safety, a comprehensive approach focused on evaluating AV responses and interactions within the traffic environment. To systematically assess behavioral safety, we introduce a third-party AV safety assessment framework comprising two complementary evaluation components: the Behavioral Competency Test and the Driving Intelligence Test. The Behavioral Competency Test evaluates the AV's reactive behaviors under controlled scenarios, ensuring basic behavioral competency. In contrast, the Driving Intelligence Test assesses the AV's interactive behaviors within naturalistic traffic conditions, quantifying the frequency of safety-critical events to deliver statistically meaningful safety metrics before large-scale deployment. In Part II of this study, an open-source Level 4 Automated Driving System (ADS) is tested to demonstrate the effectiveness of the proposed method.

0.46

Behavioral Safety Assessment towards Large-scale Deployment of Autonomous Vehicles, Part II: Assessment Results

cs.RO ·2026-10-06 ·Henry X. Liu, Tinghan Wang, Xintao Yan, Haowei Sun, Zhijie Qiao +4 more
code/data similarity 0.67
Abstract

Third-party evaluations of autonomous vehicle (AV) safety can play a vital role in improving public acceptance, building consumer confidence, and establishing effective safety standards. In Part I of this study, we propose a dedicated third-party testing initiative for systematically evaluating AV behavioral safety. In this paper, we validate our proposed framework using Autoware.Universe, an open-source Level 4 Automated Driving System (ADS), tested both in simulated environments and on the physical test track at the University of Michigan's Mcity Testing Facility. The results indicate that Autoware.Universe possesses 6 out of 14 behavioral competencies and exhibited a crash rate of 3.01x10^-3 crashes per mile, approximately 1,000 times higher than the average human driver crash rate. During the tests, we also uncovered a number of unknown unsafe scenarios for Autoware.Universe. These findings underscore the necessity of behavioral safety evaluations for improving AV safety performance prior to widespread public deployment.

0.60

Acceptance and Responsibility Attribution Toward Autonomous Ambulances Across Driving Conditions: A Preliminary Survey of Fire Service Personnel

cs.HC cs.CY ·2026-10-31 ·Hirotake Yamazoe, Shingo Yamaguchi
survey similarity 0.64
Abstract · The 2nd International Workshop on Trust and Blame in Multi-Person Multi-Agent Societies (TBSA_2nd) in conjunction with HAI 2026, 6 pages, 2 …

Traffic incidents involving ambulances and fire engines during emergency-response driving can have serious consequences. Although autonomous driving technologies may reduce workload and improve safety, their introduction into emergency services requires consideration of first responders' trust, willingness to ride (WTR), and perceptions of responsibility. We surveyed 34 fire service personnel from a single fire station in Himeji, Japan, to examine their evaluations of autonomous ambulances and responsibility attribution under non-emergency and emergency driving conditions. Emergency driving was associated with lower perceived usefulness for improving safety, trust, and WTR, as well as greater anxiety. In contrast, responsibility attribution remained largely stable, with 30 participants ($88.2\%$) selecting the same primary responsible party across conditions and the onboard crew most frequently selected in both. Among these 30 participants, 26 ($86.7\%$) also assigned the same responsibility share. Open-ended responses revealed concerns about system reliability, the complexity of emergency driving, and the need for human judgment, as well as considerations regarding operator and organizational responsibility. These findings suggest that acceptance of autonomous ambulances is sensitive to driving conditions, while responsibility judgments may also reflect perceived professional roles and responsibilities.

0.21

Occlusion-induced risk and interventions in pedestrian-autonomous truck interactions on multi-lane roads: A virtual reality study

cs.HC ·2026-08-30 ·Yun Ye, Yuan Che, S. C. Wong, Stergios-Aristoteles Mitoulis, Haoyang Liang
similarity 0.59
Abstract

Autonomous trucks (ATs) may introduce distinct pedestrian-safety risks because of their large physical dimensions, constrained braking capability, limited driver-based communication cues, and potential to occlude surrounding traffic. This study employed a controlled virtual reality experiment with 54 participants to investigate pedestrian-AT interaction risk in an unsignalized multi-lane crossing scenario and to evaluate occlusion-targeted risk mitigation strategies. The experiment examined the effects of near-side vehicle type, weather condition, and far-side vehicle yielding strategy on pedestrian behavior, perceived risk, and objective safety. Based on a representative high-risk scenario, three targeted interventions were designed and tested: an environment-aware external human-machine interface (eHMI), a projected eHMI, and an auditory warning. The results showed that ATs increased perceived risk and encouraged more cautious crossing behavior, suggesting a risk-compensation effect. However, this compensation was weakened under rainy conditions, where braking-related safety margins were reduced. AT-induced occlusion further increased far-side interaction risk by limiting pedestrians' recognition of hidden vehicles. Among the three interventions, the projected eHMI showed the best overall performance, improving objective safety margins, enhancing risk awareness, and supporting behavioral adjustment. These findings highlight the need for AT-specific interface and warning strategies that address both intention communication and risk localization.

0.23

Understanding Operator Attitudes Toward AI-Supported Decision Making in Maritime Operations

cs.HC cs.AI ·2026-09-10 ·Doreen Jirak, Armeen Saroukanoff, Dirk van Rooy
surveyhot direction similarity 0.56
Abstract · 11 figures

Maritime Autonomous Surface Ships (MASS) and AI- supported decision assistants are expected to transform maritime operations, but their safe integration depends on how maritime professionals perceive and trust such systems. This paper presents a survey study on maritime stakeholders' attitudes toward an AI-supported assistant in collision-avoidance scenarios. Participants evaluated technology anxiety, trust in automation, and explanation quality using established and adapted questionnaires, complemented by sentiment and thematic analysis of open-ended responses Results indicate a generally positive disposition toward maritime technology, no clear age-related differences in openness, stable trust across scenarios, and more scenario-sensitive, multidimensional explanation ratings. Open responses showed that participants valued support for decision-making, situation awareness, and confidence-building, while raising concerns about AI reliability, over- reliance and loss of expertise. The findings suggest that maritime AI systems should not focus solely on increasing automation or trust, but on supporting calibrated reliance through transparent, reliable, and operationally meaningful design with domain experts in the loop.

0.27

Understanding as an Explicit and Assessable Component of Frontier AI Safety Decisions

cs.CY ·2026-08-20 ·Stephen Barrett, Robin Bloomfield, Alexandra Chirilă, Mamoon Masud, David Meredith Hardy +1 more
similarity 0.56
Abstract · Changed first line of abstract

Decision makers need sufficient understanding to make good decisions about training or deploying frontier AI systems. However, such decisions are increasingly made under time-pressure, and this combined with the use of AI generated artefact creation, can mean that the existence of safety cases and system cards may no longer demonstrate that sufficient understanding exists. Our provisional methodology for making understanding explicit and assessable requires the production of an explicit description of 4 objects of understanding (decision, decision-frame, safety justification, system-in-context) and a justification for the adequacy of this understanding. In addition, the methodology provides a mechanism for describing and evaluating the adequacy of the decision-maker representation of this understanding. It builds on recent developments in safety cases using the Assurance 2.0 framework to operationalise the philosophical basis of understanding from Elgin and Arendt. To assess the methodology we trialled two different scenarios. One scenario, which we investigated through role-based analysis, concerned the risk of scheming in the deployment of an AI coding agent in a robotics company and the other scenario was for the higher uncertainty, more decision-critical argument of 'If Anyone Builds It, Everyone Dies' (Yudkowsky and Soares). The trial's central finding, for these two scenarios, is that the methodology could be applied and was found to be generative: we found the analyses that justify sufficiency of understanding (internal coherence, tethering, felicitous falsehoods, external coherence) drives the engineering.

0.25

Human-Aware Agentic Driving: Rethinking Driver State, Trust, and Intervention

cs.HC ·2026-10-24 ·Lu Feng
similarity 0.56
Abstract

Agentic driving brings goal-directed reasoning, memory, tools, and adaptive interaction into automated vehicles. A vehicle can clarify a request, explain a maneuver, or prepare a driver to take control, then adapt its next action to the response. These capabilities make the vehicle an active participant in shaping the human behavior it observes. We examine how agentic interaction affects driver-state inference, trust and reliance, and human intervention in conditional automation. Established findings on attention, takeover prediction, trust-aware planning, and adaptive warnings provide useful foundations, but their applicability depends on how observations are elicited and how assistance changes the driving task. We distinguish what remains applicable, what changes under flexible interaction, and what remains unresolved across these three areas. The analysis identifies three research priorities: establishing the effects of interventions, jointly designing interaction and driving policies, and maintaining useful adaptation across repeated use and system changes. Progress should be measured through driver comprehension, appropriate reliance, and the ability to perform the required driving action in time.

0.23