CS Paper Radar

Too Hard, Too Easy, Just Right: Performance-Driven Challenge Adaptation in Virtual Reality Firefighter Training

Xuan Wang, Jianan Jiang, Rongqian Chen, Tian Lan, Bin Li

cs.AI ·submitted 2026-10-28 00:52 UTC · v1

Abstract

Effective firefighter training requires practice under dynamic and stressful emergency conditions, yet real-world live-fire exercises are costly, risky, and difficult to scale. Virtual Reality (VR) offers a safe and controllable alternative, but many existing VR firefighter training systems rely on fixed scenarios or provide limited difficulty adaptation, making it difficult to maintain an appropriate level of challenge for skill development as trainees' performance changes over time. To address this limitation, we present ProACT, a performance-driven adaptive training system that regulates scenario difficulty through closed-loop interactions between trainee performance and simulated fire dynamics. Specifically, ProACT combines a global module that continuously adjusts scene-level fire spread dynamics in real time based on trainee performance with a local module that periodically updates object-level flammability across the environment. Our evaluation shows that ProACT improves both objective training performance and subjective user experience compared with existing adaptive and non-adaptive baselines. We further discuss how adaptive immersive environments can extend beyond firefighting to broader training domains.

Closest papers

Nearest neighbours by meaning across the whole index.

A Serious Game for Training Civil Participation in Flood Crisis Management

cs.HC ·2026-11-12 ·Solmaz Goodarzi, Arseni Ivanov, David Maruscsák, Diana Quitéria Sousa
similarity 0.63
Abstract

Floods are among the most frequent and destructive natural disasters, requiring citizens to make critical decisions under rapidly changing conditions. Most serious games related to flooding emphasize awareness, preparedness, and education in flood management, but there is still a research gap on how to train citizens to act under pressure, uncertainty, and stress. In this paper, we position Virtual Reality (VR) serious games as a promising approach to addressing this gap by providing experiential and immersive training opportunities for citizens. We propose a conceptual VR serious game that enables participants to experience realistic flood scenarios, practice decision-making, rehearse appropriate response behaviors, and develop response-related skills in a safe and controlled environment. In addition, we suggest a research agenda and an evaluation framework focused on flood risk awareness, response capabilities, and stress-related outcomes. The framework thoughtfully integrates subjective, objective, and physiological measures to assess the effectiveness of immersive flood-response training. Finally, we present design, methodological, ethical, and user-experience considerations in VR-based disaster training, and outline future research directions for the development and evaluation of immersive serious games for flood emergency response. The present study aims to contribute to the growing intersection of serious games, extended reality, and disaster risk reduction by establishing citizen-centered response training as a significant yet under-researched field.

0.26

FireWorldBench: Benchmarking Complex Physical World Intelligence through Coupled-Field Fire Dynamics

cs.AI ·2026-09-19 ·Qiang Chen, Hao Guo, Huatai Zhu, Tairan Huang, Yichao Cao +5 more
benchmark similarity 0.62
Abstract

Understanding the physical world requires more than object recognition, scene description, and short-term visual prediction, as real-world physical systems involve multiple continuous fields, latent causal mechanisms, partial observations, and intervention-sensitive dynamics. We propose FireWorldBench, a benchmark for evaluating complex physical world intelligence in multimodal large language models and agents through coupled-field fire dynamics. Fire provides a canonical stress-test environment, where multiple interacting physical fields jointly shape observable states and temporal dynamics. FireWorldBench is organized along two complementary axes, a physical capability axis and a fire scenario task axis, jointly covering physical-state understanding, temporal dynamics, causal mechanisms, and intervention reasoning. The benchmark comprises 520 fire-world entries, including 494 controlled simulation worlds and 26 real-world-aligned event groups, spanning 47 scene archetypes across 7 environment families. These entries combine structured textual observations, multiple 2D physical-field visualizations, and 3D event-level scene modeling, yielding 9,074 text-image interleaved question-answer pairs across choice-based and open-ended report-generation formats. FireWorldBench evaluates whether models can infer latent physical states, explain underlying mechanisms, forecast coupled-field evolution, and assess intervention consequences from multimodal partial observations, providing a challenging testbed for complex physical world intelligence.

0.30

A Simulation-Grounded Agentic VLM Framework for Wildfire Monitoring and Reporting

cs.CV cs.GR ·2026-10-01 ·Duowen Chen, Yuchen Sun, Zhiqi Li, Yuxuan Liao, Sinan Wang +2 more
similarity 0.59
Abstract

Effective wildfire monitoring requires relating visual evidence to physical fire dynamics, yet real videos with synchronized physical annotations are scarce and high-fidelity 3D simulation is costly. We present a simulation-grounded vision-language model (VLM) framework that automatically converts 2D wildfire simulations into labeled video episodes. A fixed Blender mapping produces low-detail 3D proxies aligned with simulator terrain, fuel layout, fire activity, and wind cues; controllable video generation supplies richer appearance. The proxies are intermediate representations rather than finely rendered final scenes. Generated videos and simulator labels form reusable multimodal memory for a training-free multi-agent VLM system that retrieves reference episodes, reconciles visual and memory-based predictions, and produces structured wildfire reports. On held-out generated episodes, video memory achieves 51.5% exact four-tag accuracy, compared with 22.6% for direct VLM querying and 16-17% for text-only memory; the complete system achieves 77.3% accuracy on six simulator-derived report fields. Component ablations, cross-generator tests, and three real-UAV evaluations assess retrieval, reporting, generator changes, and observable monitoring tasks. The framework connects automatic simulation-to-proxy conversion with memory-based VLM reasoning under scarce real-world physical annotations.

0.20

CAESAR: Mixed Reality Search-and-Rescue Platform for Cognitive Attack Evaluation

cs.HC cs.CR ·2026-10-20 ·Mingyu Zhu, Jiangong Chen, Yu Liu, Hillmer Chona, Zifan Zhou +7 more
published similarity 0.59
Abstract · Accepted to the 2026 IEEE International Symposium on Mixed and Augmented Reality (ISMAR) and selected for publication in the IEEE Transactio…

Mixed Reality (MR) enables immersive training by tightly coupling virtual content with the physical environment and supporting embodied interaction. In safety-critical collaborative tasks such as search-and-rescue, however, users rely heavily on virtual elements for perception, coordination, and decision-making, making them vulnerable to cognitive attacks that subtly distort visual feedback, virtual content, or system synchronization. While prior MR security research has examined individual attack mechanisms, evaluations are typically conducted in isolated or single-user settings, and there is a lack of standardized collaborative testbeds for systematic adversarial experimentation. In this paper, we develop CAESAR, an end-to-end multi-user MR framework for systematic evaluation of cognitive attacks in collaborative search-and-rescue training. CAESAR features a modular architecture that integrates four classes of cognitive attacks within a synchronized collaborative scenario and incorporates a multimodal data collection pipeline that captures behavioral, performance, and subjective measures under adversarial conditions. We conduct a controlled user study with an in-depth analysis of the latency-based attack, demonstrating measurable effects on task performance and user behavior while characterizing users' subjective experience under adversarial conditions.

0.17

Distilling Vision-Language Models for On-Device Fire Understanding

cs.AI ·2026-09-05 ·Mohammad Kazzazi, Zixuan Liu, Siavash Khajavi
similarity 0.57
Abstract

Vision-language models (VLMs) offer a promising alternative to conventional fire detection systems by reasoning about the semantic context of a scene and thus reducing false alarms, yet their large model size makes deployment on embedded fire sensors impractical. In this paper, we study how domain-specialized VLMs can be compressed for fully on-device deployment without losing the safety-critical behavior required for fire detection. We develop a teacher-student knowledge distillation framework in which large VLMs fine-tuned for fire understanding can be distilled into lightweight students. Experiments across multiple VLM families and model scales show that compact students preserve most of their teachers' fire-understanding capability. We further deploy the distilled models on our commercial Detectium fire detection sensor and jointly evaluate reasoning accuracy, latency, and memory usage. The results show that compression and deployment affect not only accuracy but also model failure modes, with Qwen2.5-0.5B providing the strongest overall deployment trade-off. Our findings provide broader guidance for deploying domain-specialized VLMs in resource-constrained, safety-critical settings.

0.25

Interactive Visual Gym: Evaluating Visual Interaction Models with Simulated Users in Interactive Worlds

cs.CV ·2026-11-05 ·Chenhao Zheng, Zixian Ma, Kai Li, Kanchana Ranasinghe, Jieyu Zhang +9 more
benchmark similarity 0.56
Abstract · 39 pages, including references and appendices

Visual interaction models that support users during ongoing physical tasks require evaluation in closed loop, where assistant responses can change subsequent user behavior and task outcomes. Existing benchmarks largely rely on offline replay and therefore cannot capture these effects. We introduce Interactive Visual Gym, a framework for closed-loop evaluation and training of visual interaction models through joint simulation of executable task environments and human users. We contribute three simulators that recreate everyday tasks and human-aligned action spaces across cooking, household manipulation, and mobile-interface domains, together with a persona-conditioned user simulation harness that collaborates with the assistant while incorporating controlled execution errors and other out-of-plan behaviors. We instantiate the framework as IVG-Bench, a benchmark with 315 interaction scenarios. Evaluating state-of-the-art VLMs as visual interaction models reveals substantial limitations: the best-performing model, Claude Opus 5.5, completes only 53.5% of tasks within the time limit, exhibits significant weaknesses in factual grounding and actionable guidance, and is often too slow to prevent errors when response latency is considered. We verify our evaluation protocol with a human study which finds 78.5% agreement between our interaction-quality metric and participant preferences. We further show that the environments provide useful learning signals: in a proof-of-concept GRPO experiment, closed-loop training improves both task success and interaction quality for Qwen3.5-4B model in our cooking environment.

0.27

Vision Language Models for Primary Structure Threat Identification in Wildland Urban Interface Fires

cs.CV ·2026-11-07 ·Zhangding Liu, Neda Mohammadi, John E. Taylor
published similarity 0.56
Abstract · 6 pages, 3 figures, 1 table. Accepted at the 2026 IEEE International Smart Cities Conference (ISC2), Porto, Portugal

Wildland urban interface (WUI) fires increasingly threaten communities and infrastructure, motivating the need for rapid visual assessment. Recent research has focused primarily on detecting fire and assessing post-event damage. However, structure-level fire threat identification during active WUI fire events remains underexplored. This study evaluates Qwen3-VL-8B-Instruct for this active-fire decision using two separately scored tracks: 1,824 synthetic images from 491 designed WUI scenarios and 45 frames from a controlled-burn experiment conducted in collaboration with Columbus Fire & EMS Department. Under zero-shot prompting, the model returned valid target fields for 1,808 synthetic images and 39 controlled-burn frames. Accuracy among valid outputs was 94.0% for the synthetic track and 69.2% for the controlled-burn track, compared with a 16.0% random-selection baseline for the latter. On the synthetic track, the model generally identified the intended target across varied designed WUI scenarios when the relevant fire-spread cues were visually distinct. Controlled-burn performance was well above random selection, but errors showed difficulty interpreting spatial relations in complex scenes. The dual-track protocol provides scalable stress testing in designed scenarios and a controlled-burn reference for assessing model behavior under physical fire conditions. Future work can use the synthetic data for VLM post-training and then evaluate the adapted models on larger and more diverse real WUI fire datasets.

0.28

PhysLoop: Harnessing LLMs' Physics Awareness for Self-Improving Video Generation Models

cs.CV cs.AI ·2026-11-12 ·Yuxuan Chen, Xiaojie Li, Hao Chen, Juncheng Ma, Kewei Zhang +9 more
benchmarkcommunity pick similarity 0.56
Abstract · 21 pages. Revised the human evaluation protocol, clarified the generation task-success and repair pass-vote metrics, and updated Table 1 and…

Video generation models produce visually realistic videos but still struggle with physical dynamics and causal consistency. Learning from generated videos requires fine-grained physical supervision, yet reliable quality judgments, correction pairs, and controlled variations are difficult to obtain. Large language models (LLMs) possess physical knowledge, but struggle to reliably guide video generation models in producing their training videos. We present PhysLoop, a unified harness designed to support physically grounded self-improvement in video generation models. The harness guides and constrains LLMs throughout video generation, selection, and correction, distilling their physical knowledge into physically consistent videos. The framework supports controllable training-data construction and inference-time video repair. By identifying and correcting failures, PhysLoop marks a key milestone toward recursive self-improvement (RSI) in video generation models with limited human intervention. We release 100K videos spanning diverse, realistic indoor and outdoor scenes, along with generation tools and two evaluation datasets: PhysLoop-Gen and PhysLoop-Repair. We evaluate controllable generation and localized repair on these datasets, respectively, and assess physical behavior on the external Physics-IQ Verified benchmark.

0.33