CS Paper Radar

SiMUSation: An Interactive Visitor Experience Simulation Framework to Support Museum Exhibition Design

Huanchen Wang, Qiuming Chen, Zhonghao Ji, Ruqi Sun, Zhichao Lu, Yuxin Ma

cs.HC ·submitted 2026-08-17 03:59 UTC · v1
top venue

Abstract

Understanding how diverse audiences engage with narratives and content is central to exhibition design, yet designers often rely on intuition. Existing experience evaluation methods are typically retrospective, costly, and offer limited access to visitors' internal states, hindering early-stage iterative refinement. Rather than relying only on post-implementation evaluation with real visitors, we explore LLM-driven persona simulation as a reference for early-stage design. Following this idea, we present SiMUSation, an interactive framework designed to support early-stage exhibition design. SiMUSation models diverse visitor personas and simulates their exhibition experiences through a dual-layer representation that couples observable behaviors, such as movement and gaze, with corresponding internal responses, such as confusion and narrative engagement. Designers can steer simulations, inspect feedback from simulated visits, and iteratively revise layouts, content, and narrative flow to further examine how changes reshape visitor experience. We implemented a prototype and evaluated it through a user study (N=12), showing that SiMUSation provides insights for reflection and refinement in early-stage exhibition design. Our findings further highlight the potential of persona-driven simulation to support audience-informed evaluation and iterative decision-making across design tasks.

Comment
15 pages, 7 figures, 3 tables, Accepted by ACM UIST 2026
DOI
10.1145/3830398.3830560

Closest papers

Nearest neighbours by meaning across the whole index.

From Prefabricated Content to Situated Generation: A Four-Wave Longitudinal Study of AI-Mediated Museum Surfaces and Spaces

cs.HC ·2026-10-16 ·Yibo Meng, Xiujun Chen, Bingyi Liu, Xiaolan Ding
published similarity 0.67
Abstract · ACM ISS 2026 PACMHCI full paper; revised manuscript; 5 figures; 3 tables; accepted paper

Generative AI changes a basic condition of interactive surfaces and spaces (ISS): visitor-facing content can be produced during interaction rather than fully authored before it. We report a longitudinal qualitative study with 23 Chinese science museum practitioners, interviewed annually from 2023 to 2026 (retention 23 to 19) and analyzed using reflexive thematic analysis. Participants' accounts moved from anticipated epistemic and operational risks, through backstage experimentation and visitor-facing trials, toward situated governance and renewed questions about the purpose of museum interaction. Following these changes over time shows how generative AI reconfigured the design problems of museum ISS: generated content appeared under institutional authority; inference delay became publicly and bodily experienced; concurrent touch, gesture, and speech created ambiguous multi-user intent; and post-generation editing could leave curators selecting within an AI-defined possibility space. We conceptualize the resulting shift as a movement from prefabricated display to situated generation and formulate four design propositions concerning provenance at the point of display, spatially appropriate fallback, multi-intent negotiation, and curatorial control before generation. These propositions are grounded in practitioner accounts rather than evaluations of implemented solutions.

0.37

Enabling Creative Exploration for Vibe Design Agents

cs.AI ·2026-09-14 ·Yifan Zhang, Nghi D. Q. Bui, Georgios Evangelopoulos, Arnaud Benard
benchmark similarity 0.62
Abstract · 24 pages; revised exposition and evaluation, updated figures, and expanded appendix

Vibe design agents translate natural-language requests into interfaces, yet repeated generations often converge on similar visual directions. We present an inference architecture that makes design exploration an explicit stage before implementation. A pre-pass proposes structured design specifications with typicality weights, an external policy samples a direction, and the generator implements it under fixed decoding settings. Candidate elicitation draws on Verbalized Sampling. Applied to UI themes and visual-asset prompts, this architecture provides direct control over aesthetic exploration without changing code-generation temperature. Across 168 benchmark prompts, theme sampling expands observed selection coverage from one option to nearly three and increases rendered visual variation. For visual-asset prompts, the strongest observed LLM-judge win/loss ratio is 1.32, with only a small change in whole-screen similarity. Localized aesthetic choices can thus influence judged preference even when the overall screen remains similar. We further evaluate joint theme and asset sampling in a randomized online study conducted over nearly two months, covering 3.39 million tasks and 87,416 labeled conversations. These studies show how explicit design specifications support exploration of alternative UI concepts and help us evaluate their effects on rendered interfaces, judged preference, and user interaction.

0.26

Foresee: Making Procedural Futures Tangible through Generative Previews

cs.HC ·2026-10-12 ·Yusi Sun, Ying Jiang, Jiayin Lu, Jing Qian, Yin Yang +2 more
similarity 0.60
Abstract

Procedural guidance can show users how to act without explaining what an action enables later. We present Foresee, an interface combining next-step guidance with consequence previews, method comparisons, and cross-step access. A hybrid pipeline combines structured rendering, image editing, and video generation. A literature-informed framework and six-participant formative study shaped its design. A 24-participant study compared AR guidance, AR with generated video, and Foresee across digital painting, gameplay, and cocktail making. Exploratory painting comparisons showed higher correct completion without a recorded error than AR and higher post-task quiz accuracy than generated-video guidance under task-wise correction. Interviews revealed that users could overlook valued explanations, match visible outcomes without understanding later possibilities, or wait for concrete demonstrations when symbolic cues were unclear. These findings inform generative previews that explain what actions enable or constrain while supporting ongoing execution.

0.19

Present Drawing: Exploring Avatar-Mediated Drawing Events with Physical Traces

cs.HC ·2026-10-23 ·Kojiro Tanaka, Takuya Iwamoto, Yuki Okafuji
top venue similarity 0.60
Abstract · Accepted (ACM UIST 2026)

We introduce Present Drawing, an approach for staging an avatar-mediated drawing event that leaves physical traces in the real world. Present Drawing aims to reconfigure conventional drawing events by relaxing their physical constraints. We describe an organizer-oriented design space for such an event along four elements: Time, Site, Control Source, and Avatar Embodiment. To ground this concept, we developed a proof-of-concept prototype in which an observer wears a head-mounted display to view an avatar. The avatar's motion is synchronized with a customized pen plotter whose mechanical parts are hidden from the observer. We also developed five application examples spanning live, playback, multi-site, mascot, and system-controlled configurations. We conducted an initial evaluation of one representative playback autograph configuration, showing the basic plausibility of the core Present Drawing experience as an avatar-mediated drawing event and highlighting factors associated with perceiving the avatar as the drawer.

0.42

NeuroDivSim: An Interactive Tool for Model-Based Reflection on Cognitive Diversity in Interface Design

cs.HC ·2026-10-08 ·Eske Beckefeld, Henrik H. J. Detjen
similarity 0.59
Abstract

Recent approaches to simulated and synthetic users offer new ways to support design, but raise questions about how computational representations of users should contribute to design practice. We present NeuroDivSim, an interactive tool that explores simulation as an inspectable mechanism for reflecting on cognitive diversity during design and prototyping. Rather than using an LLM to act as a simulated user, NeuroDivSim uses generative AI to construct inspectable task, interface, and environment models from a usage scenario. After human review, these models are combined with explicit cognitive reference configurations and processed through deterministic simulation. This enables designers to hold a modeled usage situation constant while varying cognitive assumptions and tracing their consequences to interaction steps and rule-based design recommendations. We further report an exploratory pilot evaluation (N=10) that provided formative insights into how participants engaged with the workflow and informed subsequent refinements to the presentation of models, simulation results, and recommendations.

0.10

ECHOES: An Adaptive LLM-Powered AR Glasses Docent for Evidence-Grounded Urban Heritage Interpretation

cs.HC ·2026-10-26 ·Bang Xiao, Baosheng Jin, Jinhan Niu, Xingchen Zhang, Hua Shen
similarity 0.58
Abstract

Urban heritage tours are often delivered through fixed scripts, leaving limited room for visitors' situated questions, language preferences, or requests for evidence. We present ECHOES, an adaptive LLM-powered AR glasses docent for evidence-grounded interpretation of historical buildings. Specifically, the agent adapts along three dimensions: it modifies response structure according to the type of visitor question (identification, architectural detail, evidence-seeking, or route inquiry); it accumulates session-level interest signals from repeated questions and expressed curiosity to shape later explanations; and it tracks language preference and retrieval context across turns to maintain conversational continuity. The core of ECHOES is an LLM agent initialized as a source-aware urban heritage docent that realizes this adaptation through dialogue and preference context maintained across the session. Around this agent, ECHOES integrates visual site grounding, a self-built historical knowledge base supporting retrieval-augmented generation, and concise multilingual AR output designed for glanceable use. Through a working prototype centered on Shanghai's East Nanjing Road and the Bund, we demonstrate how an adaptive LLM-powered AR docent can transform historical tours from scripted narration into situated, question-responsive, and source-aware conversations.

0.11

Navigating and Retrieving Information in Immersive Model-Based Design Reviews: An Exploratory Study

cs.HC ·2026-08-20 ·Victor Romero, Romain Pinquié, Frédéric Noel
similarity 0.58
Abstract

Digital engineering uses many models from different perspectives, creating a connected set of digital artefacts across a product's life cycle. Designers seeking a holistic view must navigate numerous models and views, requiring domain-specific software, languages, and representations. This can lead to getting lost in scattered information and the cognitive burden of mentally integrating details across diagrams. To overcome these issues, we developed the virtual environment GraphXplore. GraphXplore enhances perceptual and conceptual integration by linking all relevant visual items from different perspectives into an interactive, layered 3D graph displayed in virtual reality, providing a holistic view of the system. We compared GraphXplore with a conventional on-screen setup using a PowerPoint slide deck with model screenshots viewed on a desktop PC. In an experiment with N=33 volunteers (mainly industrial product design postgraduates and professors), we conducted a baseline usability study focused on fundamental information retrieval tasks for model-based design comprehension, as identifying basic model elements is the fundamental prerequisite in design reviews. Our findings indicate that for simple retrieval tasks, the correctness of answers, completion time, recall score, and perceived confidence are comparable in both environments. However, the virtual environment demonstrated practical advantages, achieving a "good" average System Usability Scale (SUS) score of 73.1 compared to the slide setup's borderline score of 66.4. Furthermore, GraphXplore users reported a lower perceived cognitive workload (mean NASA-TLX score of 43.8) compared to the traditional setup (50.4). Future work will enhance this experiment to yield empirical results across massive industrial datasets, refine GraphXplore, and extend to new design review objectives.

0.10

FocusGen: Expanding Visual Design Exploration with a Simulated Focus Group of Persona Agents

cs.HC cs.MA ·2026-08-28 ·Jaewon Choi, Helena Vasconcelos, Hyun Lee, Carolyn Zou, Tak Yeon Lee +1 more
similarity 0.58
Abstract · 18 pages, 7 figures, 6 tables

Creative professionals rarely design for themselves--they design for audiences whose preferences they must anticipate. Yet current text-to-image exploration tools derive diversity entirely from the designer's own input--their prompts, their chosen dimensions, their search queries--confining exploration to what the designer already knows to look for. We present FocusGen, an interactive system that introduces external perspectives into visual design exploration through a "virtual focus group" of simulated persona agents. In contrast to prior persona systems in which multiple agents converge as critics on a single evolving artifact, FocusGen uses personas as parallel generators: each agent--constructed from demographic data, a procedurally generated backstory, and aesthetic preferences elicited through interviews--independently drives an iterative generation loop that produces its own visual concept, transforming one design brief into a spectrum of audience-conditioned directions. With real human participants, we confirm that the iterative refinement loop produces outputs people prefer over zero-shot generation. With synthetic agents at scale, we show that persona conditioning yields higher visual diversity than a generic-assistant baseline--measured by CLIP distance and corroborated by human perceptual judgments--and that open-ended preference interviews yield more diverse outputs than structured ones for both human and synthetic cohorts, while also revealing that agent cohorts recover only part of the diversity of comparable human cohorts. A qualitative study with 16 creative professionals suggests FocusGen helps designers discover unanticipated directions, overcome fixation, and probe audience contexts--while surfacing stereotyping risks that we analyze. We position FocusGen as a divergence scaffold for early-stage ideation rather than a substitute for audience research.

0.51