CS Paper Radar

Req-Space: A User Study of Interactive Visualisations for Requirements Review

Risha Parveen, Navneet Arora, Zheying Zhang, Kalle Mäkelä, Pekka Abrahamsson

cs.SE ·submitted 2026-11-03 10:29 UTC · v1
hot direction

Abstract

Requirements review involves identifying inconsistencies and assessing change implications across distributed specifications. Motivated by needs raised in industrial project workshops, we investigate Req-Space, an interactive prototype integrating semantic exploration and traceability visualisation to support human-led review. We conducted a fixed-order, two-phase study with 20 participants, including 11 with at least three years of software or IT experience. Participants reviewed a fictional 40-requirement software specification and a guest-checkout change request, first using source documents and then revisiting the same tasks with Req-Space. During the supported review, 17 participants recorded at least one additional source-supported item or pair. Of 69 assessable additional units, 58 (84.1%) were judged supported by the source materials. Seven decision rationales were judged stronger in Phase 2, including five without a change in the decision category. Participants generally found the visualisations helpful, although workload responses were mixed and some misinterpreted visual relationships. The findings suggest that visual support can facilitate requirements exploration and decision justification, provided relationship meanings and source context remain clear. The fixed study sequence prevents attributing the observed changes specifically to Req-Space.

Comment
This work has been submitted to the IEEE for possible publication. Copyright may be transferred without notice, after which this version may no longer be accessible

Closest papers

Nearest neighbours by meaning across the whole index.

Large Language Models for Requirements Engineering: A Cross-Task Empirical Evaluation

cs.SE ·2026-08-21 ·Jacek Dąbrowski, Manjeshwar Aniruddh Mallya, Alessio Ferrari, Mohammad Amin Zadenoori, Yijun Yu
code/data similarity 0.63
Abstract

Requirements-related information is scattered across heterogeneous artefacts such as user feedback, developer discussions, and software repositories, making the extraction of actionable requirements knowledge labour-intensive and hard to scale. Large Language Models (LLMs) can support many Requirements Engineering (RE) activities, from classification and traceability identification to specification and explanation generation, but existing evidence is fragmented across tasks, artefact types, and evaluation settings, and studies rarely offer cross-task evaluations or replication packages. We present two complementary empirical studies evaluating LLMs across five RE-related activities. The first is a controlled experiment on five lightweight open-source LLMs for feedback-driven requirements classification and specification generation. The second is an exploratory industrial case study on two frontier LLMs for traceability link identification and traceability explanation generation using real project artefacts. Classification and traceability identification were assessed with quantitative metrics, and generation tasks through human evaluation. LLM performance is strongly task-dependent, ranging from moderate to high, and no single model consistently outperformed the others, indicating that effective adoption depends on selecting models and prompting strategies per task. Our contributions are: (i) the first cross-task empirical evaluation of LLMs spanning five RE-related activities, (ii) replication materials supporting reproducibility, and (iii) a broader understanding of the capabilities, limitations, and practical readiness of current LLMs for RE.

0.48

A Chat Assistant for Software Exploration in a 3D Software Visualization

cs.SE ·2026-10-07 ·Malte Hansen, Karim Issa, Wilhelm Hasselbring
top venue similarity 0.62
Abstract · 11 pages, 5 figures, accepted at VISSOFT 2026

We present a chat assistant for interactive software exploration, embedded in the 3D software visualization tool ExplorViz. The assistant builds upon current Large Language Models (LLMs) and enables users to ask questions about the currently visualized software system and trigger actions that change the visualization through natural language. We integrate the chat assistant in our ExplorViz frontend using the CopilotKit libraries such that probabilistic LLMs are combined with deterministic and tool-based actions similar to implementations using the Model Context Protocol (MCP). The chat assistant is also enabled to restructure the software system by adding, removing, or modifying parts of the software system in the visualization. An empirical experiment with eleven participants evaluated both perceived comprehension support and the tool calls that were triggered by the chat assistant. Participants rated the assistant's generated summaries and explanations as largely correct. They also reported high usability for actions like highlighting entities in the visualization and the creation of new color themes. In contrast, open-ended chat-assisted software restructuring in the visualization showed mixed results. This suggests a need for stronger guardrails for the employed LLM and better incorporation of user feedback. Overall, the assistant was perceived as usable and promising for reducing interaction overhead during exploratory program comprehension tasks. We provide a video presenting the chat assistant's use and a reproduction package of the software system that was used in our evaluation.

0.46

Don't Guess, Just Ask: Evaluating Interactive Requirement Clarification for Repository-Level Software Development

cs.SE cs.AI ·2026-10-09 ·Mingyu Chen, Zhiqing Zhong, Manyi Wang, Linxi Liang, Rouyu Chen +1 more
benchmark similarity 0.61
Abstract

As LLMs become increasingly capable of implementing software, a critical bottleneck emerges: whether they truly understand what users want. Users often begin with vague intent, leaving important requirements to be clarified through interaction. In repository-level development, misunderstandings can propagate and cause costly rework. However, existing benchmarks typically evaluate implementation from complete specifications or underspecified requests, overlooking pre-coding requirement clarification. Prior clarification studies mainly focus on function-level tasks. It therefore remains unclear how well LLMs can transform vague intent into clear requirements through interaction and how this capability affects subsequent code generation. We introduce ReqClarifyBench, an interactive requirement clarification benchmark for repository-level software development. It contains 341 tasks spanning game, miniapp, and web development, each with a vague user intent, a human-validated requirement document, and code evaluation artifacts. We employ LLM-based user simulators with diverse personas derived from real-world conversations. We evaluate six LLMs in terms of clarification effectiveness and generated requirement document quality. Results show that stronger clarification effectiveness does not necessarily translate into higher document quality, and performance varies substantially across user personas. We also find that coding-agent harnesses do not further improve requirement document quality compared with their base LLMs. These findings offer insights for building LLM-based end-to-end software development systems.

0.19

Guidelines Are Not Rules: Characterizing Terminologies around Visualization Design Guidelines

cs.HC ·2026-08-28 ·Anna L. Chinni, Md Dilshadur Rahman, Bon Adriel Aseniero, Petra Isenberg, Kushin Mukherjee +4 more
published similarity 0.61
Abstract · Accepted at BELIV @ IEEE VIS 2026

A common expectation in visualization research is that outcomes recommend how researchers and practitioners take action or make design decisions. We often express these as "guidelines." Yet, the term "guideline" is both ambiguous and loosely defined, and what one researcher considers a guideline may be too broad, too loose, or too strict for another. We take a closer look at a broader set of terms that can express desirable results around visualization research, and untangle how these words are understood in the community in relation to other similar terms. We base our work on an exploratory study with experts, followed by a crowdsourcing study with a separate mapping phase (n=30) and rating phase (n=42) targeting input from the broader visualization community, and an analysis of the use of terminology in 3,877 IEEE VIS papers published from 1990 to 2024. Based on our findings, we call for more nuanced, precise discussions of research outcomes and their communication to the broader community, including practitioners and students.

0.25

Exploring multimodal AI--XR interactions for software development: From expert perspectives to semantic code outlines

cs.HC cs.SE ·2026-11-18 ·Ilya Zakharov, Alexey Markin, Konstantin Ostroukhov, Alexey Perminov, Roham Koohestani +2 more
survey similarity 0.61
Abstract · Submitted to HIMAS 2027: Human-Centered Interactive Multimodal AI Systems, co-located with ACM IUI 2027

AI tools can generate code quickly, but developers still need to understand and check the results. We explore how the enriched multimodal context derived from the extended reality (XR) workspace might help developers manage this information. We first interviewed 13 experts in AI, XR, and related fields to identify opportunities and design challenges (Study 1). These interviews informed two prototypes explored with 12 professional developers (Study 2): four tried a version where the code faded to become invisible after it was looked at, and eight tried a version that replaced viewed code sections with short descriptions of their purpose. In the second prototype, head direction helped determine when to offer a change, while manual input let developers apply it and reopen the original code. A separate open-ended demonstration with seven software-engineering researchers provided complementary feedback. Participants' accounts suggested that descriptions could provide an overview of unfamiliar code and serve as reminders when revisiting it. However, difficulty comparing descriptions with source code, headset limitations, and controls that deviates from regular IDE routines could introduce additional effort. These exploratory findings identify requirements for attention support: make summaries easy to recognize and access, preserve straightforward inspection of the original code, and retain familiar navigation and editing practices. The study contributes to human-centered multimodal systems by showing how the coordination of input channels and AI-generated representations must account for users' attention, verification needs, and established ways of working.

0.13

Representational Fidelity in Didactic Visualization: Toward a Multidimensional Design Space

cs.HC ·2026-09-07 ·Shehryar Saharan, Michele Oliver, Karen Gordon, Gaël McGill, Jodie Jenkinson
publishedcode/data similarity 0.61
Abstract · To appear in IEEE Transactions on Visualization and Computer Graphics (Proceedings of IEEE VIS 2026). Supplemental material: https://osf.io/…

Representational fidelity is routinely treated as a single abstract-realistic continuum, a simplification that limits how it is described and compared across research and design contexts. We introduce a multidimensional design space of representational fidelity for didactic visualization in science & engineering, inductively derived from a 175-item corpus spanning several disciplines, modalities, and instructional aims. The resulting design space specifies five dimensions: Morphological, Dynamic, Cueing, Contextual, and Interactive Fidelity, with seven sub-dimensions. We demonstrate the design space's descriptive power through successive rounds of expansion and refinement and analyze the corpus to reveal relationships among dimensions and implications for design and research. We further validate the design space through a pilot focus group in which participants applied the dimensions in an open-ended design exercise. Resulting sketches and verbal rationales informed a single-designer applied case study, offering preliminary evidence of the design space's generative potential as a structured aid to design exploration. Together, these contributions lay the groundwork for future research and more intentional design practice.

0.46

Spec-Driven Development as Prescribed and as Practiced

cs.SE cs.AI ·2026-08-25 ·Shyam Agarwal, Anmol Singhal, Andrew Macvean, Bogdan Vasilescu, Travis Breaux
highly cited similarity 0.60
Abstract

AI coding agents implement software from naturallanguage instructions, but the intent behind that work is lost when stated only in chat sessions. Spec-driven development (SDD) addresses this by having developers and agents write specifications that guide implementation, yet evidence on its use comes largely from tool vendors. We study SDD in practice through a thematic analysis of Reddit discussions, interviews with 21 practitioners, including eight tool makers, and 266 active and popular repositories in SpecMine, a corpus of 470,795 spec files from 73,030 public GitHub repositories that we release. Practitioners agreed that specs should capture intent, but many also included implementation details, used SDD selectively and mainly for new features, and reported more reliable agent behavior alongside greater planning and review costs. Our findings show that implementation detail may help agents while making specs prone to decay, that tool-specific record structures shape what people and agents see, and that participants described spec-code checks mainly when changes are completed rather than over time. We also find that individual benefits may come from clarifying intent before delegation, while team benefits may depend on SDD becoming a shared process. We derive implications for tool builders, practitioners, and researchers.

0.36

Trinketry: Materializing Elements to Anchor Traceable Design Histories

cs.HC ·2026-10-16 ·Wen-Fan Wang, Yi-Ting Chiu, You-Yi Hsieh, Bing-Yu Chen, Max Kreminski
similarity 0.60
Abstract

Generative tools enable visual designers to rapidly explore diverse design directions---but as flawed generated outputs proliferate, designers may lose track of promising ideas and the context of their development. We introduce trinkets: user-preserved design elements that function as reusable materials, retrieval queries, and navigational anchors for tracing how ideas emerge, transform, and recur throughout design history. We implement this concept in Trinketry, a visual exploration canvas. In a within-subjects study with 12 concept designers, Trinketry supported focused element-level exploration and greater perceived control than a simple branching image generation history baseline. A follow-up study with six returning designers examined delayed design history sensemaking, continuation of work, and reconstruction of others' processes. Compared with whole-image histories, Trinketry supported more precise reconstruction of process structure, turning points, and goals, while helping designers recover overlooked materials and continue exploration. However, opportunities remain to augment trace representations with explicit statements of design rationale.

0.22