CS Paper Radar

Guidelines Are Not Rules: Characterizing Terminologies around Visualization Design Guidelines

Anna L. Chinni, Md Dilshadur Rahman, Bon Adriel Aseniero, Petra Isenberg, Kushin Mukherjee, Ghulam Jilani Quadri, Paul Rosen, Karen B. Schloss, Daniel Weiskopf

cs.HC ·submitted 2026-08-28 02:21 UTC · v2
published

Abstract

A common expectation in visualization research is that outcomes recommend how researchers and practitioners take action or make design decisions. We often express these as "guidelines." Yet, the term "guideline" is both ambiguous and loosely defined, and what one researcher considers a guideline may be too broad, too loose, or too strict for another. We take a closer look at a broader set of terms that can express desirable results around visualization research, and untangle how these words are understood in the community in relation to other similar terms. We base our work on an exploratory study with experts, followed by a crowdsourcing study with a separate mapping phase (n=30) and rating phase (n=42) targeting input from the broader visualization community, and an analysis of the use of terminology in 3,877 IEEE VIS papers published from 1990 to 2024. Based on our findings, we call for more nuanced, precise discussions of research outcomes and their communication to the broader community, including practitioners and students.

Comment
Accepted at BELIV @ IEEE VIS 2026

Closest papers

Nearest neighbours by meaning across the whole index.

Projecting the Public: Reflections and Recommendations for Empirical Visualization Studies of General Audiences

cs.HC ·2026-10-31 ·Mandi Cai, Jack McNiel, Erik C. Nisbet, Matthew Kay
similarity 0.68
Abstract

Calls for shifting visualization research to general audiences outside of professional contexts have been put forward since the early 2000s, but expanding outwards means contending with a diversity in visualization's communicative purpose beyond transmitting insights from data. After our own experiences studying public-facing visualizations, we sought a set of considerations to help early-career visualization researchers reason through designing empirical visualization studies for the general public that confronts the various ways visualizations are interpreted. We examined literature on guiding paradigms of research, reviewed 73 visualization papers that specify a focus on audiences broader than domain experts, and conducted 15 semi-structured interviews with authors of such papers, to derive the following: (1) a conceptualization of any experiment as 3 elements-casting audience, constructing experimental setting, and projecting audience impressions and interactions into measurable constructs (2) an account of interviewees' aspirations for each element of study design, versus the real challenges that occurred. We detail their approaches to navigate the gaps between aspirations and reality when working with general audiences and summarize them as actionable recommendations. The conceptual framework is intended to help junior researchers scope and outline experimental designs of visualizations "for the masses", while the recommendations provide concrete guidance for putting those designs into practice. The 73 papers are filterable and visualized on our study website, and our code to sample the papers is on GitHub.

0.23

Considering Contribution Statements in Visualization and HCI Research

cs.HC ·2026-08-13 ·Mara Solen, Wesley Willett, Andrew M McNutt
similarity 0.64
Abstract

Contribution statements are an increasingly common way to make research labor visible, reduce academic malfeasance, and provide broader transparency. Despite this potential value, they remain uncommon in visualization and HCI. To explore this gap, we conducted an online study with (N=21) visualization and HCI researchers. We find a range of differing opinions about the utility of contribution statements, which are set against a background of tensions relating to contribution frameworks that inadequately fit contribution types in HCI and especially visualization, power dynamics between authors, bias in authorship perceptions, and the tedium of providing yet another form of documentation. From these factors, we offer a modest recommendation to authors: consider contribution statements. There are contexts when they may usefully explicate work, and others where they can cause author-team conflict or become a burdensome chore. Regardless of whether they are used by readers or not, we suggest that scaffolded mechanisms for reflecting on contribution roles are valuable both for public accountability and internal alignment. To institutions, we recommend that contribution statements be exempt from page or word limits, and that flexible templates and examples be provided to authors, but that they continue to not be required. By surfacing these perspectives, we seek to open a dialogue about what constitutes authorship, how our community might move toward more equitable and transparent attribution practices, and where the visualization and HCI communities might be uniquely equipped to help.

0.04

Epistemic Tensions: Reframing A Visualization Co-Design through Entanglement Theory

cs.HC cs.CY ·2026-08-14 ·Wei Wei, Foroozan Daneshzand, Zezhong Wang, Erica Mattson, Jenny Farkas +3 more
similarity 0.63
Abstract · 10 pages, 5 figures, accepted by IEEE VIS BELIV workshop

In this work, we present how employing the lens of entanglement helped us examine and reframe epistemic tensions arising in a visualization co-design project. Entanglement theory challenges traditional assumptions in the visualization research community by emphasizing that knowledge is not produced through linear, isolated processes, but is inherently entangled with phenomena and apparatuses. While this perspective offers a compelling critique of conventional research practices, its practical value for visualization research remains underexplored. We apply the entanglement lens to examine and reframe the epistemic tensions that emerged in a longitudinal community-based visualization co-design project. Our experience shows that the entanglement perspective not only provides a richer understanding of these tensions, but also helps transform them into generative opportunities for methodological and theoretical reflection. Applying this lens enabled us to critically interrogate the language used in research, to develop a more nuanced understanding of visualization co-design, and to surface ``dark sides'' of conventional visualization design pipelines. These contributions illustrate the practical value of embracing entanglement as an epistemological lens for visualization research.

0.19

User Engagement in Visualization: A Scoping Review of 243 Research Articles

cs.HC ·2026-11-01 ·Mara Solen, Clara-Marie Barth, Heather O'Brien, Tamara Munzner
similarity 0.62
Abstract

User engagement is well studied in other domains. Work to date has proposed conceptual models and definitions, approaches to measurement, and factors that influence engagement in digital interactions. However, of the articles in the visualization literature that refer to engagement, few of them make evidence-based, generalizable claims, and research that does is challenging to locate due to inconsistent reporting and often lacks connection to the broader engagement literature. To address these issues and promote the consideration of the broader engagement literature, we conduct a comprehensive scoping review of visualization literature and engagement. Using scoping review methodology, we identify and analyze 243 articles that make claims about engagement with visualizations. We coded the studies conducted, literature cited, definitions provided, and claims made in these articles and analyze the codes to evaluate the quality of the work in the field and to synthesize existing findings. We find that, despite frequent references to engagement and apparent interest in the topic, the overall quality of visualization engagement research is poor, often with weak evidence, inconsistent conceptualizations, and infrequent citation of existing models, methods, or claims. We report the evidence-based claims about what engages people with visualization, including the factors of animation, interaction, and immersion, additionally describing both corroboration and apparent contradictions between these claims. Finally, we propose the COMFI framework and mnemonic for reporting important information in future engagement studies.

0.25

Dashboard Remixing: Goal-oriented Organization and Enrichment of Visualizations and Insights

cs.HC ·2026-11-08 ·Junran Yang, Leilani Battle, Jane Hoffswell
published similarity 0.61
Abstract

Dashboard creation requires iteratively authoring multiple views and organizing them into a structured format. However, creators often struggle to step back and assess their own work for organization and refinement due to cognitive limitations. In this work, we propose a pipeline to provide computational support for self-reflection during the design process. Our pipeline automatically infers analytical objectives, discovers implicit patterns, and structures those patterns to surface coherent analytical pathways. It further enriches existing dashboard designs by generating complementary visualizations and aggregating natural language insights based on relationships across data entities (e.g., contrasting, drill-down, and relatedness) to reveal chart connections. Our rule-based pipeline provides objective, verifiable feedback, offering an external perspective while enabling creators to tell their own data stories. Four case studies and six expert interviews demonstrate how this approach helps creators reflect on organizational alternatives and surface hidden analytical opportunities in a principled way, reducing the cognitive burden while encouraging deeper analytical exploration.

0.28

Req-Space: A User Study of Interactive Visualisations for Requirements Review

cs.SE ·2026-11-03 ·Risha Parveen, Navneet Arora, Zheying Zhang, Kalle Mäkelä, Pekka Abrahamsson
hot direction similarity 0.61
Abstract · This work has been submitted to the IEEE for possible publication. Copyright may be transferred without notice, after which this version may…

Requirements review involves identifying inconsistencies and assessing change implications across distributed specifications. Motivated by needs raised in industrial project workshops, we investigate Req-Space, an interactive prototype integrating semantic exploration and traceability visualisation to support human-led review. We conducted a fixed-order, two-phase study with 20 participants, including 11 with at least three years of software or IT experience. Participants reviewed a fictional 40-requirement software specification and a guest-checkout change request, first using source documents and then revisiting the same tasks with Req-Space. During the supported review, 17 participants recorded at least one additional source-supported item or pair. Of 69 assessable additional units, 58 (84.1%) were judged supported by the source materials. Seven decision rationales were judged stronger in Phase 2, including five without a change in the decision category. Participants generally found the visualisations helpful, although workload responses were mixed and some misinterpreted visual relationships. The findings suggest that visual support can facilitate requirements exploration and decision justification, provided relationship meanings and source context remain clear. The fixed study sequence prevents attributing the observed changes specifically to Req-Space.

0.36

How Data Journalists Visualize Uncertainty: Editorial Constraints and Design Heuristics in Newsroom Practice

cs.HC ·2026-11-02 ·Carmen Garro, Annemarie Wisbar, Benjamin Possin, Christoph Kinkeldey
code/data similarity 0.58
Abstract

Communicating uncertainty is increasingly recognized as important in data journalism, yet in practice it is often oversimplified, downplayed, or omitted. To understand how uncertainty is handled in newsroom visualization practice, we conducted a full-day workshop with 11 data journalists from major German-speaking newsrooms. The workshop combined presentations of newsroom examples, collaborative scenario classification, World Café discussions on authoring hurdles, and group reflections on audience needs and future directions. Our findings suggest that uncertainty communication is primarily a workflow- and context-dependent editorial decision, constrained by production overhead, anticipated audience misinterpretation, publication formats, and the need to preserve a clear takeaway. Rather than relying on advanced visualization techniques, practitioners favor pragmatic defaults, layered communication, and explanatory guidance tailored to audience and medium. The scenario-based framework we provided is valued less as a strict taxonomy for classifying finished visualizations than as a planning prompt for early design reasoning. Based on these insights, we contribute (i) practitioner-informed findings on the challenges and strategies of visualizing uncertainty in journalistic practice, (ii) a refined scenario-based framework to support communication about uncertainty, and (iii) practice-oriented heuristics for designing uncertainty visualizations in newsrooms. Our work contributes to bridging visualization research and newsroom practice by grounding uncertainty communication in the realities of journalistic production. Supplemental material is available at https://osf.io/8j4ep.

0.35

Evaluating Human-LLM Alignment on Visualization Preference

cs.HC ·2026-11-04 ·Tanmay Bakshi, Chenglong Wang, Simra Shahid
similarity 0.58
Abstract · IEEE VIS 2026 (VISxGenAI Workshop)

There are often multiple valid visualizations, spanning different chart types, visual encodings, and aesthetic choices, that can all support a user's goal of analyzing a dataset. Determining which of these candidate visualizations is most appropriate, however, remains challenging. Prior work has leveraged expert-curated taxonomies to guide visualization design and subsequent quality evaluation, a practical evaluation model must also account for human-centric factors. Latest visualization tools integrate Large Language Models (LLMs) to generate and refine visualizations, using LLM-as-a-judge to provide design feedback. Without a deeper understanding of whether, and in what ways, human and LLM perceptions of visualizations align, there is a real risk of deploying low-quality agents that do not reflect human judgment. We study this question through a pilot experiment - we formulate the problem as a preference task over curated chart pairs and compare the judgments of state-of-the-art vision models with those of a panel of human annotators. We establish a cautionary tale: such judges risk filtering out informative, compelling displays. We find that frontier models collapse human subjectivity, a rich signal that reveals contrasting design choices, into near-deterministic verdicts.

0.19