CS Paper Radar

Divided Attention Amplifies the Importance of Expectation-Aligned Visualization Design

Jiho Kim, Anna L. Chinni, Karen B. Schloss, Michael Gleicher

cs.HC ·submitted 2026-08-10 23:44 UTC · v1
published

Abstract

Studies have shown that visualization design affects interpretability when visualization interpretation is the user's sole task. However, in real-world settings, users often engage with visualizations while performing concurrent tasks, such as when users simultaneously monitor alerts or respond to messages. Such divided attention may alter how users interpret visualizations, potentially increasing the importance of designs that align with viewer expectations. We investigated this possibility through two experiments comparing visualization interpretation under single-task and dual-task conditions. Specifically, we examined how well-established inferred mappings between color, spatial position, and semantic concepts affect interpretation when users perform a concurrent task, both with unlimited viewing time (Exp. 1) and under limited viewing time (Exp. 2). Our results show that divided attention amplifies the performance gap between expectation-aligned and expectation-violating designs, affecting response time, interpretation accuracy, and the ability to produce a judgment under time constraints. To explain these results, we model the user's decision-making process using a Linear Ballistic Accumulator (LBA) framework. Our findings highlight the increased importance of aligning visualization designs with viewer expectations under divided attention and introduce a process-oriented modeling approach to understanding how expectation and multitasking shape visualization interpretation.

Comment
33 pages, 22 figures (11 pages, 5 figures for the main text; 22 pages, 17 figures for the supplementary material), to be published in IEEE Transactions on Visualization and Computer Graphics

Closest papers

Nearest neighbours by meaning across the whole index.

Crossing the Chasm: Bridging Visual Augmentations and Designer Intent

cs.HC ·2026-10-28 ·Luke S. Snyder, Maureen C. Stone, Jeffrey Heer
published similarity 0.63
Abstract · 23 pages, 17 figures, 2 tables, appendix, IEEE TVCG 2026

To direct attention and communicate context, visualization designers often employ augmentations such as annotations, animated transitions, and stylistic layouts. While graphical perception principles can helpfully prescribe effective low-level representations of data, they lack guidance for augmentations that service higher-level communication goals. To bridge this gap, we contribute a design space that frames designer intent as viewer-oriented cognitive behaviors, grounding communicative aims in actionable visualization design techniques, including both visual encodings and augmentations. This design space consists of common augmentation tactics (annotation, animation, stylized encodings, etc.) that implement design strategies (spotlighting, sequencing, association, etc.) to achieve higher-level design goals (observe, interpret, introspect), often simultaneously. We demonstrate the analytic and generative value of our design space with examples across varied designer objectives. We discuss how our contributions help align designer intent with reader takeaways, pave the way for readers to learn more effectively, and enable future (semi-)automated systems to support visualization designers in achieving their communication goals.

0.58

"Piecing Data Connections Together Like a Puzzle": Effects of Increasing Task Complexity on the Effectiveness of Data Storytelling Enhanced Visualisations

cs.HC ·2026-09-15 ·Mikaela Elizabeth Milesi, Paola Mejia-Domenzain, Laura Brandl, Vanessa Echeverría, Yueqiao Jin +4 more
top venuehighly cited similarity 0.61
Abstract · Accepted manuscript; the first two authors contributed equally. Published version (CC BY 4.0) in CHI '25, DOI: 10.1145/3706598.3714270

The emerging concept of data storytelling (DS) suggests that enhancing visualisations with annotations and narratives can make complex data more insightful than conventional visualisations. Previous works found that DS-enhanced visualisations are more effective than conventional visualisations for simple tasks like identifying key data points or the main message. However, no previous work has explored the extent to which DS enhancements influence task completion across different levels of cognitive complexity. We address this gap by presenting the results of a study where 128 participants completed tasks based on four visualisations (two line charts and two choropleth maps, either with or without DS elements) spanning a range of complexity based on Bloom's taxonomy, which has been applied in data visualisation to categorise tasks hierarchically from lower to higher-order thinking. Results suggest that while DS-enhanced visualisations effectively support lower-order tasks (finding data points and understanding insights), they don't necessarily aid the correct completion of higher-order tasks (application, analysis, evaluation and creation). However, DS enhancements improve how efficiently participants complete complex tasks.

0.58

Evaluating Human-LLM Alignment on Visualization Preference

cs.HC ·2026-11-04 ·Tanmay Bakshi, Chenglong Wang, Simra Shahid
similarity 0.61
Abstract · IEEE VIS 2026 (VISxGenAI Workshop)

There are often multiple valid visualizations, spanning different chart types, visual encodings, and aesthetic choices, that can all support a user's goal of analyzing a dataset. Determining which of these candidate visualizations is most appropriate, however, remains challenging. Prior work has leveraged expert-curated taxonomies to guide visualization design and subsequent quality evaluation, a practical evaluation model must also account for human-centric factors. Latest visualization tools integrate Large Language Models (LLMs) to generate and refine visualizations, using LLM-as-a-judge to provide design feedback. Without a deeper understanding of whether, and in what ways, human and LLM perceptions of visualizations align, there is a real risk of deploying low-quality agents that do not reflect human judgment. We study this question through a pilot experiment - we formulate the problem as a preference task over curated chart pairs and compare the judgments of state-of-the-art vision models with those of a panel of human annotators. We establish a cautionary tale: such judges risk filtering out informative, compelling displays. We find that frontier models collapse human subjectivity, a rich signal that reveals contrasting design choices, into near-deterministic verdicts.

0.19

Predicting affective connotation of visualizations from their constituent colors

cs.HC ·2026-08-10 ·Karen B. Schloss, Halle C. Braun, Kushin Mukherjee, Anna L. Chinni, Seth R. Gorelik
published similarity 0.61
Abstract · To be published in IEEE Transactions on Visualization and Computer Graphics

With increasing evidence that affective connotation (emotional association) is an important aspect of visual communication, there is a need for methods to predict affective connotation of visualizations. Many aspects of visualization design, including colors, textures, and shapes, can contribute to affective connotation, and a key question is how multiple design properties combine to determine the emotion association of a whole visualization. In this study, we focused specifically on color and tested whether it is possible to predict the affective connotation of whole visualizations by aggregating the emotion associations of the individual, constituent colors (additivity hypothesis). We also tested whether accounting for the size of colored regions, as determined by the underlying dataset, improved predictions (data-dependence hypothesis). We found that for colormap data visualizations in which colors were well-distributed across all colors in the color scale, the mean estimated associations of individual colors effectively predicted emotional associations of the maps as a whole (additivity; Exp. 1). For colormaps whose underlying datasets were biased to map more to colors at one end of the color scale, emotional associations were better predicted by a weighted mean that accounted for color frequency in the colormap (data-dependence; Exp. 2). Effects of additivity and data-dependence generalized to dot plots and bar charts (Exp. 3). These results suggest it is viable to predict affective connotation of whole visualizations from their individual design components, which has important implications for automating affective visualization design to support visual communication.

0.16

Perception or Reasoning? Diagnosing and Tackling Reinforcement Learning Bottlenecks in VLMs

cs.CV ·2026-10-15 ·Zeyuan Yang, Zhuohao Chen, Jiaben Chen, Yao Zhang, Maohao Shen +1 more
benchmark similarity 0.60
Abstract

Reinforcement learning has brought strong gains to language model reasoning, but its improvements on visual tasks remain less consistent. One difficulty is that visual task failures can arise from different sources: the same benchmark may be limited by perception for one model and by reasoning for another. We introduce Perception and Reasoning Attribution (PARA), which measures the remaining perceptual and reasoning headroom of each model--benchmark pair by comparing how many current errors are recovered with more accurate visual information versus a stronger reasoner. Across 4 vision-language models and 17 multimodal benchmarks, PARA broadly agrees with the expected characteristics of existing benchmarks while revealing substantial model-specific variation. More importantly, it shows that RL gains become smaller as perceptual headroom increases, but larger when reasoning explains more of the recoverable errors, suggesting that current RL exploits reasoning headroom more effectively than perceptual headroom. Motivated by this gap, we analyze how existing RL objectives affect visual perception and find that reward- and token-level signals influence visual attention only indirectly. We therefore propose GRAD, a group-relative attention distillation objective that uses the best rollout in each group to directly guide the visual attention of weaker rollouts. GRAD consistently improves performance across two model scales and seven benchmarks, and further complements existing RL methods.

0.38

The Whole Warps the Parts: Attentional Certainty Modulates Ensemble-Induced Bias in Visualizations

cs.HC ·2026-11-17 ·Jennifer E. Corbett, Brian W. Anthony
similarity 0.60
Abstract

Data visualizations often require viewers to extract both ensemble statistics and individual values from collections of graphical marks. Yet individual items embedded within an ensemble can be systematically biased by that context. Prior studies have reported both repulsion away from and attraction toward ensemble statistics, but these effects have been observed across different conditions. We test whether task or attentional certainty explains these opposing forms of ensemble-induced bias. In Study 1, observers briefly viewed ensembles of differently sized circles and then judged the size of an individual circle embedded within the ensemble. Using a common stimulus generation framework, we tested both identification and discrimination when the target was specified before or after the ensemble, and an additional no-cue identification condition without a specified target. Under the shared cued conditions, effects were predominantly repulsive or near zero in both identification and discrimination. In contrast, eliminating target-specific information reversed ensemble-induced bias from repulsion to attraction. Identification precision also decreased systematically from pre-cue to post-cue to no-cue conditions. Study 2 replicated this cue-dependent pattern in graphical displays of startup valuations and precinct vote contributions. Our findings isolate attentional certainty as a key determinant of whether ensemble context repels or attracts individual-item representations, extending the design question beyond precision to how attention directing choices determine which bias the viewer will be operating under.

0.43

Model Literacy: An Extra Summative Evaluation Factor for Visual Analytics

cs.HC ·2026-08-19 ·Lei Xia, Siyu Wu, Haodian Li, Ye Sun, Liang Zhou +1 more
similarity 0.59
Abstract

Understanding and enhancing visual analytics (VA) performance is important for maximizing their impact. Existing studies have successfully applied well-established summative evaluation methods from information visualization to the VA context, yet the recent emphasis on an extra data analysis/modeling stage in the VA pipeline poses an additional challenge. Inspired by the modern concept of visualization literacy, this paper examines model literacy, namely users' knowledge of the analysis model used in a VA technique, as an additional factor for VA performance. Results from a controlled study on the visual analysis of multidimensional data with two dimensionality-reduction models indicate a positive correlation between model-task accuracy and VA-task accuracy. The study involves two common dimensionality-reduction models, PCA and t-SNE. The correlation is stronger for PCA than for t-SNE in the current task design, a pattern consistent with the possibility that VA effectiveness is more closely associated with model literacy when model outputs are less directly readable from the visualization. Completion-time evidence does not show a stable efficiency gain, suggesting that differences in model intuitiveness may help explain when model knowledge shortens task completion and when it involves additional interpretive effort. The findings of this study suggest ways to further enrich VA evaluation methods and provide directions for developing more rigorous model-literacy assessment instruments.

0.10

Humanity's Sixth Sense: Benchmarking Intuitive Visual Reasoning in Multimodal Models

cs.AI cs.MM ·2026-10-06 ·Xingang Guo, Jing Gu, Brian Jang, Renxiong Wang, Utkarsh Tyagi +24 more
benchmark similarity 0.59
Abstract

Humans perceive far more in a scene than what is explicitly depicted: a single glance captures past causes and future trajectories; a quick peek determines if a vehicle can fit between two parked cars; a few seconds of video reveals who holds authority in a room; and a fleeting clip highlights subtle abstract patterns like unwritten rules or hidden labels. This capacity reflects a form of humanity's sixth sense: an intuitive reasoning mechanism that recovers implicit information beyond raw sensory perception. Crucially, this rapid, zero-shot visual intuition underpins everyday navigation and social interaction, making it a vital capability for Multimodal Large Language Models (MLLMs) deployed alongside people. Existing visual benchmarks, however, target either deliberate expert-level analysis in academic and mathematical domains or low-level perception, leaving the intuitive reasoning that people perform largely untested. To bridge this gap, we introduce Humanity's Sixth Sense (HSS), a benchmark for intuitive visual reasoning. HSS spans diverse image and video inputs, organizes items under a structured taxonomy, and pairs each with human-written prompts probing the implicit temporal, spatial, social, and abstract structure that people infer at a glance. Frontier MLLMs fall short of human performance: participants reach 93.1% accuracy, while the strongest model, GPT-6-astra, reaches only 53.6% even at maximum reasoning effort. Despite excelling in many complex tasks that require advanced perception and knowledge, current models still struggle significantly on these visual tasks that are intuitive for humans. We further explore agentic setup that apply dynamic visual manipulation to HSS, which narrows but does not close the gap. HSS establishes intuitive visual reasoning as a measurable axis and directs attention to a capability that scaling on current benchmarks has so far left behind.

0.37