CS Paper Radar

Predicting affective connotation of visualizations from their constituent colors

Karen B. Schloss, Halle C. Braun, Kushin Mukherjee, Anna L. Chinni, Seth R. Gorelik

cs.HC ·submitted 2026-08-10 19:37 UTC · v1
published

Abstract

With increasing evidence that affective connotation (emotional association) is an important aspect of visual communication, there is a need for methods to predict affective connotation of visualizations. Many aspects of visualization design, including colors, textures, and shapes, can contribute to affective connotation, and a key question is how multiple design properties combine to determine the emotion association of a whole visualization. In this study, we focused specifically on color and tested whether it is possible to predict the affective connotation of whole visualizations by aggregating the emotion associations of the individual, constituent colors (additivity hypothesis). We also tested whether accounting for the size of colored regions, as determined by the underlying dataset, improved predictions (data-dependence hypothesis). We found that for colormap data visualizations in which colors were well-distributed across all colors in the color scale, the mean estimated associations of individual colors effectively predicted emotional associations of the maps as a whole (additivity; Exp. 1). For colormaps whose underlying datasets were biased to map more to colors at one end of the color scale, emotional associations were better predicted by a weighted mean that accounted for color frequency in the colormap (data-dependence; Exp. 2). Effects of additivity and data-dependence generalized to dot plots and bar charts (Exp. 3). These results suggest it is viable to predict affective connotation of whole visualizations from their individual design components, which has important implications for automating affective visualization design to support visual communication.

Comment
To be published in IEEE Transactions on Visualization and Computer Graphics

Closest papers

Nearest neighbours by meaning across the whole index.

Ten Years Later: Replicating Two Color Discrimination Studies

cs.HC ·2026-08-25 ·Shadmaan Hye, Andrew M. McNutt, Katherine E. Isaacs
similarity 0.62
Abstract · 5 pages, 4 figures. Accepted in the VisXVision workshop at the IEEE VIS conference

Color discrimination is a fundamental aspect of visualization as it influences how people interpret visual encodings. Many visualization guidelines are informed by perceptual studies, yet relatively few have been replicated. Acknowledging that the interaction between human perception, visual tasks, and display technology can change over time, we replicate two crowdsourced color discrimination studies conducted 10 years earlier. Specifically, we replicated a visualization-focused color discrimination task (N=144) and a more general perceptual discrimination task (N=394). In both studies, our results reproduced the original perceptual effects. We further use the replication to investigate whether color-related practice influences color discrimination. Specifically, we extended our replication studies by adding questions about participants' engagement with color practices. We then examined whether diverse color-related practices (e.g., artistic hobbies, knowledge of color theory, and cosmetic makeup use) influenced color discrimination. We found no significant difference between participants who reported engaging in color-related practices and those who did not, suggesting that design guidance regarding color discrimination may generalize across viewers regardless of their regular color practice.

0.28

Divided Attention Amplifies the Importance of Expectation-Aligned Visualization Design

cs.HC ·2026-08-10 ·Jiho Kim, Anna L. Chinni, Karen B. Schloss, Michael Gleicher
published similarity 0.61
Abstract · 33 pages, 22 figures (11 pages, 5 figures for the main text; 22 pages, 17 figures for the supplementary material), to be published in IEEE T…

Studies have shown that visualization design affects interpretability when visualization interpretation is the user's sole task. However, in real-world settings, users often engage with visualizations while performing concurrent tasks, such as when users simultaneously monitor alerts or respond to messages. Such divided attention may alter how users interpret visualizations, potentially increasing the importance of designs that align with viewer expectations. We investigated this possibility through two experiments comparing visualization interpretation under single-task and dual-task conditions. Specifically, we examined how well-established inferred mappings between color, spatial position, and semantic concepts affect interpretation when users perform a concurrent task, both with unlimited viewing time (Exp. 1) and under limited viewing time (Exp. 2). Our results show that divided attention amplifies the performance gap between expectation-aligned and expectation-violating designs, affecting response time, interpretation accuracy, and the ability to produce a judgment under time constraints. To explain these results, we model the user's decision-making process using a Linear Ballistic Accumulator (LBA) framework. Our findings highlight the increased importance of aligning visualization designs with viewer expectations under divided attention and introduce a process-oriented modeling approach to understanding how expectation and multitasking shape visualization interpretation.

0.22

Toward AI-Friendly Cartography: Understanding How Color Design Influences Foundation Model Spatial Reasoning on Sequential Choropleth Maps

cs.AI ·2026-08-16 ·Yonghe Sun, Zhenjia Liu, Hua Liao, Wenjia Xu, Nai Yang +2 more
benchmarkcode/data similarity 0.60
Abstract · 42 pages, 12 figures, 13 tables

Foundation models (FMs) increasingly support multimodal and geospatial reasoning, yet it remains unclear whether cartographic principles designed for human perception are equally effective for machines. Focusing on sequential choropleth maps, we examine how hue palette, color ordering, and lightness contrast influence FM spatial reasoning. We construct a controlled benchmark of 5,760 maps and 28,800 questions spanning Attribute Identify, Spatial Recognition, Compare, Rank, and Pattern Delineate, and evaluate 21 open-source and proprietary multimodal FMs. Results show that hue choice has limited and inconsistent effects, whereas disrupting sequential color ordering substantially reduces performance, especially for comparison and ranking. Reduced lightness contrast also consistently impairs reasoning, while increasing contrast beyond sufficient separability provides only marginal gains. LoRA fine-tuning improves overall accuracy but preserves these relative sensitivities. Additional factorial experiments further indicate that errors arise from color-and-legend decoding, spatial reasoning, and the integration of thematic attributes with spatial structure. These findings show that conventional sequential ordering and sufficient contrast remain important for machine map understanding and provide empirical guidance for AI-friendly cartographic design.

0.26

Bringing Data to Life: Designing Data Characters for the Emotional Self

cs.HC ·2026-08-28 ·Diego Abarcar Calugay, Isabella Amador, Keke Wu
similarity 0.60
Abstract · IEEE VIS Poster and Summary (2026)

Journaling is a common practice for emotional expression, reflection, and processing. However, as entries accumulate, it can become difficult to interpret and compare their affective content, especially since traditional text-based analyses and visualizations often struggle to convey affective nuance. We introduce Data Characters, a visualization approach that represents affective content in journaling through human-like characters. Using a customizable Data Character as a design probe, we investigate the potential of character-based representations for conveying affective experiences and explore what visual encodings emerge through customization. Preliminary walkthroughs with two participants demonstrate the intuitiveness and feasibility of the approach. This work contributes an exploratory approach to studying how affective experiences can be visually represented and encoded through anthropomorphic forms.

0.14

Seeing Red, Thinking Bad: Color Bias in Vision Language Models

cs.CV cs.AIcs.CL ·2026-08-14 ·Kohsuke Ide, Ryousuke Yamada, Yoshihiro Fukuhara, Hirokatsu Kataoka, Yutaka Satoh
publishedcode/data similarity 0.59
Abstract · 15 pages. Accepted to ICPR 2026

Vision language models (VLMs) are increasingly used in industrial decision-making systems, such as recruitment support and recommendation. This motivates careful analysis of how VLMs process visual and textual information. In this work, we study how VLMs interpret text rendered as an image, and investigate the influence of visual styling biases. To this end, we introduce Stealth Visual Prompts, which subtly change visual styling of text, such as color and contrast, while preserving semantic content. Using these prompts, we systematically control the visual styling of words in text and measure their impact on the analysis performed by VLMs. We further analyze how such visual perturbations affect the latent representations of the vision encoder. From our experiments, we observed that coloring positive words in green consistently shifts sentiment predictions toward a positive direction. As a result, VLMs often fail to properly account for negative words present in the text. Our analysis suggests that this behavior is correlated with changes in the latent representations of the vision encoder induced by color variations. In addition, we show that reducing text--background contrast increases reliance on visually salient cues and leads to more incorrect Visual Question Answering (VQA) outputs. These results suggest that the visual styling of rendered text can guide VLMs' interpretation in ways that diverge from human semantic understanding. Project page: https://github.com/KohsukeIde/color-bias-vlm

0.49

CatPAL: Task-Aware Learning for Categorical Palette Recommendation

cs.HC ·2026-08-10 ·Chin Tseng, Arran Zeyu Wang, Yunqi Li, Danielle Albers Szafir
similarity 0.57
Abstract

Designing effective categorical palettes requires balancing a range of factors, including perceptual distinctiveness, category count, and task effectiveness. The effectiveness of categorical encodings can vary substantially depending on the target analytical tasks; however, existing recommendation tools largely ignore task context when evaluating palette quality, resulting in inconsistent performance across tasks. We synthesize findings from a series of multi-stage user studies into a unified model of task-based effectiveness for color encodings, shape encodings, and their redundant combination across category counts and seven common scatterplot tasks. Our results show that task and palette choice jointly influence perceptual accuracy: different color and shape palettes exhibit varying levels of robustness across tasks, indicating that palette effectiveness is task-dependent. We estimate task-specific perceptual strengths for 39 colors and 39 shapes using Bradley-Terry models, refined through adaptive sampling to target uncertain and task-sensitive comparisons. We further quantify cross-channel interactions using a redundant gain Delta G metric to model performance across color and shape pairings. We then train a predictive model that scores candidate palettes based on task, category count, and perceptual features. This model drives effective palette recommendations in CatPAL, a task-aware palette recommendation system grounded in empirical data responsive to user constraints. Our findings highlight the importance of selecting categorical palettes aligned with specific analytical tasks and demonstrate how task-aware modeling enables more reliable palette design. CatPAL translates empirical results into a practical tool that supports user-specified colors or shapes and returns ranked palette recommendations adaptable to a range of tasks.

0.04

Colour Blinded by the Noise

cs.HC stat.ME ·2026-08-18 ·Harriet Mason, Rachel Rogers, Alison Kleffner, Dianne Cook
published similarity 0.57
Abstract · To be presented at IEEE VIS 2026 and published in IEEE TVCG in 2027

Uncertainty visualisation is important for data transparency, especially for map visualisations where data is often aggregated. Despite the importance of this area, studies evaluating uncertainty visualisation lack consensus and produce conflicting results. This work introduces a new evaluation approach for uncertainty visualisation that attempts to assess uncertainty as noise, rather than signal. We evaluate five methods of visualising uncertainty: standard choropleth maps, value/variance bivariate maps, value-suppressing uncertainty palettes, overlaid sampling, and pixelated sampling maps. Built on principles of implicit testing, we put an 'uncertainty visualisation' spin on the classic Ishihara colourblind test to create a novel test that is able to evaluate uncertainty as noise. We compare signal visibility to conventional hypothesis tests at various levels of group separation. By building our experimental design on top of established graphics theory, we isolate the plot components that facilitate successful signal suppression and establish foundational theory for the perception of uncertainty visualisation.

0.53

Vibe Analysis: Exploring LLM Adoption by Data Visualization Practitioners

cs.HC cs.AI ·2026-09-25 ·Shani C Spivak, Aditi Krishna, Mahsan Nourani, Melanie Tory
published similarity 0.57
Abstract

Large language models (LLMs) are enticing in their promise to support data visualization (Vis) through faster and simpler workflows for data prep, analysis, and visualization creation. Yet LLMs are notoriously error-prone and not built for data visualization tasks. Few studies have explored LLM adoption among Vis practitioners. To fill this gap, we conducted semi-structured interviews with members of the Data Visualization Society, a global community of data visualization designers. Our findings show that Vis designers actively use LLMs for both creative and technical aspects of the visualization process. A new visualization workflow is emerging, a process we call vibe analysis, analogous to vibe coding. Some key challenges raised by participants parallel those of vibe coding, while others are Vis-specific, like gaps in Vis knowledge and chart verification. This work opens up opportunities for research combining LLM-mediated work with Vis tools that incorporate data visualization guidance, constraints, and best practices.

0.14