CS Paper Radar

Sounds Uncertain: Exploring the Affective Aspects of Sonification for Uncertainty Visualization

Marcel-Simon Dutt, Sita A. Vriend, Elias Elmquist, Daniel Weiskopf

cs.HC cs.SD ·submitted 2026-08-19 08:31 UTC · v1
published

Abstract

Affective visualization can influence how users perceive, interpret, and engage with data by embedding and conveying emotion through visual design. While sound is widely used in media to evoke emotions, little is known about how sonification can support affective visualization. In this work, we investigate how sonification can communicate emotion in uncertainty visualizations through a co-design study. Participants created two sonifications to accompany a visualization: one conveying the affective component of uncertainty and one conveying neutrality. Our findings show that uncertainty was commonly associated with wavy auditory qualities related to an ominous sentiment. On the other hand, neutrality was associated with clear and relaxing auditory qualities. These results provide insights for the design of visualizations that integrate sonification to communicate the affective component of uncertainty.

Comment
Accepted to IEEE Workshop on Uncertainty Visualization

Closest papers

Nearest neighbours by meaning across the whole index.

Juicy Interactive Visualization: Evaluating How Excessive Feedback Design Shapes Visualization Engagement

cs.HC ·2026-10-06 ·Shano Liang, Max Chen, Lane Harrison
similarity 0.60
Abstract · 11 pages, 3 figures

Visualization research has long examined embellishment and animation, while the design of rich interaction-contingent feedback remains under-articulated as a systematic design space. We introduce JuicyVIS, a theory-informed operationalization of juicy feedback for interactive visualization that translates ideas from game studies into a visualization-centered framework. JuicyVIS introduces three dimensions, interaction type, feedback timing, and feedback intensity, which we explore through 26 controlled prototypes, grounded in established visualization interaction categories and prior work on juicy feedback in games. We evaluate the juicy design space through three exploratory mixed-methods online studies. Results show that juicy feedback was consistently associated with higher engagement and aesthetic experience, while the clearest gains came from post-interaction feedback, not, for example, by simply increasing intensity. We discuss how juicy feedback can be thought of as a design material in visualizations, shaping how visualization interactions feel, how action consequences are perceived, and how users remain engaged with data representations.

0.14

Bringing Data to Life: Designing Data Characters for the Emotional Self

cs.HC ·2026-08-28 ·Diego Abarcar Calugay, Isabella Amador, Keke Wu
similarity 0.59
Abstract · IEEE VIS Poster and Summary (2026)

Journaling is a common practice for emotional expression, reflection, and processing. However, as entries accumulate, it can become difficult to interpret and compare their affective content, especially since traditional text-based analyses and visualizations often struggle to convey affective nuance. We introduce Data Characters, a visualization approach that represents affective content in journaling through human-like characters. Using a customizable Data Character as a design probe, we investigate the potential of character-based representations for conveying affective experiences and explore what visual encodings emerge through customization. Preliminary walkthroughs with two participants demonstrate the intuitiveness and feasibility of the approach. This work contributes an exploratory approach to studying how affective experiences can be visually represented and encoded through anthropomorphic forms.

0.14

Crossing the Chasm: Bridging Visual Augmentations and Designer Intent

cs.HC ·2026-10-28 ·Luke S. Snyder, Maureen C. Stone, Jeffrey Heer
published similarity 0.58
Abstract · 23 pages, 17 figures, 2 tables, appendix, IEEE TVCG 2026

To direct attention and communicate context, visualization designers often employ augmentations such as annotations, animated transitions, and stylistic layouts. While graphical perception principles can helpfully prescribe effective low-level representations of data, they lack guidance for augmentations that service higher-level communication goals. To bridge this gap, we contribute a design space that frames designer intent as viewer-oriented cognitive behaviors, grounding communicative aims in actionable visualization design techniques, including both visual encodings and augmentations. This design space consists of common augmentation tactics (annotation, animation, stylized encodings, etc.) that implement design strategies (spotlighting, sequencing, association, etc.) to achieve higher-level design goals (observe, interpret, introspect), often simultaneously. We demonstrate the analytic and generative value of our design space with examples across varied designer objectives. We discuss how our contributions help align designer intent with reader takeaways, pave the way for readers to learn more effectively, and enable future (semi-)automated systems to support visualization designers in achieving their communication goals.

0.58

Vibe Analysis: Exploring LLM Adoption by Data Visualization Practitioners

cs.HC cs.AI ·2026-09-25 ·Shani C Spivak, Aditi Krishna, Mahsan Nourani, Melanie Tory
published similarity 0.58
Abstract

Large language models (LLMs) are enticing in their promise to support data visualization (Vis) through faster and simpler workflows for data prep, analysis, and visualization creation. Yet LLMs are notoriously error-prone and not built for data visualization tasks. Few studies have explored LLM adoption among Vis practitioners. To fill this gap, we conducted semi-structured interviews with members of the Data Visualization Society, a global community of data visualization designers. Our findings show that Vis designers actively use LLMs for both creative and technical aspects of the visualization process. A new visualization workflow is emerging, a process we call vibe analysis, analogous to vibe coding. Some key challenges raised by participants parallel those of vibe coding, while others are Vis-specific, like gaps in Vis knowledge and chart verification. This work opens up opportunities for research combining LLM-mediated work with Vis tools that incorporate data visualization guidance, constraints, and best practices.

0.14

Art2Song: Enhancing Visual Art Appreciation with Contextual Music Generation

cs.HC ·2026-09-05 ·Sungeun Jo, Myung Jin Kim, Chi Yoon Jeong
top venue similarity 0.57
Abstract · 3 pages, 1 figure, To appear in the Adjunct Proceedings of the 39th Annual ACM Symposium on User Interface Software and Technology (UIST Adj…

Art2Song is a conceptual framework that expresses artworks as sound by separating Non-Visual Context, which is difficult to perceive from the image alone, from Visual Evidence. Visual Evidence, such as objects, colors, and spatial composition, is transformed into Lyrics, while the Contextual Mood derived from the historical and art-historical context in the museum's artwork description is reflected in the background soundtrack. Rather than describing artworks textually, Art2Song aims to explore the possibility of a new mode of art appreciation in which viewers experience hidden stories and emotional context through music. As future interaction directions, we plan an Emotional Layer Blending Slider interface and a structured, traceable song-generation scenario, presenting the possibility that users can explore the relationship between Visual Evidence and Contextual Mood.

0.27

Predicting affective connotation of visualizations from their constituent colors

cs.HC ·2026-08-10 ·Karen B. Schloss, Halle C. Braun, Kushin Mukherjee, Anna L. Chinni, Seth R. Gorelik
published similarity 0.57
Abstract · To be published in IEEE Transactions on Visualization and Computer Graphics

With increasing evidence that affective connotation (emotional association) is an important aspect of visual communication, there is a need for methods to predict affective connotation of visualizations. Many aspects of visualization design, including colors, textures, and shapes, can contribute to affective connotation, and a key question is how multiple design properties combine to determine the emotion association of a whole visualization. In this study, we focused specifically on color and tested whether it is possible to predict the affective connotation of whole visualizations by aggregating the emotion associations of the individual, constituent colors (additivity hypothesis). We also tested whether accounting for the size of colored regions, as determined by the underlying dataset, improved predictions (data-dependence hypothesis). We found that for colormap data visualizations in which colors were well-distributed across all colors in the color scale, the mean estimated associations of individual colors effectively predicted emotional associations of the maps as a whole (additivity; Exp. 1). For colormaps whose underlying datasets were biased to map more to colors at one end of the color scale, emotional associations were better predicted by a weighted mean that accounted for color frequency in the colormap (data-dependence; Exp. 2). Effects of additivity and data-dependence generalized to dot plots and bar charts (Exp. 3). These results suggest it is viable to predict affective connotation of whole visualizations from their individual design components, which has important implications for automating affective visualization design to support visual communication.

0.16

ResonaVis: Visualizing Interactive Music Data to Support Reflective Music Composition for Therapeutic Contexts

cs.HC ·2026-08-11 ·Abhishek Karwankar, Elise Ruggiero, Daniel Stevens, Matthew Louis Mauriello
published similarity 0.55
Abstract · 9 pages core, 2 pages acknowledgements + references, 2 pages appendices. Accepted at IEEE VIS 2026, to appear in November 2026

Designing music for therapeutic contexts requires navigating complex relationships between musical structure and listeners' sensory responses, yet composers often lack structured representations of these interactions, relying instead on intuition. We present ResonaVis, an interactive visualization system that helps composers analyze interaction and audio data from prior sessions with children with Autism Spectrum Disorder (ASD), informing future compositions. ResonaVis integrates audio features and interaction logs to capture how children engage with layered musical compositions, representing this engagement through coordinated visualizations of temporal transitions, layer co-occurrence, rhythmic activity, and spectral characteristics. Rather than prescribing strategies or supporting therapy sessions directly, the system surfaces patterns in past session data to support data-informed reflection during composition. We evaluated ResonaVis through a mixed-methods study with eight music students and a follow-up case study with two experienced composers. Results demonstrate good usability (SUS = 72.23), exceeding benchmarks for early prototypes, and show that participants could identify interaction patterns, reason about layer relationships, and make informed compositional decisions with high perceived performance and low frustration. Confidence in interpreting interaction and acoustic data for ASD-focused composition increased significantly across multiple dimensions (p < 0.05), with qualitative findings suggesting a shift toward more adaptive, data-informed composition. This work contributes a visualization design space for therapeutic music interaction data, an integrated system for compositional reflection, and empirical evidence that visualization tools support analytical reasoning and confidence in data-informed creative practice. (Abstract shortened for arXiv.)

0.25

Colour Blinded by the Noise

cs.HC stat.ME ·2026-08-18 ·Harriet Mason, Rachel Rogers, Alison Kleffner, Dianne Cook
published similarity 0.54
Abstract · To be presented at IEEE VIS 2026 and published in IEEE TVCG in 2027

Uncertainty visualisation is important for data transparency, especially for map visualisations where data is often aggregated. Despite the importance of this area, studies evaluating uncertainty visualisation lack consensus and produce conflicting results. This work introduces a new evaluation approach for uncertainty visualisation that attempts to assess uncertainty as noise, rather than signal. We evaluate five methods of visualising uncertainty: standard choropleth maps, value/variance bivariate maps, value-suppressing uncertainty palettes, overlaid sampling, and pixelated sampling maps. Built on principles of implicit testing, we put an 'uncertainty visualisation' spin on the classic Ishihara colourblind test to create a novel test that is able to evaluate uncertainty as noise. We compare signal visibility to conventional hypothesis tests at various levels of group separation. By building our experimental design on top of established graphics theory, we isolate the plot components that facilitate successful signal suppression and establish foundational theory for the perception of uncertainty visualisation.

0.53