CS Paper Radar

"Piecing Data Connections Together Like a Puzzle": Effects of Increasing Task Complexity on the Effectiveness of Data Storytelling Enhanced Visualisations

Mikaela Elizabeth Milesi, Paola Mejia-Domenzain, Laura Brandl, Vanessa Echeverría, Yueqiao Jin, Dragan Gašević, Yi-Shan Tsai, Tanja Käser, Roberto Martínez-Maldonado

cs.HC ·submitted 2026-09-15 14:52 UTC · v1
top venuehighly cited

Abstract

The emerging concept of data storytelling (DS) suggests that enhancing visualisations with annotations and narratives can make complex data more insightful than conventional visualisations. Previous works found that DS-enhanced visualisations are more effective than conventional visualisations for simple tasks like identifying key data points or the main message. However, no previous work has explored the extent to which DS enhancements influence task completion across different levels of cognitive complexity. We address this gap by presenting the results of a study where 128 participants completed tasks based on four visualisations (two line charts and two choropleth maps, either with or without DS elements) spanning a range of complexity based on Bloom's taxonomy, which has been applied in data visualisation to categorise tasks hierarchically from lower to higher-order thinking. Results suggest that while DS-enhanced visualisations effectively support lower-order tasks (finding data points and understanding insights), they don't necessarily aid the correct completion of higher-order tasks (application, analysis, evaluation and creation). However, DS enhancements improve how efficiently participants complete complex tasks.

Comment
Accepted manuscript; the first two authors contributed equally. Published version (CC BY 4.0) in CHI '25, DOI: 10.1145/3706598.3714270
Journal ref
Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems (CHI '25), Yokohama, Japan, 2025
DOI
10.1145/3706598.3714270

Closest papers

Nearest neighbours by meaning across the whole index.

Harnessing LLMs Without Surrendering Control: Delegation Boundaries in Visual Data Storytelling Authoring

cs.HC ·2026-09-22 ·Zhuojun Jiang, Yuki Ueno, Chris Bryan
publishedcode/data similarity 0.67
Abstract · Accepted as a Short Paper at IEEE VIS 2026

Despite the emergence of large language models (LLMs) for visual data storytelling workflows, there are open questions about how authors decide what activities or tasks to entrust to them and what should be "protected" or maintained under human control. To investigate this, we interviewed a cohort of 12 expert visual data storytellers. Our analysis shows that participants rarely treated LLMs as autonomous storytellers. Instead, they tend to selectively delegate execution-oriented tasks to LLMs while retaining control over activities that shape narrative intent and story meaning. Our findings show that LLM assistance is most productive after human seeding and constraint-setting, and that it shifts labor from production to verification. We discuss design implications for boundary-aware authoring tools, data-grounded generation, low-fidelity ideation, and reporting practices for LLM-based visualization research. Supplemental materials for this paper are available at https://osf.io/hcnp6.

0.42

InsightChain: Optimized Chain-of-Insight Analytics for LLM-driven Data Visualization

cs.CL cs.HC ·2026-09-06 ·Hanya Sun, Chen Zhang, Sheng Liang, Yongyue Zhang, Yong Liu
top venue similarity 0.66
Abstract · EMNLP 2026 Findings

Large language models (LLMs) are increasingly used for automated data visualization, yet existing approaches often frame visualization generation as a single-step mapping from user query to figure or code, overlooking the iterative analytical reasoning process of expert analysts. We present InsightChain, a four-stage visualization prompting pipeline (Explore--Focus--Test--Present) that emulates expert analytical workflows, together with VG-COPRO, a vision-guided automatic prompt optimization (APO) method adapted to jointly optimize such multi-stage, executable pipelines. To address the evaluation gap for complex data visualization, we introduce the Insight Progression Metric (IPM), a rubric combining four text-based dimensions with a vision-based dimension. We assess IPM through a 100-chain human pilot and an expanded 300-chain agent-based evaluation spanning all ten domains. Experiments on public datasets show that InsightChain consistently outperforms competing prompting baselines. Existing APO methods fail to yield consistent gains on this multi-stage task, whereas VG-COPRO improves performance in both in-domain and cross-domain settings.

0.30

QUARTZ: Qualitative Understanding via Accessible Representation and Visualization

cs.HC ·2026-08-11 ·Omar Khan, JooYoung Seo
top venue similarity 0.65
Abstract · 24 pages, accepted at ASSETS 2026

Qualitative data visualizations -- concept maps, network graphs, Sankey diagrams, and coding stripes -- are integral to research practice, yet remain entirely inaccessible to blind and low-vision (BLV) researchers. While visualization has seen advanced multimodal solutions for quantitative charts, qualitative visualizations, and their non-linear, semantically rich structures have received no attention. We present QUARTZ, a web-based system that provides screen-reader-accessible, multimodal representations of qualitative data visualizations. Using the Rapid Iterative Testing and Evaluation (RITE) method, we conducted a user study with 8 BLV participants who completed 12 tasks across four visualization types. Our findings expose accessibility barriers unique to qualitative visualizations -- non-linear navigation breakdowns and semantic comprehension gaps absent from quantitative chart research---and document how iterative co-design with BLV users resolved them. We contribute empirical evidence and design guidelines for an underexplored visualization domain, advancing the infrastructure BLV researchers need to participate independently in qualitative inquiry.

0.35

Crossing the Chasm: Bridging Visual Augmentations and Designer Intent

cs.HC ·2026-10-28 ·Luke S. Snyder, Maureen C. Stone, Jeffrey Heer
published similarity 0.65
Abstract · 23 pages, 17 figures, 2 tables, appendix, IEEE TVCG 2026

To direct attention and communicate context, visualization designers often employ augmentations such as annotations, animated transitions, and stylistic layouts. While graphical perception principles can helpfully prescribe effective low-level representations of data, they lack guidance for augmentations that service higher-level communication goals. To bridge this gap, we contribute a design space that frames designer intent as viewer-oriented cognitive behaviors, grounding communicative aims in actionable visualization design techniques, including both visual encodings and augmentations. This design space consists of common augmentation tactics (annotation, animation, stylized encodings, etc.) that implement design strategies (spotlighting, sequencing, association, etc.) to achieve higher-level design goals (observe, interpret, introspect), often simultaneously. We demonstrate the analytic and generative value of our design space with examples across varied designer objectives. We discuss how our contributions help align designer intent with reader takeaways, pave the way for readers to learn more effectively, and enable future (semi-)automated systems to support visualization designers in achieving their communication goals.

0.58

VisPuzzle: Task-Aware Composite Visualization Construction

cs.HC ·2026-08-12 ·Zheng Wang, Zhiyang Shen, Lingyun Yu, Shixia Liu
published similarity 0.65
Abstract · Accepted by IEEE VIS 2026

Compositing multiple visualizations into a coherent whole remains challenging due to the vast design space and the need to balance the coverage of task-relevant data insights (e.g., trends and outliers), perceptual clarity, and aesthetic quality. In this paper, we present VisPuzzle, a task-aware method that formulates visualization composition as a stepwise search problem over a composition graph. In this graph, nodes represent either data composition operations (e.g., union, join) or visual composition operations that determine component relationships, spatial arrangements, or component proportions, and edges encode feasible transitions between operations. We employ Monte Carlo Graph Search to efficiently identify high-quality composition candidates from this graph, guided by a reward function that balances task relevance, perceptual effectiveness, and aesthetic coherence. A use case and a user study show that the top-ranked candidates produced by VisPuzzle align closely with human judgments of composition quality, demonstrating its utility in supporting principled and scalable visualization composition.

0.53

Dashboard Remixing: Goal-oriented Organization and Enrichment of Visualizations and Insights

cs.HC ·2026-11-08 ·Junran Yang, Leilani Battle, Jane Hoffswell
published similarity 0.64
Abstract

Dashboard creation requires iteratively authoring multiple views and organizing them into a structured format. However, creators often struggle to step back and assess their own work for organization and refinement due to cognitive limitations. In this work, we propose a pipeline to provide computational support for self-reflection during the design process. Our pipeline automatically infers analytical objectives, discovers implicit patterns, and structures those patterns to surface coherent analytical pathways. It further enriches existing dashboard designs by generating complementary visualizations and aggregating natural language insights based on relationships across data entities (e.g., contrasting, drill-down, and relatedness) to reveal chart connections. Our rule-based pipeline provides objective, verifiable feedback, offering an external perspective while enabling creators to tell their own data stories. Four case studies and six expert interviews demonstrate how this approach helps creators reflect on organizational alternatives and surface hidden analytical opportunities in a principled way, reducing the cognitive burden while encouraging deeper analytical exploration.

0.28

MuTable: Composable and Reusable Table Transformations for In-Situ Data Exploration

cs.HC ·2026-09-16 ·Fuling Sun, Devamardeep Hayatpur, Jane L. E, Nicole Sultanum, Haijun Xia
top venue similarity 0.63
Abstract · To be published in UIST 26

Tables are central to data work to support precise lookup and full detail, but they can be limiting for overview and pattern-finding tasks. Visualizations are then created to gain richer perceptual support. In practice, moving between tables and charts often requires maintaining parallel representations, introducing context switching, and extra coordination work. Building on prior hybrid table-visualization systems, we present MuTable, a prototype that reifies transformations as persistent, composable, and reusable modifiers to support in-situ data exploration. Users can reshape the table while retaining and adapting intermediate forms as their questions evolve. An expert interview with eight data workers suggests that MuTable can support coordination between representations, rapid exploration, and greater user agency in constructing visualizations, as a low-commitment exploration space.

0.43

Do the Numbers Match the Plot? Statistical-Visual Verification for Automated Exploratory Data Analysis

cs.HC cs.CV ·2026-08-12 ·Zixun Fu, Jian Huang, Maojun Sun, Yancheng Yuan
similarity 0.62
Abstract

Automated exploratory data analysis (EDA) systems can execute statistics correctly while producing misleading interpretations. For example, correlations may be driven by influential observations, and mean differences may arise from skewness, overlap, or sparse subgroups rather than broad distributional shifts. We present EDAgent, a sequential framework that performs targeted visual verification before report synthesis. For each finding, the system records the statistical result, generates a visualization request identifying relevant distributional features, creates the corresponding chart, and uses the observed pattern to retain, qualify, or reconsider the interpretation. We call this process statistical-visual verification. EDAgent includes VisPlan, an 8B-parameter model that converts visualization rationales into detailed chart plans. We evaluate 87 end-to-end reports on EDA-Bench using a six-dimension rubric and GPT-5.1 multimodal evaluation. Maximum-score proportions reached 87.4% for factuality and visual consistency, 93.1% for statistical-visual cross-validation, and 96.6% for analytical narrative. On 166 open-ended VisEval tasks, VisPlan improved the mean overall score from 4.55 (Qwen3-8B) to 4.62, with the largest gain in aesthetics. These descriptive results indicate that visual verification can make automated EDA reports more transparent about how statistical findings relate to underlying data structure.

0.04