CS Paper Radar

The CAPED Framework: Characterizing User Skills in Chart Authoring through the Lens of Tasks and Tools

Bongshin Lee, Zhicheng Liu, John Thompson, Chenglong Wang

cs.HC ·submitted 2026-10-26 00:34 UTC · v1
published

Abstract

In this paper, we introduce a new framework for characterizing the user skills required for chart authoring. Despite growing attention to authoring systems, we lack a conceptual framework that characterizes the diverse and multifaceted skills involved and helps identify opportunities for system design and development. Our initial investigation revealed that skill is a complex and elusive concept, and that existing theories on skills from other disciplines are too high-level to capture the importance of tasks and tools in data visualizations. To address this gap, we formulate the CAPED framework that characterizes skill as the ability to create a chart involving five dimensions pertinent to tasks and tools: input data, output chart, paradigm, abstraction, and expression. We demonstrate the framework's descriptive power by highlighting different skills involved in similar authoring situations and identifying the types of knowledge associated with chart authoring. We further present examples illustrating how the framework can be used to identify new research opportunities in supporting users with varying skills.

Comment
Accepted at IEEE VIS 2026, to appear in IEEE Transactions on Visualization and Computer Graphics (TVCG)

Closest papers

Nearest neighbours by meaning across the whole index.

Dashboard Remixing: Goal-oriented Organization and Enrichment of Visualizations and Insights

cs.HC ·2026-11-08 ·Junran Yang, Leilani Battle, Jane Hoffswell
published similarity 0.69
Abstract

Dashboard creation requires iteratively authoring multiple views and organizing them into a structured format. However, creators often struggle to step back and assess their own work for organization and refinement due to cognitive limitations. In this work, we propose a pipeline to provide computational support for self-reflection during the design process. Our pipeline automatically infers analytical objectives, discovers implicit patterns, and structures those patterns to surface coherent analytical pathways. It further enriches existing dashboard designs by generating complementary visualizations and aggregating natural language insights based on relationships across data entities (e.g., contrasting, drill-down, and relatedness) to reveal chart connections. Our rule-based pipeline provides objective, verifiable feedback, offering an external perspective while enabling creators to tell their own data stories. Four case studies and six expert interviews demonstrate how this approach helps creators reflect on organizational alternatives and surface hidden analytical opportunities in a principled way, reducing the cognitive burden while encouraging deeper analytical exploration.

0.28

Chartography: A Benchmark for Professional Chart Understanding

cs.CV ·2026-08-11 ·Suhaas Garre, Chris Mutty, Sushant Mehta, Edwin Chen
publishedbenchmark similarity 0.64
Abstract · 16 pages, 5 figures, 5 tables. Accepted at the 2nd Workshop on Benchmarking Evidence-Aligned Multimodal Reasoning (BEAM 2), ECCV 2026

Professionals across medicine, engineering, finance, manufacturing, and the sciences often make consequential decisions from charts. Existing chart benchmarks do not sufficiently measure this ability: they are dominated by bar, line, and pie formats, rely on shorter reasoning chains, and are nearing saturation, with frontier models already scoring 80-90%. We introduce Chartography, a benchmark of 100 tasks that pair charts drawn from professional practice, in domain-specific formats that standard chart benchmarks rarely include, with questions written by professionals who read these charts for a living and independently verified by three additional experts. In an evaluation of 30 frontier-model configurations (20 scored trials per task), the best configuration reaches only 45.0% mean pass@1; the remainder span 9.0-39.5%. Failures concentrate in visual perception: models can miss nuanced features, misread values along sparsely labeled axes, mishandle projected 3D geometry, and violate domain conventions encoded in the chart. We release all tasks, images, provenance metadata, and evaluation code.

0.63

The Future of Visualization Dashboards in the Age of Generative AI

cs.HC ·2026-09-28 ·Vaishali Dhanoa, Duosi Dai, Gabriela Molina Léon, Eduard Gröller, Niklas Elmqvist
similarity 0.63
Abstract

Generative AI promises easier dashboard creation, raising questions about the future of dashboards and the people who create and use them. We interviewed 16 experts based in 14 countries about their practices and expectations. Almost all expected dashboards to persist for recurring questions, monitoring, and reporting. They anticipated adaptive views and combinations of language, graphical controls, and gestures, while emphasizing interaction as part of human exploration and understanding. Participants expected authors' responsibilities to shift toward specifying requirements, curating generated work, and evaluating outputs, with design knowledge and communication remaining important. Easier creation also raised concerns about validation effort, users' understanding, maintenance, and personalization weakening shared understanding. We discuss seven opportunities for research and practice concerning validation, end-user education, dashboard proliferation and rot, organizational guidance, adaptation, novel visualizations, and accountability for AI-generated content. Our findings connect dashboard evolution with the human and organizational work needed to sustain their use.

0.08

What Cognitive Accessibility Reveals About Data Visualization

cs.HC ·2026-08-17 ·Keke Wu, Jinjuan Heidi Feng, Jonathan Lazar
publishedposition similarity 0.63
Abstract · Accepted to the 3rd Workshop on Accessible Visualization at IEEE VIS 2026

Data visualization aims to augment human cognition and make data accessible to diverse audiences. As data increasingly shapes participation and decision-making across many domains, there is a growing need to examine whether prevailing assumptions in visualization adequately reflect the diversity of human abilities, experiences, and needs. We argue that cognitive accessibility provides a critical lens for examining these questions and functions as a stress test for visualization theory. Drawing on cognitive accessibility research and our experiences studying accessible visualization, we identify three interconnected assumptions that shape visualization research and practice: assumptions about what forms of cognition visualization supports, how accessibility is defined and measured, and whose needs and abilities are centered in design and evaluation. Making these assumptions explicit reveals opportunities to rethink longstanding approaches and open new directions. Ultimately, we believe that cognitive accessibility can serve as a catalyst for innovation, expanding what visualization supports, whom it serves, and the roles it plays in people's lives.

0.25

"Here Be Sharks!": Enhancing Scientific Communication and Analysis through Authoring Interactivity

cs.HC ·2026-09-08 ·Caroline Berger, Josh Pollock, Dylan Wooton, Arvind Satyanarayan, Clemens Nylandsted Klokmose
similarity 0.63
Abstract

We report on a case study for designing authoring environments for interactive visualizations to enhance scientific work. We conducted a workshop and prototype review with a group of marine biologists. When it came to visualizing their data, participants identified challenges in conveying their research accurately and completely as well as and analyzing it with ease. Based on our findings, authoring environments should consider the context of scientific work aspects such as domain expertise, collaboration culture, and publication traditions. We propose consideration of non-traditional programming languages and environments for scientific work, discuss ways of facilitating interactive visualizations for scientists, and examine ways of meaningfully integrating AI. The critiques, artifacts, and reactions from the scientists along with our analysis and discussion inform how computational tools should be designed for scientific work.

0.04

InsightChain: Optimized Chain-of-Insight Analytics for LLM-driven Data Visualization

cs.CL cs.HC ·2026-09-06 ·Hanya Sun, Chen Zhang, Sheng Liang, Yongyue Zhang, Yong Liu
top venue similarity 0.62
Abstract · EMNLP 2026 Findings

Large language models (LLMs) are increasingly used for automated data visualization, yet existing approaches often frame visualization generation as a single-step mapping from user query to figure or code, overlooking the iterative analytical reasoning process of expert analysts. We present InsightChain, a four-stage visualization prompting pipeline (Explore--Focus--Test--Present) that emulates expert analytical workflows, together with VG-COPRO, a vision-guided automatic prompt optimization (APO) method adapted to jointly optimize such multi-stage, executable pipelines. To address the evaluation gap for complex data visualization, we introduce the Insight Progression Metric (IPM), a rubric combining four text-based dimensions with a vision-based dimension. We assess IPM through a 100-chain human pilot and an expanded 300-chain agent-based evaluation spanning all ten domains. Experiments on public datasets show that InsightChain consistently outperforms competing prompting baselines. Existing APO methods fail to yield consistent gains on this multi-stage task, whereas VG-COPRO improves performance in both in-domain and cross-domain settings.

0.30

ggaction: A Grammar of Graphical Actions

cs.HC cs.GR ·2026-09-13 ·Hyeon Jeon, Jinwook Seo
code/data similarity 0.62
Abstract · 21 pages

A chart may be declarative; authoring it is not. Visualization grammars often describe charts as finished specifications, whereas people construct them through a sequence of authoring actions. This mismatch can make visualization code difficult for humans to interpret and for machines to generate from human intent. ggaction addresses this gap by modeling the chart authoring process itself. In ggaction, individual authoring actions are abstracted as functions, and the authoring process is expressed as a chain of these functions. This representation more closely aligns chart designers' authoring intent with code specifications, making the code easily understandable to both humans and machines, including language models. Through a series of evaluations, we show that ggaction is sufficiently expressive to capture common chart authoring intents and outperforms widely used visualization grammars, including Vega-Lite and ggplot2, in both human and machine interpretability. ggaction is available at github.com/ggaction/ggaction.

0.24

"Piecing Data Connections Together Like a Puzzle": Effects of Increasing Task Complexity on the Effectiveness of Data Storytelling Enhanced Visualisations

cs.HC ·2026-09-15 ·Mikaela Elizabeth Milesi, Paola Mejia-Domenzain, Laura Brandl, Vanessa Echeverría, Yueqiao Jin +4 more
top venuehighly cited similarity 0.62
Abstract · Accepted manuscript; the first two authors contributed equally. Published version (CC BY 4.0) in CHI '25, DOI: 10.1145/3706598.3714270

The emerging concept of data storytelling (DS) suggests that enhancing visualisations with annotations and narratives can make complex data more insightful than conventional visualisations. Previous works found that DS-enhanced visualisations are more effective than conventional visualisations for simple tasks like identifying key data points or the main message. However, no previous work has explored the extent to which DS enhancements influence task completion across different levels of cognitive complexity. We address this gap by presenting the results of a study where 128 participants completed tasks based on four visualisations (two line charts and two choropleth maps, either with or without DS elements) spanning a range of complexity based on Bloom's taxonomy, which has been applied in data visualisation to categorise tasks hierarchically from lower to higher-order thinking. Results suggest that while DS-enhanced visualisations effectively support lower-order tasks (finding data points and understanding insights), they don't necessarily aid the correct completion of higher-order tasks (application, analysis, evaluation and creation). However, DS enhancements improve how efficiently participants complete complex tasks.

0.58