CS Paper Radar

Facilitating Reproducibility in Visualization Systems Research Through Containerization

Thomas Breimer, Pirm Dhararag, Kiya Gedamu, Paras Pandey, Marie Amandine Reyes, Tal Spector, Galileo Steinberg, Nathan Subrahmanian, Paul Weir, Peter Williams, Weichen Zhao, Dylan Cashman

cs.HC ·submitted 2026-08-24 13:40 UTC · v1
position

Abstract

In this position paper, we argue for the importance of containerizing visual analytics artifacts to improve the scientific progress of our research community. First, based on our previous experience authoring, reading, and reviewing visual analytics research from the previous decade, we identify risks and impediments to empirical research in visual analytics within the broader reproducibility crisis, including an inability to compare systems and techniques and a slow pace of adjusting to a rapidly changing ecosystem of analysis methods, such as machine learning and artificial intelligence. Next, we analyze the benefits of different artifact sharing and deployment setups across five artifact goals: reproducibility, replicability, portability, performance, and scalability. Then, we argue that containerization addresses the issue of reproducibility in visual analytics research, with downstream benefits in terms of replicability, portability, performance, and scalability. To demonstrate the ease of use and the utility of containerization, we deploy ten visual analytics systems developed over the course of a graduate seminar onto a live server using containerization with the help of agentic AI. We share lessons learned through the containerization process, and describe a suite of potential benefits for our research community as well as research opportunities for leveraging modularity to improve the artifacts themselves.

Comment
9 pages, 2 figures. Accepted to IEEE VIZ BELIV Workshop 2026

Closest papers

Nearest neighbours by meaning across the whole index.

Towards Actionable Visualization: Ten Years Later, What Generative AI Changes and What It Cannot

cs.SE cs.ET ·2026-08-23 ·Leonel Merino, Mohammad Ghafari, Oscar Nierstrasz
position similarity 0.68
Abstract · 2026 IEEE Working Conference on Software Visualization (VISSOFT)

Ten years ago, we surveyed software visualization research under the assumption that the challenge for adoption was matching developers' needs with techniques. Generative AI might have made that assumption obsolete by driving the cost of producing a visualization on demand toward zero. We argue that this mirrors a broader inversion already underway in software engineering: as AI devalues the production of artifacts, it elevates the human work of perceiving and directing them. Looking back at our 2016 research, we found that domains we flagged as neglected, such as rationale, are exactly the ones AI now makes tractable, and a tool-sustainability problem we diagnosed then is one generative AI may worsen before it helps solve. One finding shifted outright: the share of studies delivered through immersive environments grew roughly fifteen-fold, though it remains a small minority of the field. We argue that future research should focus on helping people understand large and complex software systems, including the reasoning processes generated by AI agents alongside the code itself. Humans have always been accountable for what they trust, but AI may lead them to trust without enough scrutiny. We confront the risks that follow, from the reliability of AI-generated visualization itself to the temptation of competing with machines on their own terrain, and conclude that actionable visualization is no longer a distant destination but a standard the field can now meet.

0.06

AI Agents and the Future of VIS

cs.HC ·2026-08-14 ·Chen Zhu-Tian, Nam Wook Kim, Saeed Boorboor, Shivam Raval, Pan Hao +2 more
similarity 0.65
Abstract · workshop proposal

Recent advances in agents (i.e., autonomous, goal-driven AI systems that iteratively observe, act, and learn from their environments) offer a fundamentally different approach from traditional AI models that passively respond to input. These AI agents are rapidly reshaping how we approach data-intensive tasks and providing new opportunities for the VIS community. Imagine an agent autonomously generating visualizations to analyze complex data, discovering patterns collaboratively, testing hypotheses, and communicating visual insights at a speed and scale beyond human capability. Yet, the emergence of these powerful systems raises critical questions that the VIS community must address: Could autonomous agents eventually replace human data scientists, and if not, how might they best collaborate? Are current visualization techniques and interfaces, originally designed for human analysts, suitable for agent interactions? How can VIS designers effectively integrate agents into their workflows without compromising human agency? And to what extent should agents help shape and educate the next generation of visualization researchers? Through a mix of keynote talks, paper presentations, and an agentic VIS challenge, this workshop invites researchers and practitioners to share innovative ideas, explore these questions, and discuss strategies to transform the impact of VIS for a future where human and AI agents co-exist.

0.41

Towards Insight-Centric Data Spaces: Integrating Visual Analytics and Decentralized Data Ecosystems

cs.GR ·2026-11-04 ·Christina Faßbender, Benjamin Greiner, Benedikt T. Arnold, Georgios Toubekis, Christoph Lange
similarity 0.65
Abstract

Visual analytics and dataspaces address complementary challenges in modern data ecosystems: visual analytics enables interactive exploration and human-centered reasoning over complex data, dataspaces provide decentralized infrastructures for sovereign and collaborative data sharing. Both fields have largely evolved independently, resulting in a gap between data management and data understanding in distributed environments.We explore their intersection and argue that integration is essential for next-generation data ecosystems. Visual analytics acts as a cognitive layer for dataspaces by making data availability, quality, provenance, and exchange processes observable and interpretable, while dataspaces reshape visual analytics by introducing decentralized, heterogeneous, and governed data environments. We illustrate this interplay through a semi-synthetic cultural dataspace scenario analyzing exchange patterns and metadata quality across a federated ecosystem. Based on these insights, we identify key open challenges and outline a vision of insight-centric data spaces, in which data management and analysis are tightly integrated into a unified, human-centered environment.

0.33

T(r)opical Islands: Visualizing & Understanding Socio-Technical Artifacts

cs.SE ·2026-09-04 ·Adam Štěpánek, Marco Raglianti, Vít Rusňák, Jan Byška, Barbora Kozlíková +1 more
top venue similarity 0.64
Abstract · 12 pages, 11 figures, 1 table, accepted at ICSME 2026

Projects hosted on collaborative software development platforms, such as GitHub, include many non-code artifacts documenting the project's lifecycle, with its challenges, plans, design, and even community. These socio-technical artifacts include, for example, bug reports, feature requests, and forum posts, offering a useful prospect on the project's evolution. However, these artifacts are dispersed over multiple communication channels and written in natural language, making their analysis difficult, as they are fragmented and with considerable noise. We present a 3D visualization approach mapping topics found across a project's socio-technical artifacts onto vegetation-covered islands, where the individual artifacts are depicted as trees of various types. The topic islands rise out of the ocean as they become discussed, to sink again when they are no longer so. We built a prototype implementing the entire visualization pipeline, from data mining to interactive rendering, leveraging machine learning techniques to cluster the artifacts and extract their topics. We present, through several case studies, the insights that our approach elicits about discussions of development topics throughout a project's history. The user study we conducted (N=34) further strengthens our conclusions about its suitability for understanding socio-technical artifacts and their evolution.

0.71

InsightChain: Optimized Chain-of-Insight Analytics for LLM-driven Data Visualization

cs.CL cs.HC ·2026-09-06 ·Hanya Sun, Chen Zhang, Sheng Liang, Yongyue Zhang, Yong Liu
top venue similarity 0.64
Abstract · EMNLP 2026 Findings

Large language models (LLMs) are increasingly used for automated data visualization, yet existing approaches often frame visualization generation as a single-step mapping from user query to figure or code, overlooking the iterative analytical reasoning process of expert analysts. We present InsightChain, a four-stage visualization prompting pipeline (Explore--Focus--Test--Present) that emulates expert analytical workflows, together with VG-COPRO, a vision-guided automatic prompt optimization (APO) method adapted to jointly optimize such multi-stage, executable pipelines. To address the evaluation gap for complex data visualization, we introduce the Insight Progression Metric (IPM), a rubric combining four text-based dimensions with a vision-based dimension. We assess IPM through a 100-chain human pilot and an expanded 300-chain agent-based evaluation spanning all ten domains. Experiments on public datasets show that InsightChain consistently outperforms competing prompting baselines. Existing APO methods fail to yield consistent gains on this multi-stage task, whereas VG-COPRO improves performance in both in-domain and cross-domain settings.

0.30

RaivenTracks: Branching Provenance for Conversational Visualization Workflows

cs.HC ·2026-08-14 ·Ella Hugie, Alexandra Irger, Grace Guo, Kenneth Moreland, David Pugmire +2 more
similarity 0.63
Abstract · *Ella Hugie and Alexandra Irger are co-first authors

As AI agents increasingly participate in scientific workflows, scientists are shifting from direct authorship toward oversight, inspection, and steering. LLM-driven visualization systems are a promising interface for this hand-off, yet they remain largely stateless, forcing users to reconstruct context across refinements and offering little support for revisiting prior decisions or exploring alternatives. We present RaivenTracks, a workflow-aware extension of the Raiven DSL-mediated visualization pipeline that treats validated visualization specifications as persistent, branchable checkpoints. Because each checkpoint is a verifiable RaivenDSL specification rather than a dialogue transcript, restoring a node recompiles a known artifact rather than re-interpreting prior context. RaivenTracks contributes a two-level state management architecture that pairs a persistent, branchable version tree with a fine-grained undo/redo stack over runtime visualization settings, across both InfoVis and SciVis backends. A formative pilot study with three visualization researchers shows early promise, with all participants adopting the version tree for branching and recovery, and surfaces design directions for tree navigation, node labeling, and scalability that inform a planned controlled comparison against Raiven without version history. We frame branchable conversational visualization history as a step toward provenance support for future scientist-in-the-loop oversight of AI-driven scientific workflows.

0.04

The Future of Visualization Dashboards in the Age of Generative AI

cs.HC ·2026-09-28 ·Vaishali Dhanoa, Duosi Dai, Gabriela Molina Léon, Eduard Gröller, Niklas Elmqvist
similarity 0.62
Abstract

Generative AI promises easier dashboard creation, raising questions about the future of dashboards and the people who create and use them. We interviewed 16 experts based in 14 countries about their practices and expectations. Almost all expected dashboards to persist for recurring questions, monitoring, and reporting. They anticipated adaptive views and combinations of language, graphical controls, and gestures, while emphasizing interaction as part of human exploration and understanding. Participants expected authors' responsibilities to shift toward specifying requirements, curating generated work, and evaluating outputs, with design knowledge and communication remaining important. Easier creation also raised concerns about validation effort, users' understanding, maintenance, and personalization weakening shared understanding. We discuss seven opportunities for research and practice concerning validation, end-user education, dashboard proliferation and rot, organizational guidance, adaptation, novel visualizations, and accountability for AI-generated content. Our findings connect dashboard evolution with the human and organizational work needed to sustain their use.

0.08

AI Scientist Mission Control (AIMC): Visual Analytics for Human Oversight of Autonomous Scientific Discovery

cs.AI ·2026-08-10 ·Rikathi Pal, Klaus Mueller
similarity 0.62
Abstract

Autonomous scientific discovery systems can generate large numbers of research ideas, experiments, and manuscripts with minimal human intervention. As these systems become increasingly capable, scientists require effective mechanisms to monitor output quality, identify recurring failure modes, understand research evolution, and prioritize promising discoveries for review. We present AIMC, a visual analytics framework for human oversight of autonomous scientific discovery. AIMC combines semantic embeddings, automated weakness extraction, temporal analysis, and interactive visualizations to support the exploration of AI-generated research artifacts. We demonstrate the framework through a case study of the papers generated by an autonomous AI Scientist (FARS), together with their associated review feedback. Our analysis reveals recurring methodological weaknesses, evolving research themes, domain-specific differences in quality, and a small set of highly novel papers that warrant deeper human inspection. These findings illustrate how visual analytics can support transparency, diagnosis, and human AI collaboration in emerging autonomous scientific discovery workflows.

0.04