CS Paper Radar

AI Agents and the Future of VIS

Chen Zhu-Tian, Nam Wook Kim, Saeed Boorboor, Shivam Raval, Pan Hao, Qianwen Wang, Vidya Setlur

cs.HC ·submitted 2026-08-14 18:41 UTC · v1

Abstract

Recent advances in agents (i.e., autonomous, goal-driven AI systems that iteratively observe, act, and learn from their environments) offer a fundamentally different approach from traditional AI models that passively respond to input. These AI agents are rapidly reshaping how we approach data-intensive tasks and providing new opportunities for the VIS community. Imagine an agent autonomously generating visualizations to analyze complex data, discovering patterns collaboratively, testing hypotheses, and communicating visual insights at a speed and scale beyond human capability. Yet, the emergence of these powerful systems raises critical questions that the VIS community must address: Could autonomous agents eventually replace human data scientists, and if not, how might they best collaborate? Are current visualization techniques and interfaces, originally designed for human analysts, suitable for agent interactions? How can VIS designers effectively integrate agents into their workflows without compromising human agency? And to what extent should agents help shape and educate the next generation of visualization researchers? Through a mix of keynote talks, paper presentations, and an agentic VIS challenge, this workshop invites researchers and practitioners to share innovative ideas, explore these questions, and discuss strategies to transform the impact of VIS for a future where human and AI agents co-exist.

Comment
workshop proposal

Closest papers

Nearest neighbours by meaning across the whole index.

Agentic Dashboards: A New Design Paradigm for Visual Analytics

cs.HC ·2026-11-12 ·Sam Yu-Te Lee, Yun-Hsin Kuo, Kwan-Liu Ma
similarity 0.78
Abstract

Visual analytics systems traditionally combine analytical methods and interactive visualizations into a fixed application specified at the design phase. Coding agents offer a flexible approach: experts could conduct analysis through natural-language instructions. We envision an agentic dashboard as a persistent visual analytics workspace where an agent makes decisions about analytical methods, views, and their coordination within a designer-defined decision space. This approach shifts part of the visualization designer's role from engineering a fixed interface to defining the decisions an agent may make at runtime. We illustrate how such a dashboard could operate with current capabilities and propose criteria for evaluating its behavior and potential failures. As analytical workflows become more fluid and agent-mediated, visualization can help experts maintain awareness, coordinate with agents, and exercise judgment.

0.05

Advances in Agentic Computer Graphics

cs.CV ·2026-11-01 ·Hengyu Liu, Jihyeon Je, Ruiqi Wang, Mingxuan Wu, Haven Feng +9 more
community pick similarity 0.72
Abstract · 27 pages, 19 Figures

Computer graphics is built on code. Large language model (LLM) agents can now generate graphics code and iteratively refine it through various feedback. This capability opens the door to a potentially new paradigm of computer graphics, with graphics algorithms increasingly built around agentic systems to automate progressively complex tasks. Over the past years, research on agentic graphics has expanded rapidly across a diverse range of tasks. This rapid growth makes it increasingly difficult for manual literature reviews to keep pace with new developments. At the same time, similar ideas are often described using different terminology across these tasks, further complicating efforts to develop a systematic understanding of the field. In this report, we address these challenges through two contributions. First, we introduce a unified taxonomy for characterizing agentic systems across diverse computer graphics tasks. Second, we develop an agentic literature system that can assist human researchers in analyzing existing and newly published papers at scale. Building on these contributions, we analyze emerging research trends and discuss open challenges in coordinating agents and tools across graphics tasks, designing interfaces and representations for human-agent collaboration, sustaining long-horizon planning and refinement, and reliably evaluating interactive graphics systems.

0.35

MIVAIS: A Study Environment for Multi-Agent Mixed-Initiative Visual Analytics Applications

cs.HC cs.MA ·2026-09-04 ·Tobias Stähle, Simon Schneider, Rita Sevastjanova, Mennatallah El-Assady
similarity 0.72
Abstract

Mixed-initiative Visual Analytics (VA) systems empower human users by interleaving human intuition with software agents and their machine intelligence. However, the development and rigorous evaluation of such systems remain constrained by engineering overhead. Developers must, e.g., implement complex, low-level state synchronization to manage asynchronous agent behaviors, while researchers struggle to capture the multimodal provenance required to study and evaluate human-AI collaboration. We present MIVAIS, a dual-layered research platform designed to abstract the structural complexities of mixed-initiative VA. First, it contributes a computational Infrastructure that standardizes human-software agent interaction, state synchronization, and communication between the agents. Second, it provides a declarative Study Environment that automatically logs multimodal human-AI telemetry - including application/system state, screen capture, audio, and additional sensor data - enabling seamless, in-situ user studies and post-session analysis. We technically validate our infrastructure by replicating three state-of-the-art systems (Podium, Voyager 2, and ProactiveVA). Furthermore, we evaluate the framework's expressiveness and efficiency through expert case studies with HCI and VA researchers, demonstrating how MIVAIS effectively lowers the barrier to prototyping and evaluating intelligent, co-adaptive interfaces.

0.19

The Future of Visualization Dashboards in the Age of Generative AI

cs.HC ·2026-09-28 ·Vaishali Dhanoa, Duosi Dai, Gabriela Molina Léon, Eduard Gröller, Niklas Elmqvist
similarity 0.70
Abstract

Generative AI promises easier dashboard creation, raising questions about the future of dashboards and the people who create and use them. We interviewed 16 experts based in 14 countries about their practices and expectations. Almost all expected dashboards to persist for recurring questions, monitoring, and reporting. They anticipated adaptive views and combinations of language, graphical controls, and gestures, while emphasizing interaction as part of human exploration and understanding. Participants expected authors' responsibilities to shift toward specifying requirements, curating generated work, and evaluating outputs, with design knowledge and communication remaining important. Easier creation also raised concerns about validation effort, users' understanding, maintenance, and personalization weakening shared understanding. We discuss seven opportunities for research and practice concerning validation, end-user education, dashboard proliferation and rot, organizational guidance, adaptation, novel visualizations, and accountability for AI-generated content. Our findings connect dashboard evolution with the human and organizational work needed to sustain their use.

0.08

InsightChain: Optimized Chain-of-Insight Analytics for LLM-driven Data Visualization

cs.CL cs.HC ·2026-09-06 ·Hanya Sun, Chen Zhang, Sheng Liang, Yongyue Zhang, Yong Liu
top venue similarity 0.70
Abstract · EMNLP 2026 Findings

Large language models (LLMs) are increasingly used for automated data visualization, yet existing approaches often frame visualization generation as a single-step mapping from user query to figure or code, overlooking the iterative analytical reasoning process of expert analysts. We present InsightChain, a four-stage visualization prompting pipeline (Explore--Focus--Test--Present) that emulates expert analytical workflows, together with VG-COPRO, a vision-guided automatic prompt optimization (APO) method adapted to jointly optimize such multi-stage, executable pipelines. To address the evaluation gap for complex data visualization, we introduce the Insight Progression Metric (IPM), a rubric combining four text-based dimensions with a vision-based dimension. We assess IPM through a 100-chain human pilot and an expanded 300-chain agent-based evaluation spanning all ten domains. Experiments on public datasets show that InsightChain consistently outperforms competing prompting baselines. Existing APO methods fail to yield consistent gains on this multi-stage task, whereas VG-COPRO improves performance in both in-domain and cross-domain settings.

0.30

Towards Actionable Visualization: Ten Years Later, What Generative AI Changes and What It Cannot

cs.SE cs.ET ·2026-08-23 ·Leonel Merino, Mohammad Ghafari, Oscar Nierstrasz
position similarity 0.69
Abstract · 2026 IEEE Working Conference on Software Visualization (VISSOFT)

Ten years ago, we surveyed software visualization research under the assumption that the challenge for adoption was matching developers' needs with techniques. Generative AI might have made that assumption obsolete by driving the cost of producing a visualization on demand toward zero. We argue that this mirrors a broader inversion already underway in software engineering: as AI devalues the production of artifacts, it elevates the human work of perceiving and directing them. Looking back at our 2016 research, we found that domains we flagged as neglected, such as rationale, are exactly the ones AI now makes tractable, and a tool-sustainability problem we diagnosed then is one generative AI may worsen before it helps solve. One finding shifted outright: the share of studies delivered through immersive environments grew roughly fifteen-fold, though it remains a small minority of the field. We argue that future research should focus on helping people understand large and complex software systems, including the reasoning processes generated by AI agents alongside the code itself. Humans have always been accountable for what they trust, but AI may lead them to trust without enough scrutiny. We confront the risks that follow, from the reliability of AI-generated visualization itself to the temptation of competing with machines on their own terrain, and conclude that actionable visualization is no longer a distant destination but a standard the field can now meet.

0.06

AdaLens: Interactive Storyline for Monitoring and Steering Long-Running Agentic Data Analysis

cs.HC cs.AI ·2026-08-18 ·Yangtian Liu, Yan Miao, Shuhan Liu, Yunfan Zhou, Dae Hyun Kim +2 more
similarity 0.68
Abstract

Large language models are pushing data science toward increasingly autonomous and agentic workflows, with recent systems already supporting multi-step and long-running analyses. As these workflows become more autonomous, conventional interfaces no longer provide adequate support for two critical requirements: observability for understanding an agent's evolving reasoning and evidence, and steerability for redirecting low-value directions or deepening promising ones during execution. Existing interactive approaches improve process visibility and open intervention points, but they remain largely designed for discrete, turn-by-turn exchanges rather than the parallel branches and evolving decision structures of long-running agentic analysis. We study this need as interactive oversight in long-running agentic data analysis and present AdaLens, an interactive system for monitoring and steering ongoing runs. AdaLens combines a storyline-based representation that unifies analytical plans, execution progress, intermediate findings, and data-column involvement with steering interactions grounded in these analytical elements for directional guidance and execution control. We evaluate AdaLens through two case studies and a user study, examining how it supports analysts in monitoring and steering long-running agentic data analysis.

0.29

CATVis: A Collaborative Multi-Agent Workflow for Turbomachinery Simulation Data Visualization

cs.HC ·2026-09-15 ·Zhe Wang, Zehao Lou, Guanghui Zhao, Yu Dong, Guan Li +4 more
published similarity 0.68
Abstract · The paper is accepted by IEEE VIS 2026 Short Paper

Recent advances in AI for Science have enabled natural language (NL) interfaces for scientific data analysis. In turbomachinery CFD post-processing, translating ambiguous high-level analytical goals (e.g., vortex identification) into precise visualization procedures supporting complex domain-specific analysis is challenging. We present CATVis, a Collaborative multi-agent workflow system that bridges this gap by transforming NL intents into structured middle representation for visualization. Our approach reformulates domain-specific visualization procedures as composable workflow representations, and use multi agent to generate workflow representations via intent planning, template generation, and error-aware refinement, where each stage incrementally updates a shared structured representation. We evaluate the impact of external knowledge and workflow structuring on generation accuracy, demonstrating that the proposed approach significantly improves complex workflow generation correctness while reducing prompt complexity.

0.14