CS Paper Radar

Reveal: A Provenance-Aware System for Multimodal Urban Data Exploration

Leonardo Ferreira, Joao Rulff, Maryam Hosseini, Aline Paes, Daniel de Oliveira, Fabio Miranda, Marcos Lage

cs.HC cs.CYcs.MM ·submitted 2026-11-15 23:18 UTC · v1
published

Abstract

Urban sensing initiatives increasingly produce multimodal datasets that combine visual and textual information to capture city characteristics and subjective factors such as safety, comfort, and accessibility. Yet, analyzing such data at scale remains difficult, as manual inspection is unfeasible and automated methods struggle to interpret subjective cues and uncover relationships across diverse data modalities. Moreover, existing workflows rarely make exploration steps explicit, hindering reproducibility. To address these challenges, we introduce Reveal, a provenance-aware visual analytics system for exploring heterogeneous urban data. Reveal enables users to build dataflows by combining text and image searches across coordinated views, chaining queries into pipelines, and applying set operations within an exploration diagram while capturing analytical provenance. We evaluate Reveal through two case studies focused on accessibility and walkability.

Comment
Accepted to SIBGRAPI 2026

Closest papers

Nearest neighbours by meaning across the whole index.

Benchmarking Fine-Grained Visual Reasoning for Remote Sensing in Urban Management

cs.CV ·2026-11-04 ·Jiawei Zhang, Rizhao Cai, Dayan Guan
publishedbenchmarkcode/data similarity 0.62
Abstract · Accepted by IEEE AP-GARSS 2026; 4 pages, 3 figures, 3 tables

Fine-grained visual reasoning is essential for remote sensing in urban management, yet remains underexplored in the evaluation of multimodal large language models (MLLMs). We introduce UMBench, a fine-grained urban remote sensing benchmark built from unmanned aerial vehicle (UAV) images for multiple urban management tasks such as traffic monitoring, urban construction, environmental quality, and disaster warning. Evaluations on UMBench reveal that current MLLMs often rely on scene-level priors and overlook fine-grained visual evidence. To address this issue, we further propose a novel evidence-first chain-of-thought method that directs models to inspect fine-grained visual evidence in a training-free manner. Experiments show that our method can improve the performance of both open-source and commercial MLLMs on UMBench.

0.34

Beyond Static Charts: Can Language and Vision Language Models Generate Interactive Data Visualization Interfaces?

cs.CL ·2026-08-11 ·Mizanur Rahman, Aaryaman Kartha, Enamul Hoque Prince
benchmarkcode/data similarity 0.62
Abstract

Data visualization is central to analytical reasoning, but real-world analysis increasingly requires language-driven interactive interfaces rather than static charts. Although recent large language and vision language models (LLMs/VLMs) have shown promise in generating static charts from natural language, their ability to generate interactive data visualization interfaces remains largely unexplored due to the lack of benchmarks. We introduce VIS-GEN, a benchmark for evaluating how well LLMs/VLMs can generate interactive visualization interfaces from natural language queries. VIS-GEN comprises 3,042 samples covering diverse analytical intents, including data filtering, temporal analysis, and visualization editing, each paired with dataset metadata and natural language queries that are designed to reflect realistic, goal driven data exploration scenarios. We benchmark 14 state-of-the-art open-source and closed-source LLMs/VLMs, revealing large performance gaps and frequent failures on queries involving implicit intent, multiple interaction alternatives, and complex editing operations, highlighting interactive interface generation as a key open challenge beyond static chart synthesis. To address this, we propose a structured multi stage interface generation framework that decomposes the task into visualization design representation, generation of multiple interface candidates, constraint-aware critique, and self-refinement. This approach improves the best models pass rate by 15.9 percentage points, demonstrating a practical path toward more reliable language-driven interactive visualization systems. We release VIS-GEN at https://github.com/vis-nlp/VIS-GEN.

0.24

Faithful Chart Generation for Multimodal Deep Research: Frame-Evidence Co-Adaptation

cs.HC cs.AIcs.CLcs.GR ·2026-09-30 ·Yuxin Yue, Yingchen Zhang, Ruqing Zhang, Jiafeng Guo, Maarten de Rijke +1 more
similarity 0.61
Abstract

Analytical charts in multimodal deep research encode quantitative claims, requiring every visualized value to be faithfully grounded in supporting evidence. Unlike retrieved images that mainly provide contextual information, charts require numerical fidelity: visualized values should not only match retrieved evidence quantitatively but also preserve its original meaning and scope. However, achieving such fidelity remains challenging because current systems usually construct visualization plans before knowing what quantitative evidence can actually be retrieved from the web. As a result, predefined plans may require entities, temporal ranges, or comparison dimensions that the retrieved evidence only partially supports. Existing approaches mainly address this issue through post-hoc verification after chart plans are fixed, enabling unsupported values to be identified but leaving the underlying visual frames unchanged. To address this challenge, we propose Frame-Evidence Co-Adaptation (FECA), an evidence-adaptive visual planning framework for multimodal deep research. Inspired by the bidirectional sensemaking process in Data-Frame Theory, FECA models chart generation as an iterative interaction between visual frames and retrieved evidence. Each visual frame is adaptive: the frame guides evidence acquisition, while retrieved evidence determines whether the frame should be accepted, revised, or dropped before rendering. By coupling visualization planning with evidence availability, FECA shifts chart generation from fixed-plan verification to adaptive evidence-grounded visual reasoning. Experiments on 100 real-world research topics show that FECA substantially improves numerical fidelity while preserving report quality and chart utility.

0.19

Towards Insight-Centric Data Spaces: Integrating Visual Analytics and Decentralized Data Ecosystems

cs.GR ·2026-11-04 ·Christina Faßbender, Benjamin Greiner, Benedikt T. Arnold, Georgios Toubekis, Christoph Lange
similarity 0.61
Abstract

Visual analytics and dataspaces address complementary challenges in modern data ecosystems: visual analytics enables interactive exploration and human-centered reasoning over complex data, dataspaces provide decentralized infrastructures for sovereign and collaborative data sharing. Both fields have largely evolved independently, resulting in a gap between data management and data understanding in distributed environments.We explore their intersection and argue that integration is essential for next-generation data ecosystems. Visual analytics acts as a cognitive layer for dataspaces by making data availability, quality, provenance, and exchange processes observable and interpretable, while dataspaces reshape visual analytics by introducing decentralized, heterogeneous, and governed data environments. We illustrate this interplay through a semi-synthetic cultural dataspace scenario analyzing exchange patterns and metadata quality across a federated ecosystem. Based on these insights, we identify key open challenges and outline a vision of insight-centric data spaces, in which data management and analysis are tightly integrated into a unified, human-centered environment.

0.33

Exploratory Unstructured Data Analysis: A Formative Study and Implications for Human-AI Collaboration

cs.HC ·2026-09-03 ·Johannes Eschner, Dominik Eitler, Max Irendorfer, Patrick Kramml, Matthias Zeppelzauer +1 more
published similarity 0.61
Abstract

We propose a conceptual framework for exploratory data analysis of (large) unstructured data (EluDA), combining classical elements (querying, visualization) with active knowledge construction in the "search for structure". In a formative study, users conceptualized a structure for an image dataset during exploration. We found that users conceptualize by building faceted classifications bottom-up and rarely create meaningful spatial categorization during this process. We also evaluated CLIP for zero-shot assignment and semantic categorization, finding that it remains unreliable for assigning user-defined concepts to images but does support semantic grouping. Based on these findings, we identify and discuss four key opportunities for human-AI collaboration in EluDA: intelligent sampling and visualization to maximize data visibility; incremental and few-shot learning to minimize effort for reliable assignment; automatic category, concept, and facet suggestions to reduce effort during the search for structure; and the necessity for effective trust calibration methods.

0.34

InSight: A Benchmark for Agentic Claim Verification in Interactive Visualizations

cs.CL cs.CVcs.HC ·2026-09-01 ·Maeve Hutchinson, Syed Mahbubul Huq, Mohammad Albinhassan, Radu Jianu, Aidan Slingsby +1 more
top venuebenchmarkcode/data similarity 0.60
Abstract · To be presented at EMNLP Main Conference

Vision Language Models have demonstrated remarkable proficiency in interpreting static visual artifacts, but modern data analysis is inherently dynamic, requiring the active interrogation of interactive environments. Existing benchmarks are predominantly constrained to static imagery and one-shot question answering and fail to capture the epistemic demands of this domain, where evidence is frequently occluded, distributed across linked views, or conditionally revealed through user agency. In this paper, we introduce InSight, a benchmark for agentic claim verification over interactive visualizations. The dataset consists of 21,349 claims derived from human-authored analytical narratives and grounded in fully interactive web-based environments. Agents must navigate these environments to determine whether a natural language claim is supported, refuted or not verifiable given the available evidence. Unlike traditional evaluations, InSight treats interaction traces as intrinsic proxies for reasoning, enabling a rigorous audit of how models seek and synthesize visual evidence. We evaluate state-of-the-art models, revealing that interactive verification remains a non-trivial challenge. We release InSight at https://github.com/maevehutch/insight.

0.47

Sidewalk Stewards: A Visual Analytics Approach for Interactive Topology Repair of Sidewalk Networks

cs.HC cs.CVcs.CY ·2026-11-15 ·Stefan Cobeli, Leonardo Ferreira, Logan Loch, Luiza Melo, Peyman Baghershahi +5 more
similarity 0.60
Abstract · Under review

Accurate pedestrian network data is foundational to urban accessibility, routing, and infrastructure planning, yet such data remains scarce and difficult to produce at scale. Automated extraction pipelines have made significant strides by leveraging computer vision to derive sidewalk networks from aerial imagery, and have seen real-world adoption by municipalities seeking cost-effective inventory solutions. Yet, these pipelines consistently produce topological errors (e.g., disconnected components, dangling edges, missed connections, malformed intersections) that undermine the utility of the extracted networks for routing and accessibility analysis. Correcting these errors requires situated human judgment that global automated repair strategies cannot replicate, yet practitioners currently lack dedicated tools to support this work efficiently. We present Sidewalk Stewards, a visual analytics system that bridges the gap between automated extraction and a deployment-ready pedestrian network. Sidewalk Stewards detects candidate topology errors, supports interactive user-guided correction through coordinated spatial views, and provides real-time quality feedback as edits are applied. We evaluate Sidewalk Stewards through a comparative user study, case studies across cities, and a quantitative evaluation. Compared with conventional workflows, the system facilitates error identification and enables faster and more complete correction. The case studies illustrate the workflow across different urban contexts, and the quantitative evaluation shows that a small number of user corrections can enhance multiple sidewalk quality metrics. Sidewalk Stewards is available at urbantk.org/sidewalk.

0.45

MAP: A Benchmark on Multimodal Accessibility Planning for Real World Places

cs.AI ·2026-08-28 ·Jason Armitage, Ioannis Tsochantaridis, Linda Mazzone, Chuqiao Yan, Srini Narayanan +1 more
benchmark similarity 0.60
Abstract

We introduce MAP, the first benchmark to evaluate multimodal AI systems as assistants for users with accessibility requirements when planning visits to places in the real world. In our evaluation, systems are presented with requests to verify or recommend a point of interest meeting an accessibility requirement. MAP contains two novel assessments: Claim verification for accessibility planning assesses if information on places and stated accessibility features is supported and identifies places that satisfy requested accessibility features. Visual evidence retrieval for accessibility planning checks if a multimodal AI system can select visual evidence for the requested place and accessibility feature. Our methodology supports comparison of AI systems in a setting where place information and accessibility information can change over time by evaluating systems and refreshing ground truth data at scheduled times. The benchmark is based on automatic rating and human rating for a proportion of responses.

0.27