CS Paper Radar

MesoCraft: a web-based tool for interactive procedural modeling of mesoscale biological structures

Donggang Jia, Alexandre Kouyoumdjian, Ondrej Strnad, Uros Smajdek, Ciril Bohak, Dilara Bayraktar, Alejandra Esparza, Peter Mindek, Tobias Klein, Stefan T. Arold, Ivan Viola

cs.GR ·submitted 2026-10-27 20:37 UTC · v1

Abstract

Biological models bring the molecular world of cells into view, enabling experts and the public to explore and understand biological discoveries. Building mesoscale models requires organizing many molecular components into spatial arrangements that can be revised as evidence and interpretations develop. We present MesoCraft, a browser-based tool for structural biologists centered on interactive procedural modeling. User-defined rules generate collections of molecular instances, while a geometry-node editor and visual feedback support authoring and revision of their spatial relationships. Beyond model construction, MesoCraft integrates exploration and communication, enabling researchers to inspect molecular organization and create guided animations that highlight key spatial relationships. By connecting modeling, exploration, and explanation in a unified workflow, MesoCraft allows insights gained during exploration and communication to inform iterative model refinement, supporting the development of mesoscale models into visual narratives of cellular organization. A demonstrative deployment of the tool is available at https://mesocraft.kaust.edu.sa/.

Closest papers

Nearest neighbours by meaning across the whole index.

How Do We Visualize Space in Molecular Biology? A Study of Spatial Transcriptomics Visualization Practices

cs.HC ·2026-09-17 ·Denisse Chacón-Ramírez, Mark S. Keller, Eric Mörth, Nils Gehlenborg, Marc Streit +1 more
similarity 0.69
Abstract · Submitted to IEEE Transactions on Visualization and Computer Graphics

A cell's identity depends on where it sits in tissue: for example, a macrophage behaves differently in a tumor core than at its edge. Spatial transcriptomics has transformed how we study this by recovering that lost coordinate, but it does so by producing data that is simultaneously high-dimensional, multimodal, and uncertain. Visualizing this combination is a hard problem in its own right, and one that warrants an assessment of how the field currently represents it, what has worked, and what is still missing. We surveyed 148 papers and 1,824 figure panels using a What-Why-How coding framework grounded in Munzner's nested model, connecting the data represented, the biological tasks motivating each visualization, and the design choices through which they are expressed; a subset of the surveyed work also contributed dedicated interactive visualization software that was not necessarily reflected in the static figures, and we looked at what interaction capabilities those tools supported as well. We close by outlining where the field stands and the challenges ahead for bioinformatics and visualization researchers to tackle together.

0.26

OSWorld-Science: A Benchmark of Computer Use Agents for Learning and Using Scientific Software

cs.AI ·2026-09-30 ·Dingyuan Dai, Heli Qi, Lei Liu, Yinxi Li, Baiding Chen +26 more
benchmark similarity 0.59
Abstract · 62 pages. Website: https://discoailab.github.io/osworld-science-page/ Public contributions welcome: https://forms.gle/htxY5snyANJ4moVEA

Scientific software presents a demanding test for computer-using agents based on visual language models (VLMs): completing a research workflow requires interpreting specialized interfaces, manipulating scientific objects, and producing verifiable results. We thus introduce OSWorld-Science, a benchmark and evaluation environment that combines scientifically meaningful tasks, artifact-based evaluation, and an efficient agent harness for studying computer use in the scientific domain. The benchmark contains 12 VLMs and 146 high-quality tasks across several scientific domains and software configurations, covering workflows such as molecular drawing and retrosynthesis, pathology image analysis, statistical computing, and physical simulation. Tasks are developed through expert proposals and iterative human--AI co-design, with selection guided by scientific value and difficulty. Task-specific execution-based evaluators inspect application states and generated artifacts, including molecular structures, segmentation masks, plots, and numerical results, and award partial credit for incomplete outcomes. Our special harness integrates model adapters, interaction-loop control, and trajectory logging to support comparisons of models and interaction strategies. Our results show that current state-of-the-art VLMs with a strong harness still face challenges in addressing key questions in the scientific domains. We also analyze the benchmarking results across multi-linguistics, reasoning efforts, context length and other factors and derive several important conclusions and directions to assist future development. Overall, we provide an integrated framework connecting expert-defined scientific goals to verifiable software outcomes, enabling systematic evaluation of both agent capabilities and harness design in scientific workflows.

0.28

How Spatial Biologists Direct and Verify AI-Assisted Analyses

cs.HC ·2026-09-23 ·Ella Hugie, Alexandra Irger, Chiara Schiller, Lukas Hatscher, Denis Schapiro +1 more
similarity 0.58
Abstract · *Ella Hugie and Alexandra Irger are co-first authors

Spatial biologists use visualization to assess computational analyses of tissue data. We examine how they direct and verify analyses when an AI agent performs this work. We synthesized workflows from fourteen contextual inquiries and conducted a formative pilot followed by an observational study with ten spatial biologists using Claude Science on their own data. Participants valued help with plotting, locating cells of interest, and tasks they found laborious or could not otherwise perform. Assessing the agent's work involved obtaining suitable evidence, sometimes through additional work in external tools, and interpreting it using knowledge of the tissue and its markers. Scientists also sought information about ongoing computation to decide how analysis should proceed. We contribute a workflow synthesis, an empirical account of scientists directing and verifying agentic analyses, and four design directions addressing execution control, familiar interactive views, source and execution information, and accessible verification across computing setups and experience.

0.10

Molecular LLM Agents: From Architectural Design to Scientific Autonomy

cs.CL cs.AI ·2026-08-24 ·Jiatong Li, Wengyu Zhang, Weida Wang, Yuxuan Ren, Wei Liu +6 more
similarity 0.56
Abstract · 25pages

Molecular science represents an important frontier for LLM-based agents. Unlike general agents that mainly operate over natural language, code, or web environments, molecular LLM agents must perceive, reason about, and act upon chemical objects across symbolic strings, molecular graphs, 3D conformations, spectra, simulations, and wet-lab measurements. Their capabilities depend on chemically faithful molecular perception, an LLM-centered agent framework, domain-specific tool grounding, and computational or experimental feedback, in addition to planning and tool use. This work develops a conceptual framework for molecular LLM agents from two complementary perspectives. First, we introduce an architectural view of molecular-agent design, covering molecular representation and perception, the agent framework, domain-specific toolboxes, and learning and optimization. Second, we propose a scientific autonomy ladder inspired by staged autonomy in engineering systems, categorizing agents into four levels: L1 assistive or fixed workflows, L2 adaptive computational agents, L3 feedback-aware physical experiment agents, and L4 scientific-agenda agents. Together, these two perspectives establish a comprehensive framework for comparing existing molecular LLM agents, identifying missing capabilities and deployment risks, and guiding the design, evaluation, and deployment of future agents in molecular discovery workflows.

0.23

"Here Be Sharks!": Enhancing Scientific Communication and Analysis through Authoring Interactivity

cs.HC ·2026-09-08 ·Caroline Berger, Josh Pollock, Dylan Wooton, Arvind Satyanarayan, Clemens Nylandsted Klokmose
similarity 0.56
Abstract

We report on a case study for designing authoring environments for interactive visualizations to enhance scientific work. We conducted a workshop and prototype review with a group of marine biologists. When it came to visualizing their data, participants identified challenges in conveying their research accurately and completely as well as and analyzing it with ease. Based on our findings, authoring environments should consider the context of scientific work aspects such as domain expertise, collaboration culture, and publication traditions. We propose consideration of non-traditional programming languages and environments for scientific work, discuss ways of facilitating interactive visualizations for scientists, and examine ways of meaningfully integrating AI. The critiques, artifacts, and reactions from the scientists along with our analysis and discussion inform how computational tools should be designed for scientific work.

0.04

OctMole: Multiscale 3D Molecular Generation with Hierarchical Spatial Flows

cs.LG ·2026-10-12 ·Yu-Tong Jin, Yi-Yang Tian, Qiwei Ye, Peng-Shuai Wang
code/data similarity 0.54
Abstract · 28 pages, 22 figures, and 17 tables

Generating accurate 3D molecules requires jointly determining a variable number of atoms, their identities, and geometry across spatial scales: global shape emerges coarsely, whereas chemical bonds demand fine local precision. Existing atom-based diffusion and flow models operate largely at a single scale, while dense spatial fields become costly at high resolution. We introduce OctMole, a multiscale octree flow framework for 3D molecular generation. A hierarchical occupancy flow progressively resolves sparse molecular support from coarse to fine, and a joint atom flow assigns atom types and continuous in-cell offsets to occupied leaves. This decomposition combines efficient global structure with subcell geometric precision, while cell corruption improves robustness to generated support. On QM9 and GEOM-DRUG, OctMole achieves strong chemical, distributional, and geometric quality, with particularly clear gains over Uni-3DAR on GEOM-DRUG and substantial efficiency gains over dense 3D generation. As an additional capability, intermediate occupancy states and selected regions provide spatial conditioning without task-specific retraining, supporting multiscale shape conditioning, regional editing, linker generation, and shape interpolation. Code and pretrained checkpoints are available at https://github.com/octree-nn/octmole and https://huggingface.co/Disembo/octmole, respectively.

0.39

Learning Transferable Reaction Mechanisms from Visual Chemical Knowledge

cs.CE cs.AI ·2026-09-27 ·Yujian Yuan, Jiaxin Xu, Xin Cai, Yufan Chen, Zhichao Tan +2 more
benchmark similarity 0.53
Abstract

Reaction mechanisms describe the step-by-step transformations underlying chemical reactions and are central to reaction analysis and synthesis. Learning-based models have achieved strong performance on established mechanism-prediction benchmarks, but transferring them to unseen chemistry remains challenging. Such transfer is difficult because familiar mechanisms must be applied to unfamiliar molecular structures, and some target mechanisms may be poorly covered by the training data. To address these challenges, we introduce MechaVLM, a visual framework that combines transferable chemical representations with external mechanistic knowledge. It learns reusable visual features through multiscale chemical grounding and cross-rendering contrastive learning. For open-book prediction, MechaVLM retrieves a fixed set of precedents from 70,384 literature mechanism figures and re-reads relevant visual evidence as the molecular state evolves, directly using the figures without symbolic mechanism parsing. An atom-indexed language decoder then recursively generates executable electron edits to construct the complete mechanism. We further introduce MechBench, a challenging literature-derived benchmark with 2,184 mechanisms and 9,146 elementary steps. Across cross-dataset and literature-derived benchmarks, MechaVLM establishes strong zero-shot mechanism prediction. Its closed-book model alone improves Step/Pathway Top-1 by 12.50/13.93 percentage points on FlowER-to-ReactMech transfer, while external visual precedents unlock further gains on challenging OOD reactions. The learned representation also generalizes beyond mechanism prediction to atom mapping and reaction center prediction.

0.05

From Sketch to Design: A Cross-scale Workflow for Procedural Generative Urban Design

cs.HC cs.GR ·2026-11-08 ·Jin Gao, Sayjel Vijay Patel
published similarity 0.52
Abstract · 7 pages, 6 figures. Author version of a paper published at CAADRIA 2024

Urban designers use sketches and symbols to express spatial intentions, while many generative urban design tools rely on numeric parameters that are difficult to relate to this visual process. We propose a cross-scale workflow and a web-based prototype that translates symbolic sketches into controllable procedural urban generation. A vocabulary of shapes, informed by examples of urban design diagrams and sketching exercises with graduate urban design students, encodes attributes such as network structure, density, and program. The prototype uses the \$1 Unistroke Recognizer to map gestures to symbols and translates their locations and sizes into tensor-field attractors and weighted parameter grids. Grid and radial tensor fields guide street-network generation, while the parameter grids control building heights and programs. Implemented in JavaScript and TypeScript with React and Three.js, the prototype supports interactive sketching, visualization, and urban massing generation. We describe the methodology and illustrate prototype interactions, then discuss downstream integration with architectural-scale generative tools for further refinement and analysis. The work connects designers' symbolic input with an explicit procedural generation process.

0.56