CS Paper Radar

AI-Experiment: an augmented reality art project co-created with artificial intelligence

Bernhard Egger, Hans Furer

cs.CV ·submitted 2026-09-29 19:20 UTC · v1
publishedcode/data

Abstract

We describe the creation of a physical artwork that was performed in synergy between an artist, a computer scientist and generative AI tools. A latent diffusion model was finetuned on photographs of the artwork of the specific artist and the generative model then generated synthetic artworks in a similar style. From the generated artworks a subset was selected to be painted again with acrylic on canvas by the original artist. In addition to the physical artifact an augmented reality component was added which brings the artwork to life with a set of generative video models. Together with this paper we release part of the artwork (training data), the code that was deployed to generate the artwork as well as the augmented reality experience for arts, research and education under https://github.com/BernhardEgger/ARTimate

Comment
presented and published at AI for Visual Arts Workshop and Challenges (AI4VA) in conjunction with European Conference on Computer Vision (ECCV) 2026, Malmö, Sweden

Closest papers

Nearest neighbours by meaning across the whole index.

Artly: Exploring Digital Artists' Perceptions of AI-Generated Feedback

cs.HC ·2026-08-17 ·Ulvi Rajabli, Alexander Wiethoff, Zelun Tony Zhang
published similarity 0.65
Abstract

Recent developments in generative AI have lowered barriers to image generation, but existing tools mostly optimize for efficiency, producing generic results and offering little support for artistic growth. We present Artly, an AI system that combines personalizable AI feedback with human-authored learning resources. In a between-subjects study with artists, we compared a mode without image generation features against one that allowed to generate variations of users' illustrations. Artly was perceived as helpful for learning and self-improvement, with the exception of the most proficient participants. Participants who used the image generation feature interacted slightly less with the AI feedback. They reported feeling more creative after using Artly than participants using the restricted mode, while reporting slightly lower scores on new ideas for their work. Overall, our findings underline the potential of our feedback approach for supporting artistic growth in a manner that is well received by artists.

0.19

Real-time Learning and Evolution in Robotic Art Installations

cs.HC cs.LGcs.NEcs.RO ·2026-09-11 ·Sofian Audry, Stephen Kelly
similarity 0.61
Abstract

We present three robotic art installations which explore the aesthetics of adaptive behavior. Through embodied machine leaning and digital evolution, these works draw viewers into an artificial ecosystem in which open-ended novelty, trial-and-error learning, competition, and cooperation emerge in real time. Research-creation practices are examined in relation to these works, focusing on how they redefine the role of artists within a human-machine collective while examining points of convergence and divergence between artistic and engineering approaches to adaptive robotics. The systems in question use learning and evolutionary processes not as a means to optimize a specific solution, but as an aesthetic experience on its own, suggesting new modes of interdisciplinary art-science research. Finally, we discuss strategies and practices to elevate the aesthetic experience for audiences, including contexts of presentation as well as temporal and material considerations for artworks based on embodied adaptive systems.

0.16

From Style Replication to Style Exploration: Enabling Art Style Exploration with Analyze-Experiment-Resituate Framework

cs.HC cs.AI ·2026-08-14 ·Wen-Fan Wang, TsaiHsuan Lin, Chi-Lan Yang, An-Ru Cheng, Bing-Yu Chen
top venue similarity 0.59
Abstract · Accepted to UIST '26

Art style is a signature of professional digital artists that develops through repeated experimentation, reflection, and adaptation. While generative AI (GenAI) can reproduce styles with high fidelity, current tools provide limited support for exploring new stylistic directions and may encourage style replication over exploration. To address this gap, we propose Analyze-Experiment-Resituate (AER), a framework for AI-assisted style exploration derived from interviews with 10 professional digital artists. Rather than prioritizing visually appealing outputs alone, AER supports three core practices of style exploration, including interpreting references, trying out stylistic possibilities, and reflecting on how emerging styles may be received. Specifically, AER enabled artists to (1) analyze artworks into interpretable stylistic elements, (2) have controllable experimentation guided by their own choices, and (3) resituate emerging styles through simulated social perspectives. We implemented AER in a prototype system and evaluated it in a controlled study with 16 artists. Compared with a direct style-transfer workflow, AER increased artists' agency and reflection as they pursued new stylistic directions. A two-week field study with four artists revealed how the AER framework influenced daily style exploration, such as reflection, experimentation, and stylistic decision-making at each stage. We discuss opportunities and challenges in designing AI-assisted style-exploration workflows, and outline implications for future artistic support tools.

0.68

Exploring the Affordances of Generative Image AI for Supporting Early-stage Architect-client Communication

cs.HC ·2026-09-28 ·Chengzhi Zhang, Weijie Wang
similarity 0.58
Abstract · 18 pages

Text-to-image generative AI can produce renderings from natural-language prompts in near real time, making it increasingly popular for rapidly visualizing concepts in early-stage architectural design. Meanwhile, exchanging ideas efficiently and building shared understanding have long been central challenges in architect-client communication. How might the speed of generative image AI change this communication? To explore this question, we conducted a study with 11 architect-client pairs, in which each pair used generative image AI over video conference to collaboratively produce early-stage renderings of the client's "dream house." Our findings suggest that generative image AI helped pairs develop a solid shared understanding by providing concrete visual materials and supporting the exchange of ideas. It also shifted conversation dynamics, enabling clients to participate more actively in shaping design direction. However, challenges emerged, including a stylistic bias toward particular types of images and unpredictable shifts in design direction caused by variation across generations. We conclude with implications for the design of future generative image AI-based systems that support architect-client communication.

0.13

Abstract4D: A Large-Scale Dataset and Framework for Understanding the Visual Language of Abstract Art

cs.CV ·2026-08-28 ·Haowei Zhang, Yuanpei Zhao, Ji-Zhe Zhou, Mao Li
benchmarkdataset similarity 0.57
Abstract

Artificial intelligence can classify artistic styles and synthesize images, but it still lacks a model of the visual language that gives art meaning. Abstract painting minimizes object semantics and foregrounds structural cues, making it an ideal testbed for computational perception. We introduce \textbf{Abstract4D}, the largest dataset of abstract paintings to date: more than 120,000 images paired with rich metadata and multi-dimensional prompts that capture each work's perceptual attributes---\textit{form, color, texture, and composition}. Annotations are produced by a hybrid human--VLM pipeline for quality and consistency. Using Abstract4D, we (i) analyze the semantic structure of abstract art through large-scale embedding visualization, uncovering how perceptual relationships organize artistic meaning, and (ii) establish benchmark tasks for classification, cross-modal retrieval, and text-to-image generation to evaluate how AI models perceive and reproduce abstract visual language. Together, these analyses demonstrate how Abstract4D enables both exploration and quantitative assessment of AI's ability to represent and interpret abstract art.

0.25

PixelBench: Evaluating Language Models for Pixel-Art Creation

cs.CV ·2026-11-16 ·Mutian Hong, Jianxuan Yao, Mingkun Yue, Changkai Li, Hower Yang +1 more
benchmark similarity 0.57
Abstract · 38 pages, 12 figures, 11 tables

Pixel art is widely used in games and digital content creation, requiring readable forms, coherent spatial relationships, and harmonious colors under limited resolution and palette constraints. Language models show growing promise in visual creation, yet their pixel art creation capabilities lack systematic evaluation. We introduce PixelBench, formalizing text-to-image generation and instruction-guided editing for pixel art and providing a benchmark for these tasks. We further present a creation environment in which language model agents invoke drawing tools through code to generate and edit pixel art. We assess the quality of generated artwork through human evaluation and employ a multimodal large language model as a judge, validating the agreement between its automated assessments and human preferences. We compare language models and configurations across diverse subjects and canvas sizes. In our experiments, GPT-6 Astra achieves both the highest average judge score and the best average human rank, highlighting the potential of general-purpose language models for pixel art creation. We release the tasks, all artworks, the human rankings, and the judge protocol.

0.19

How Far Can Coding Agents Go in Visual Generation?

cs.CV cs.LG ·2026-10-13 ·Hengguang Zhou, Yuanhao Ban, Jiaqi Feng, Xiaohuan Pei, Justin Cui +1 more
benchmark similarity 0.57
Abstract

Modern image generation largely relies on specialized generative models that leave the process of image construction implicit in learned parameters. We explore an alternative: general-purpose coding agents that construct images through executable programs. Our study of zero-shot drawing on AgentDrawBench, a 200-prompt benchmark, reveals a distinctive capability profile. Agents excel at preserving structure and satisfying precise visual constraints, achieving competitive results in domains where compositional accuracy matters more than photorealistic appearance, while remaining limited in perceptual richness. Their visual expressiveness varies with the drawing interface, and a qualitative study on reconstruction shows how procedural skills extracted from human demonstrations support different artistic media. We then examine code as an external visual language of thought: a structured, executable representation that agents can construct and inspect. We test it in visual question answering task and find reconstructed visual code retains substantial information for question answering and, in some domains, supports higher accuracy than the original image. These abilities raise a further question: do agents draw on a shared internal representation of scene content beyond a particular drawing program? We explore an internal visual language-of-thought hypothesis, in which a shared, compositionally structured representation supports visual operations across drawing languages. Cross-harness drawings and images assembled from independent single-pixel queries exhibit related layouts and tones. Agents also maintain self-generated room arrangements across viewpoints after visible drawings are removed. These results demonstrate that the coding agent would maintain a consistent and coherent world inside its imagine even before the harness gets involved and the generation starts.

0.29

A Design Space for Visual Interfaces for Generative Image Models

cs.HC ·2026-09-16 ·Susie S. Y. Li, Mingwei S. G. Li, Remco Chang
similarity 0.57
Abstract

Interactive visual interfaces have become an important means of controlling generative image models, enabling users to manipulate generation through prompts, direct manipulation, and a range of interactions. However, existing techniques are typically presented as independent systems, making it difficult to understand how they relate, compare their interaction mechanisms, or identify opportunities for new interface designs. We introduce a design space for interactive visual interfaces for generative image models derived from 51 research systems and practitioner tools. The framework decomposes each system into three complementary components: the user interface (U), the controllable model objects (Z), and the mapping function ($φ$) that translates user interaction into model operations. This decomposition provides a common representation for analyzing heterogeneous interaction techniques across model families, revealing recurring design patterns and underexplored regions of the design space. We further present an interactive corpus explorer that support comparative analysis, and discuss usage scenarios for both educational settings and HCI/AI practitioners identifying research and design opportunities.

0.07