CS Paper Radar

From Semantic Editing Intentions to Persistent Parametric Controls for AI-Assisted Image Editing

Rifat Mehreen Amin, Michelle Dutoit, Anton Rockenstein, Baptiste Caramiaux, Andreas Butz

cs.HC ·submitted 2026-10-14 14:39 UTC · v1

Abstract

AI-powered image editing increasingly allows users to express high-level editing intentions, yet how these intentions are translated into concrete editing actions often remains difficult to understand. We present Atelier, a semantic image editing tool that uses image semantics and user intent to determine which editing controls to surface and how to initialize them. Guided by a formative study with eight image-editing practitioners, Atelier composes context-specific, directly manipulable controls that users can refine rather than committing AI interpretations directly to finished edits. In a within-subjects study with 12 practitioners, participants preferred AI-composed controls, described them as supporting creative exploration, and actively refined AI proposals. However, experiences of control were mixed, and interviews highlighted limited insight into why particular controls and values were proposed. Our findings suggest that making AI interpretations actionable through manipulable controls can support exploration and refinement, but actionability alone does not make those interpretations transparent to all users.

Closest papers

Nearest neighbours by meaning across the whole index.

reComposer: Editable Planning for Controllable Image Generation

cs.HC cs.AI ·2026-11-09 ·Susie S. Y. Li, Angie Boggust, Fred Hohman, Donghao Ren, Dominik Moritz +1 more
similarity 0.74
Abstract · 21 pages, 14 figures, 4 tables

Prompt-based image generation makes it easy to produce visual assets, but offers little support for engaging with the creative process. Prompting collapses interdependent creative decisions into a monolithic instruction and returns a finished image, leaving control limited to revising the prompt or correcting the model's output. We present reComposer, a process-oriented image-generation interface built around editable planning, which decomposes users' evolving intent into meaningful creative decisions - such as subject, composition, or palette - and collaborates with users to explore underspecified goals and alternatives. reComposer supports conversational and direct manipulation of the plan, moving between concept-level intent and visual-level control. We evaluated reComposer with 8 design and non-design professionals. Compared to prompting, participants felt greater control and ownership while developing visual assets, exploring alternatives, and iterating on details. Our findings suggest how shifting generative AI interaction from specifying outputs to shaping process can support creative thinking alongside asset production.

0.13

Grounded Exploration for Open-Ended Image Editing

cs.CV ·2026-10-24 ·Jieyu Zhou, Mehdi Ben Ayed, Shubham Gupta, Zhenyu Tan, Jiajing Xu +4 more
similarity 0.70
Abstract

Open-ended image-editing requests, such as ``decorate this room,'' admit multiple valid realizations. Direct sampling may produce ungrounded variation, whereas explicit diversity prompting often produces superficial differences. We study how to ground these requests without prematurely eliminating their legitimate ambiguity. We introduce a two-stage framework that first identifies diverse, feasible edit scopes and then realizes them as executable edit instructions. Across 300 open-ended image-editing tasks, our approach achieves 24.6% higher mean semantic dispersion and 17.1% higher mean groundedness than direct diversity prompting, while producing more valid and distinct realizations. These results show that structuring feasible edit directions before realization supports more useful grounded exploration.

0.19

Shaping AI's Beliefs Before It Generates: Human Sense of Agency in Creative AI

cs.AI cs.HC ·2026-11-16 ·Zi Wang, Mahima Pushkarna
top venue similarity 0.70
Abstract · The Proactive Co-Creator (PaCC) can be accessed at https://proactive-co-creator.github.io/. Accepted at Neural Information Processing System…

AI systems for creative media generation expand human capabilities yet risk diminishing human agency. A core problem is anchoring, where the user's thinking becomes anchored to a polished, generated artifact, shifting the user's role from active authoring to reactive editing. We propose pre-generation belief controls that can empower creators to inspect, revise, and steer the AI's interpretation before any media is generated, so that the initial anchor is set by the human. We formalize four design principles and instantiate them in the Proactive Co-Creator (PaCC), a system for early-stage conceptual ideation and prototyping that proactively surfaces its assumptions and uncertainty through clarifications, belief graphs, and media attributes, inviting users to shape the AI's beliefs before generating the final outcome. Using PaCC as a design probe in a small-scale, single-arm exploratory user study, we observed that participants reported directionally positive sense of agency and process control relative to their familiar prompt-based AI tools, noting that surfaced assumptions helped them think through details they had overlooked, whereas their feelings about ownership and authorship diverged

0.48

OmniScribble: Mixed-Initiative Authoring of Animated Sketches through Inspectable and Repairable AI Decisions

cs.HC ·2026-11-03 ·Hien Trinh, Tan-Hiep To, Trung-Nghia Le
similarity 0.67
Abstract

AI-assisted creative tools reduce the effort of authoring content, but delegating creative decisions to AI can make it difficult for authors to understand, correct, or redirect work. We present OmniScribble, a system for animating multi-object sketches that treats object decomposition and motion planning as editable artifacts. Rather than generating animation end-to-end, OmniScribble presents AI proposals at verification checkpoints, where authors can accept, repair, or regenerate them. Both manual and AI-assisted authoring operate on the intermediate representation and rendering pipeline, allowing us to isolate AI delegation. In a within-subject study with eight participants, AI-assisted authoring yielded a median within-participant reduction in completion time of 71.4\%, while perceived control and motion-intent alignment remained high. Interaction traces and interviews show that participants adapted to AI errors by repairing local issues, regenerating mismatches, and accepting proposals. These findings suggest that inspectable, repairable delegation enables generative automation while maintaining control over the outcome.

0.08

Who Shaped What? Untangling Human and AI Creative Contributions Through Spatial Provenance in Image Editing

cs.HC ·2026-10-27 ·Riya Sahni, Christine Dierk, Lydia Chilton, Eunyee Koh, Doga Dogan +1 more
similarity 0.67
Abstract · 24 pages, 7 figures

Images co-edited with AI are often labeled to disclose AI use. However, creators feel these labels do not sufficiently describe their contributions to the editing process. Editing histories preserve requests, suggestions, and revisions, but how do creators use these logs to judge contribution? We investigated this with Roop, a mixed-initiative design probe that links image regions to editing histories (spatial provenance) and summarizes interactions in a heat map. Twenty participants edited images, annotated human and AI contributions, then reviewed the spatial provenance heat map. Participants credited themselves for directing changes while crediting AI for determining visual details. They judged contribution partly by whether their interactions achieved their intentions. Reviewing provenance helped participants remember interactions without always changing whom they credited. These findings motivate provenance systems that preserve enough context for creators to explain how interactions shaped their work, alongside the record of what happened.

0.25

CraftTrace: Unflattening Videos into Malleable, Creation-Inspired Structures for Generative Editing

cs.HC ·2026-09-24 ·Boyu Li, Yuqian Zhou, Duotun Wang, Ding Li, Zhe Lin +4 more
similarity 0.66
Abstract

Recent generative video editing models enable video content modification (e.g., changing a character) but target short clips. Extending them to full multi-shot videos requires tedious work to locate relevant content across shots, segment it into clips, craft context-aware editing prompts for each clip, and repeatedly articulate complex editing intent. To address this, we explore an interaction paradigm for editing through underlying video structures (e.g., scripts, scenes, characters, shots, and their relationships). We present CraftTrace, an interactive prototype that transforms a video into a malleable, multilevel structure for generative editing. Users work in task-centric workspaces to modify elements or reshape relationships, while an AI agent translates and propagates changes across the video. A user study and expert review show that this structure helps users understand videos, formulate and refine editing intent, and explore alternatives, supporting rapid prototyping during early-stage exploration and full video post-production.

0.30

Beyond Explicit Intent: Discovering and Shaping Artistic Intent through Human-AI Co-Creation

cs.AI cs.CVcs.HC ·2026-10-15 ·Renye Yan, Jialun Zhong, Jikang Cheng, Yi Gao, Yanzeng Li +1 more
similarity 0.66
Abstract · Human-AI Co-Creation, Reinforcement Learning

Generative AI is becoming an important medium for artistic creation, yet existing interactions often assume that creators can specify intentions in advance and accurately communicate them through text prompts. Artistic intentions, however, may be vague, latent, or recognizable only after seeing concrete visual possibilities. We propose a human-AI co-creation paradigm beyond explicit intent expression. By expanding model exploration, we expose artists to diverse visual possibilities, allowing them to identify previously unarticulated preferences through observation, comparison, and selection. We then integrate artists' curatorial judgments into reinforcement learning, assigning different learning strengths based on preferences over generation trajectories, so recognized directions are more strongly reinforced and the model gradually adapts to individual aesthetics. This creates a continuous "explore-identify-shape-re-explore" loop in which artistic intent is progressively discovered, externalized, and shaped. Through three user studies, we examine latent-preference discovery, personalized preference alignment, and the externalization of vague, difficult-to-express creative intentions.

0.37

Editable Visual Design

cs.CV cs.CL ·2026-09-03 ·Junyan Ye, Wei Liu, Dongzhi Jiang, Zichen Wen, HaoDong Li +7 more
similarity 0.66
Abstract

While diffusion base models such as GPT-Image-2 and Nano-Banana exhibit remarkable visual expressiveness, their end-to-end generation inherently yields flattened bitmaps with error-prone text, precluding layer-wise post-editing. Conversely, code-based visual generation via Coding Agents provides precise layout control and decoupled layers, yet remains constrained by a lack of global aesthetic intuition and the difficulty of coding complex visual assets. To address this, we propose Editable Visual Design, a new paradigm driven by a Coding Agent. We designate the VLM as the ``creative brain'' for requirement comprehension, task planning, and aesthetic judgment, while utilizing the image generation model as an on-demand ``visual world simulator'' to synthesize standalone visual assets. Operating under an ``imagine first, then act'' closed-loop workflow, the agent generates isolated assets, writes native HTML/CSS, and iteratively refines the design against visual rendering feedback. Furthermore, Agent Design Replay faithfully reproduces the creative and reasoning trajectory akin to that of professional human designers. Ultimately, the system delivers editable artifacts with decoupled layers and real text, enabling users to perform intuitive mouse dragging and layout adjustments on a graphical user interface. Validations on posters, infographics, and other scenarios show that this paradigm successfully achieves both refined aesthetics and production-grade editability.

0.35