CS Paper Radar

Does AI Save Time on Product Design? A Randomized Controlled Experiment of AI Prompt-to-Design Workflows

Remy Stewart, Olabode Anise, Andrew Hogan, Augustus Griffin

cs.HC cs.AI ·submitted 2026-09-22 17:13 UTC · v1

Abstract

AI tools for digital product design now offer prompt-to-design capabilities, allowing designers and their non-designer colleagues to create prototypes through conversational workflows with large language models (LLMs). While these tools promise time savings, experimental evidence in product design remains limited compared with evidence from software engineering. We conducted a randomized controlled trial with 50 product designers and 50 product managers to evaluate prospective time savings from leveraging Figma Make in design work. Participants attempted three standardized design tasks with or without access to Figma Make. Among participants who completed the study tasks, access to Figma Make was associated with approximately 20% shorter completion times, with larger gains among product managers. Our findings suggest that prompt-to-design tools may enable product managers to further contribute to design work, while the benefits for professional designers may be task dependent.

Closest papers

Nearest neighbours by meaning across the whole index.

AI Tools Adoption across the Double Diamond Workflow: Phase, Mode, and Barriers in Designer Practice

cs.HC ·2026-09-28 ·Sepideh Tajarmakan, Khashayar Hojjati Emami
similarity 0.70
Abstract

Designers are adopting AI faster than the tools built for them can keep up. General-purpose conversational AI led AI use among designers in three of the four phases of design work, ahead of tools built for design. We surveyed 443 designers from at least 43 countries about AI use in each phase of the Double Diamond: Discover, Define, Develop and Deliver. Tools were classified by output and function. Of these designers, 79.7% confirmed AI use in at least one phase. Adopters used AI in a mean of 2.89 phases, and only 35.1% used it in all four. They added phases in workflow order, from Discover onward. Conversational tools led in Discover, Define and Deliver. AI-native image generation led in Develop, where AI-native tools peaked at 57.6% of tool picks. Embedded AI features in existing design software peaked later, in Deliver (37.5%). Fewer designers used AI in later phases, from 318 in Discover to 182 in Deliver. Those who did named a similar number of tools per phase. Low perceived usefulness was the only barrier that separated non-adopters (40.5%) from adopters (16.4%) after correction for multiple tests. Concern about accuracy was similar in both groups.

0.32

Designing UIs with GenAI: Understanding the Use, Benefits, and Limitations of Prompt-to-Design Generators

cs.HC ·2026-11-09 ·Jingzhou Ye, Yao Li, Xueqiang Wang
similarity 0.69
Abstract

The integration of generative AI (GenAI) into user interface (UI) design has led to prompt-to-design generators (P2dGens), tools that enable designers to create UI prototypes from textual prompts efficiently. Despite their growing adoption, little is known about how designers use these tools in everyday practice, their benefits, and limitations. We conducted semi-structured interviews with 17 UI designers to investigate P2dGens use, focusing on workflow integration, attitudes toward generator-assisted design, and the organizational climate. Findings show that designers primarily use P2dGens as ideation accelerators rather than end-to-end solutions, and they adopt a variety of individual and collaborative prompting strategies. Designers expressed complex attitudes, noting gains in efficiency and inspiration while also highlighting concerns about loss of personal creativity and design quality. We also observed emerging governance practices and varying attitudes within organizations toward P2dGens. These insights illuminate how P2dGens reshape UI design workflows and contribute to understanding human-AI collaboration in UI design.

0.27

Too Late to Prune: Generative AI, the Screen, and Team Creative Decisions

cs.AI econ.GN ·2026-10-10 ·Difang Huang, Shumin Yu, Fadong Chen, Weihua Zhou
position similarity 0.64
Abstract

Generative AI makes options cheap and shifts the bottleneck of creative work from generating options to screening them. We argue that AI's value depends on whether its options arrive before or after the team's screen. In our model, early options compete for a place in the portfolio; late options arrive after that competition and are kept unscreened. In a preregistered experiment, we randomly assigned 148 three-person teams to five schedules of access to the same language model during a product-design task with timed search and selection stages. Moving the same 15 minutes of access from search to selection lowered expert-rated creativity by 0.62 standard deviations, although teams used the model at similar rates. Platform logs locate the difference at the screen. Early access enlarged the pool of ideas fivefold, and teams pruned it. Late-access teams reached the screen with the same small pool as teams without AI and then searched again, devoting 29% of their selection-stage queries to generating new options, compared with 11% for teams with access throughout. Late access added breadth, not quality: these teams submitted 73% more proposals than did teams without AI. Language-model judges detected the benefit of access but not the cost of late timing.

0.31

CommSketch: How Speaking while Sketching Steers Human--AI Design Ideation

cs.HC ·2026-09-29 ·Weiyan Shi, Darryl Lim, Geraldine Quek, Kenny Tsu Wei Choo
similarity 0.64
Abstract · work in progress

Designers often speak while sketching when explaining ideas, yet AI design tools often rely on sketches or prompts, overlooking context expressed as ideas develop. We developed a sketch-based AI design interface that jointly interprets sketches and concurrent speech. Through a between-subjects study ($N=24$), we examined how speaking while sketching steers human--AI design ideation compared with sketches alone. For creativity support, concurrent speech supported natural expression of design intent and efficient visualisation. For human--AI collaboration, speech helped establish a shared understanding of design intent, supported significantly higher perceived alignment ($p<.05$), and enabled participants to guide AI contributions as ideas co-evolved. We discuss how future human--AI design tools could support dynamic alignment, broader multimodal expression, and human--AI co-creativity.

0.20

DuoSketch: How Pairs Navigate Challenges in AI-Supported Collaborative Design Ideation

cs.HC ·2026-10-07 ·Weiyan Shi, Darryl Lim, Geraldine Quek, Kenny Tsu Wei Choo
similarity 0.61
Abstract · work in progress

Generative AI offers new resources for collaborative design ideation, yet how designers work with it as a shared concept develops remains underexplored. We developed DuoSketch, integrating a shared canvas and live transcripts with a separate AI for each member of a pair. An exploratory qualitative study with 12 pairs identified three challenges: unresolved fit between AI proposals and shared design purposes, shared meanings not expressed in AI responses, and agreed changes missing from later outputs. We found that pairs navigated these challenges through bridging work in two directions: AI -> Shared Design (reworking features, developing uses, and assessing fit with shared requirements) and Shared Design -> AI (supplying materials, explaining meanings, and communicating decisions). We discuss how future AI systems can support the joint exploration and articulation of design ideas.

0.04

Understanding Creative Design Practices among Data Artists

cs.HC ·2026-09-23 ·Tianwei Ma, Anna Offenwanger, Naimul Hoque
similarity 0.60
Abstract · 28 pages, 7 figures

Creative and artistic data visualizations communicate stories and invite engagement, yet how designers develop their expressive forms remains poorly understood. We investigate the design process of data artists through three complementary studies: an analysis of 40 public project accounts, artifact-anchored interviews with seven experienced data artists, and a design task-based study with eight data artists. We find that stories and visual forms develop together through data exploration, reference adaptation, sketching, and prototyping. Inspiration comes from data, existing work, everyday imagery, and personal experience. Sketches help develop mappings, while prototypes with real data can reshape representations and intended stories. Designers consider multiple possibilities but typically develop one direction at a time, partly because producing alternatives is costly. Their choices balance meaning, visual appeal, readability, and feasibility. These findings inform tools connecting stories, references, and real data, including AI assistance that supports testing and revising alternatives while preserving designers' creative judgment.

0.13

Probing How Users Interact with Turn-Level Design Frictions for AI Chatbots

cs.HC ·2026-08-23 ·Helen Weixu Chen, Katy Ilonka Gero
similarity 0.60
Abstract · 32 pages, 8 figures, currently under review at ACM IUI 2027

AI chatbots can help people write faster, but they can also encourage overreliance by making it easy to turn minimal input into usable text. We study turn-level design friction: intentional constraints added to each chatbot exchange that slow, limit, or redirect how users request, access, or use model responses. We designed six friction probes, organized around three mechanisms: eliciting user contribution, restricting access to generated content, and reshaping system output. In a within-subject study with 24 participants, all six probes increased workload, task duration, and perceived ownership relative to a conventional AI chatbot, while their effects on recall and recognition were more selective. We further found that participants adapted to friction in different ways, and that the same constraint could support or obstruct involvement depending on users' goals and workflows.

0.48

Shaping AI's Beliefs Before It Generates: Human Sense of Agency in Creative AI

cs.AI cs.HC ·2026-11-16 ·Zi Wang, Mahima Pushkarna
top venue similarity 0.59
Abstract · The Proactive Co-Creator (PaCC) can be accessed at https://proactive-co-creator.github.io/. Accepted at Neural Information Processing System…

AI systems for creative media generation expand human capabilities yet risk diminishing human agency. A core problem is anchoring, where the user's thinking becomes anchored to a polished, generated artifact, shifting the user's role from active authoring to reactive editing. We propose pre-generation belief controls that can empower creators to inspect, revise, and steer the AI's interpretation before any media is generated, so that the initial anchor is set by the human. We formalize four design principles and instantiate them in the Proactive Co-Creator (PaCC), a system for early-stage conceptual ideation and prototyping that proactively surfaces its assumptions and uncertainty through clarifications, belief graphs, and media attributes, inviting users to shape the AI's beliefs before generating the final outcome. Using PaCC as a design probe in a small-scale, single-arm exploratory user study, we observed that participants reported directionally positive sense of agency and process control relative to their familiar prompt-based AI tools, noting that surfaced assumptions helped them think through details they had overlooked, whereas their feelings about ownership and authorship diverged

0.45