CS Paper Radar

DuoSketch: How Pairs Navigate Challenges in AI-Supported Collaborative Design Ideation

Weiyan Shi, Darryl Lim, Geraldine Quek, Kenny Tsu Wei Choo

cs.HC ·submitted 2026-10-07 15:30 UTC · v1

Abstract

Generative AI offers new resources for collaborative design ideation, yet how designers work with it as a shared concept develops remains underexplored. We developed DuoSketch, integrating a shared canvas and live transcripts with a separate AI for each member of a pair. An exploratory qualitative study with 12 pairs identified three challenges: unresolved fit between AI proposals and shared design purposes, shared meanings not expressed in AI responses, and agreed changes missing from later outputs. We found that pairs navigated these challenges through bridging work in two directions: AI -> Shared Design (reworking features, developing uses, and assessing fit with shared requirements) and Shared Design -> AI (supplying materials, explaining meanings, and communicating decisions). We discuss how future AI systems can support the joint exploration and articulation of design ideas.

Comment
work in progress

Closest papers

Nearest neighbours by meaning across the whole index.

CommSketch: How Speaking while Sketching Steers Human--AI Design Ideation

cs.HC ·2026-09-29 ·Weiyan Shi, Darryl Lim, Geraldine Quek, Kenny Tsu Wei Choo
similarity 0.75
Abstract · work in progress

Designers often speak while sketching when explaining ideas, yet AI design tools often rely on sketches or prompts, overlooking context expressed as ideas develop. We developed a sketch-based AI design interface that jointly interprets sketches and concurrent speech. Through a between-subjects study ($N=24$), we examined how speaking while sketching steers human--AI design ideation compared with sketches alone. For creativity support, concurrent speech supported natural expression of design intent and efficient visualisation. For human--AI collaboration, speech helped establish a shared understanding of design intent, supported significantly higher perceived alignment ($p<.05$), and enabled participants to guide AI contributions as ideas co-evolved. We discuss how future human--AI design tools could support dynamic alignment, broader multimodal expression, and human--AI co-creativity.

0.20

Scanvas: Discovering and Developing Synergistic Opportunities in Generative Design Spaces

cs.HC ·2026-09-28 ·Yaqing Yang, Aniket Kittur, Hongyu Howie Wang, Nikolas Martelaro, Matt Klenk +2 more
similarity 0.70
Abstract

Good design is often synergistic, creating super-additive value by linking goals so that existing resources produce greater outcomes. However, finding these synergistic opportunities in sparse design spaces is difficult, and current LLM-supported ideation tools largely default to additive paradigms such as feature blending, variant generation, or local patching. We present Scanvas, an AI-supported system for systematically discovering and developing synergistic design opportunities. Scanvas operationalizes synergy through a two-step computational process: first, it decomposes seed ideas into explicit properties (components, behaviors, surpluses, and issues) to enrich the design space; second, it systematically searches across enriched ideas using three theory-grounded strategy operators: unlocking or strengthening goals, turning weaknesses into resources, and sharing components across functions. We instantiate Scanvas as an auto-generation pipeline and an interactive system. Pipeline ablations and a user study with 12 professional designers demonstrate that Scanvas enables users to surface and develop significantly higher-quality, synergistic concepts compared to LLM ideation baselines.

0.23

Exploring the Affordances of Generative Image AI for Supporting Early-stage Architect-client Communication

cs.HC ·2026-09-28 ·Chengzhi Zhang, Weijie Wang
similarity 0.69
Abstract · 18 pages

Text-to-image generative AI can produce renderings from natural-language prompts in near real time, making it increasingly popular for rapidly visualizing concepts in early-stage architectural design. Meanwhile, exchanging ideas efficiently and building shared understanding have long been central challenges in architect-client communication. How might the speed of generative image AI change this communication? To explore this question, we conducted a study with 11 architect-client pairs, in which each pair used generative image AI over video conference to collaboratively produce early-stage renderings of the client's "dream house." Our findings suggest that generative image AI helped pairs develop a solid shared understanding by providing concrete visual materials and supporting the exchange of ideas. It also shifted conversation dynamics, enabling clients to participate more actively in shaping design direction. However, challenges emerged, including a stylistic bias toward particular types of images and unpredictable shifts in design direction caused by variation across generations. We conclude with implications for the design of future generative image AI-based systems that support architect-client communication.

0.13

Generative AI and Extended Reality in Collaborative Architectural Design Education: An Exploratory Studio Study

cs.HC cs.AI ·2026-09-11 ·Yao Xiao, Max Chen, Yichen Li, Nathaniel Powers, Maxwell Wiesenfeld +3 more
similarity 0.67
Abstract

Architectural design education relies heavily on visual ideation and representation to support collaborative learning in studio environments. Recent advances in generative artificial intelligence (GenAI) and extended reality (XR) offer new opportunities for rapid idea exploration and immersive spatial visualization. This exploratory mixed-methods classroom study investigated how GenAI-assisted multi-user XR influenced collaborative architectural conceptual design. We developed GenARch, a pipeline that integrates GenAI-based visual generation with collaborative XR environments, and deployed it in an undergraduate architectural design studio. Twenty-seven students formed seven self-selected design teams; four teams incorporated GenARch into their usual course workflow to support collaborative ideation and visualization, while three teams continued the same course workflow without GenARch. Pre- and post-intervention surveys assessed design self-efficacy, attitudes toward collaborative learning, and teamwork; a seven-member panel evaluated team design presentations; and GenARch teams participated in group interviews. The quantitative results showed larger relative declines in confidence and outcome expectancy for the GenARch condition and a positive difference-in-differences estimate for perceived conflict management, while panel-rated presentation outcomes were not significantly different between conditions. Interviews indicated complementary roles for the technologies: GenAI supported idea externalization and visual reference generation, whereas XR supported spatial, contextual, and scale-based evaluation. Students also reported challenges related to control, dimensional fidelity, shared attention, and motion comfort. These findings highlight both opportunities and limitations when GenAI and XR are incorporated into collaborative design education.

0.27

Assessing the Applicability of Existing Design Recommendations to AI Companion Design: A Multi-Method Study

cs.HC cs.AI ·2026-09-13 ·Soobin Cho, Deveshi Modi, Divya Mavinkurve, Jieqiong Ding, Mark Zachry
publishedhot direction similarity 0.67
Abstract

With the rapid proliferation of large language model (LLM)-based systems, AI companions have emerged as conversational agents designed to cultivate emotional connection rather than primarily to support humans in instrumental tasks. Because engagement with AI companions involves relational, emotional, and potentially long-term interactions, their design is consequential. Prior work has offered guidance for designing trustworthy and relational AI systems and has begun to examine design for AI companionship. However, while such work provides insights into possible design solutions, less is known about what makes AI companion design difficult as a design problem. To examine this challenge, we assessed the applicability of existing design recommendations from adjacent domains in the context of AI companion design. Our multi-method investigation unfolded across four phases: literature review, practitioner co-analysis, internal heuristic evaluation, and external expert assessment. Throughout this process, we synthesized nine design principle areas that surfaced tensions in the applicability of existing recommendations to AI companion design. Our findings show that ethical and UX-oriented considerations are deeply intertwined and often require context-sensitive application. We document a systematic, multi-method problem analysis that uses these principle areas as an analytic artifact to examine why existing recommendations cannot be directly transferred to AI companion contexts.

0.33

Designing UIs with GenAI: Understanding the Use, Benefits, and Limitations of Prompt-to-Design Generators

cs.HC ·2026-11-09 ·Jingzhou Ye, Yao Li, Xueqiang Wang
similarity 0.67
Abstract

The integration of generative AI (GenAI) into user interface (UI) design has led to prompt-to-design generators (P2dGens), tools that enable designers to create UI prototypes from textual prompts efficiently. Despite their growing adoption, little is known about how designers use these tools in everyday practice, their benefits, and limitations. We conducted semi-structured interviews with 17 UI designers to investigate P2dGens use, focusing on workflow integration, attitudes toward generator-assisted design, and the organizational climate. Findings show that designers primarily use P2dGens as ideation accelerators rather than end-to-end solutions, and they adopt a variety of individual and collaborative prompting strategies. Designers expressed complex attitudes, noting gains in efficiency and inspiration while also highlighting concerns about loss of personal creativity and design quality. We also observed emerging governance practices and varying attitudes within organizations toward P2dGens. These insights illuminate how P2dGens reshape UI design workflows and contribute to understanding human-AI collaboration in UI design.

0.27

Integrating Multi-Source Feedback in Computational Design

cs.HC ·2026-09-08 ·Francisco Erivaldo Fernandes Junior, Thomas Langerak, Mira Keränen, Danqing Shi, Ardak Alipova +1 more
published similarity 0.66
Abstract · Accepted for publication in ACM Transactions on Interactive Intelligent Systems (TiiS)

In real-world design practice, evaluations rarely rely on a single source of judgment. Designers routinely combine expert opinions, empirical studies, and computational models, each with distinct strengths and limitations. While machine learning offers methods to integrate multiple feedback sources, these approaches remain largely inaccessible to designers without technical expertise. In this paper, we explore how to integrate multiple feedback sources, primarily through: (1) a practical approach for multi-source integration, and (2) its implementation in MUSE, a no-code tool that allows designers to combine and balance diverse sources. Our technical findings show that independent modeling of multiple evaluation sources enables exploration across heterogeneous feedback, accommodates different evaluation speeds, surfaces disagreements between sources, and supports an adaptable evaluation setup that designers can reconfigure during their process. In a visualization design study, participants navigated their own judgments alongside simulator feedback, reporting a perception of enhanced confidence and flexibility. Our results highlight the viability of multi-source integration to support computational design, offering a step toward bridging the gap between advanced optimization methods and design practice.

0.18

Understanding Creative Design Practices among Data Artists

cs.HC ·2026-09-23 ·Tianwei Ma, Anna Offenwanger, Naimul Hoque
similarity 0.66
Abstract · 28 pages, 7 figures

Creative and artistic data visualizations communicate stories and invite engagement, yet how designers develop their expressive forms remains poorly understood. We investigate the design process of data artists through three complementary studies: an analysis of 40 public project accounts, artifact-anchored interviews with seven experienced data artists, and a design task-based study with eight data artists. We find that stories and visual forms develop together through data exploration, reference adaptation, sketching, and prototyping. Inspiration comes from data, existing work, everyday imagery, and personal experience. Sketches help develop mappings, while prototypes with real data can reshape representations and intended stories. Designers consider multiple possibilities but typically develop one direction at a time, partly because producing alternatives is costly. Their choices balance meaning, visual appeal, readability, and feasibility. These findings inform tools connecting stories, references, and real data, including AI assistance that supports testing and revising alternatives while preserving designers' creative judgment.

0.13