CS Paper Radar

Lived Experiences of Power and Agency: Achieving Voice Sovereignty in Assistive Speech Technology for Nonbinary Users

Maxwell Hope, Juliana Francis, Joakim Gustafson, Éva Székely

cs.CY cs.HC ·submitted 2026-11-16 10:31 UTC · v1
top venue

Abstract

Speech-generating devices (SGDs) are essential tools for many speech-disabled individuals, yet current systems often reinforce normative assumptions about identity and communication. Prior research on gender expansive SGD users has largely focused on gendered voice options, with less attention to broader identity alignment and the technological conditions that shape users' agency. This study examines how gender expansive SGD users experience power over their voices using thematic analysis of qualitative survey data. Three themes emerged: (1) integration of SGDs into daily life, (2) identity expression, and (3) power and agency. Participants expressed the need for more responsive and reliable technology, inclusive and customizable voices, and greater autonomy in defining how their voices sound and are perceived. Ultimately, their perspectives call for a reimagining of SGD systems as tools for reclaiming the power of one's voice and the ability to define and enact one's will through it.

Comment
Proceedings of Interspeech 2026
Journal ref
Proc. Interspeech 2026, 3663-3668
DOI
10.21437/Interspeech.2026-2663

Closest papers

Nearest neighbours by meaning across the whole index.

Seeing the Voice, Preserving the Self: A Participatory Design Approach to Deaf-Centric Text-to-Speech

cs.HC ·2026-09-09 ·Shela Atemnkeng, Patrick Boudreault, Paige DeVries, Lloyd May, Christian Vogler
top venue similarity 0.61
Abstract · Accepted for publication at ACM ASSETS 2026

We describe a participatory design approach toward developing Deaf-centric text-to-speech (TTS) technologies. While TTS is growing rapidly in the mainstream, it has received little attention to date in the deaf and hard of hearing (DHH) technology space. Critical problems have remained unaddressed for DHH users, including the ability to manipulate tone, emotions and delivery via non-auditory means. Verifying that the generated speech matches intent and is appropriate for a given situation without having to listen to it is another challenge. Respecting cultural and identity factors in the generated speech is also important. This work explores the design space with DHH participants through two focus groups, three co-design sessions, and four one-on-one early-stage design evaluation sessions. Participants included people both familiar and unfamiliar with TTS, as well as DHH content creators. We describe key findings, design ideas, results, and implications for future Deaf-centric TTS development. We also identify unmet technology requirements that pose barriers to adoption of Deaf-centric TTS technology.

0.46

Aspirational Identities: How VTubing Affords New Modes of Digital Embodiment

cs.HC ·2026-11-14 ·Wells Lucas Santo, Hibby Thach
published similarity 0.57
Abstract · 5 pages, 3 figures, Body Politics workshop at CHI 2025

VTubing, short for "Virtual YouTubing", is a modality of streaming where a CGI avatar is used in place of the streamer's analog face and body. As VTubing has become increasingly popular, especially for queer and trans streamers of color, it is worth studying as a way for streamers to express identities that they hope to embody, which we call "aspirational identities". In this workshop submission, we draw on preliminary findings from qualitative research to argue that VTubing is a potent object of study for understanding digital embodiment and the performance of identity online, especially for questions of race, gender, sexuality, and disability.

0.47

No-Shot Text-to-Speech: Limitations of Zero-Shot TTS and its Evaluation Methods in Representing Queer and Transgender Voices

cs.SD ·2026-11-16 ·Juliana Francis, Robin Netzorg, Joakim Gustafson, Éva Székely
top venue similarity 0.56
Abstract · Proceedings of Interspeech 2026

Gender expansive voices remain underrepresented in speech datasets, which could cause challenges with generalizability in zero-shot Text-To-Speech (TTS) systems. We evaluate six zero-shot TTS models on two datasets: one containing non gender expansive voices (N-GE) and one with gender expansive (GE) voices from self-identified speakers. Human ratings found that 2 of the 6 models synthesize less similar GE voices compared to N-GE voices, and 3 have improved performance for GE voices. Automated evaluations yield conflicting results, with speaker similarity and automated mean opinion score predictors rating performance of GE voices inconsistently between models and human ratings. This highlights a potential blind spot in evaluation pipelines, emphasizing a need for more representative data and metrics that better capture human perceptual judgments. Our findings stress the need to include transgender, queer, and minority communities in creation of better datasets and model training.

0.39

Queer inclusion in speech datasets: An audit and taxonomy of practical tensions

cs.AI ·2026-09-21 ·Brooklyn Sheppard, Anaelia Ovalle, Adina Williams, Levent Sagun
top venue similarity 0.56
Abstract · Accepted at Interspeech 2026

In this paper, we examine speech datasets for their inclusion of LGBTQIA+, or queer, voices and provide a taxonomy of tensions to better understand why there is a lack of such voices in current speech technology datasets. Through an audit of six diverse speech datasets, we find that measurable queer representation is low (0-1.4% of speakers) - insufficient for robust disparity measurement. We take this community as a case study to consider what challenges and tensions are associated with collecting speech data from marginalized communities. For comparison, we audit an additional two datasets from the speech sciences that were created by, for, and with the queer community. We note that many customs in speech dataset collection efforts in AI and speech technology research may conflict with values emphasized in participatory approaches with marginalized communities, and provide a taxonomy describing these tensions.

0.32

Towards participatory speech dataset curation: A queer case study and conceptual framework

cs.AI cs.CY ·2026-09-21 ·Brooklyn Sheppard, Anaelia Ovalle, Adina Williams, Levent Sagun
top venue similarity 0.54
Abstract · Accepted at Interspeech 2026

In this paper, we motivate the need for a participatory speech dataset creation framework through a case study of the LGBTQIA+, or queer, community - a community with documented concerns about AI and reported harms, including attempts to develop 'gaydar' technologies that purportedly identify individuals as queer. We review common speech data collection practices, why these methods may be unsuitable for engaging with queer speakers, and discuss previous efforts in participatory AI with queer community engagement, as well as participatory endeavours specific to speech data collection for other marginalized communities. From this review, we develop a conceptual framework for participatory speech data curation by, for, and with marginalized communities drawing on insights from co-design and knowledge sharing. We propose a framework comprising overlapping and two-way processes of defining a community, project formulation, modes of participation, and personal autonomy.

0.43

Assembling, Breaking, and Refusing the Mask: Agency in AI-Mediated Self-Presentation in Livestreaming

cs.HC ·2026-09-23 ·Yang Hong, Nusrat Jahan Mim, Sharifa Sultana
similarity 0.51
Abstract

Our mixed-method study examines how Chinese women livestreamers use masking to construct idealized mediated personas while navigating gendered, commercial, organizational, and platform pressures alongside personal agendas. We built on the concept of masking, analyzed 627 recruitment posts, and conducted livestream observations and interviews with 26 Chinese women streamers. We found that streamers assembled masks across bodies, AI-mediated technologies, spaces, performances, and social relations to become recognizable while protecting personal boundaries. These masks were continually negotiated, and participants sometimes broke, resisted, or refused them when demands became misaligned or unsustainable. We conceptualize masking as a sociotechnical assemblage in which agency lies in preserving, disrupting, and reconfiguring relations rather than controlling a single interface. We further theorize breaking as a consequential part of masking that exposes hidden labor and unequal costs of visibility. We offer theoretical and design directions for more negotiable, contestable, and agency-supporting AI-mediated self- presentation.

0.27

VoCa: Designing Speech-Canvas Interaction for Voice-Based Conversational Agents

cs.HC cs.AI ·2026-10-03 ·Yate Ge, Run Yuan, Yueran Qi, Wenjie He, Jiaqi Mo +5 more
similarity 0.50
Abstract · 22 pages, 11 figures, 5 tables

People write and sketch while speaking to explain, organize, and develop content together. Inspired by these practices, we investigate how voice agents can use a canvas alongside speech in multi-turn conversations with users. We conducted a two-part formative study: an observational study of how pairs coordinated speech and boardwork, followed by a design workshop that informed a design space for speech-canvas interaction with voice agents. Building on these insights, we developed VoCa, a voice agent that coordinates speech with visual object creation, annotation, and attention guidance. A five-day deployment with 18 participants examined usability, experiences of speech-canvas interaction, patterns of use, and desired improvements. Participants' experiences highlighted opportunities for speech-canvas interaction in learning, work, and daily life, alongside challenges in coordinating what agents say and show in ways users can follow and influence. These findings inform how voice agents can use a canvas alongside speech in conversation.

0.36

"I Felt Very Seen, But Still Very Alone": Longitudinal Trajectories of General-Purpose LLM Use for Socioemotional Support

cs.HC ·2026-09-11 ·Meryl Ye, Briana Vecchione, Livia Garofalo, Ranjit Singh
similarity 0.50
Abstract

People increasingly use general-purpose chatbots such as ChatGPT, Claude, and Gemini for mental health and emotional support. We report a multi-stage longitudinal qualitative study of 18 U.S. adults, conducted from April to December 2025, combining initial interviews, a four-week diary study, focus groups, and exit interviews. We find that socioemotional use often emerged gradually out of practical use and when other forms of support were unavailable. Participants developed routines and boundaries around chatbot use, which were disrupted by model updates, evolving public discourse about AI harms, and changes in personal circumstances. We demonstrate how longitudinal study captures factors beyond the human-AI dyad, and argue that HCI researchers and designers should account for users' histories with their chatbots and broader care ecologies when evaluating AI systems over time and introducing updates that may disrupt established sources of support.

0.20