CS Paper Radar

What Makes a Question Curious? Measuring Model Curiosity in Human-LLM Interactions

Angana Borah, Rachana Ramchandar, Inderjeet Nair, Rada Mihalcea

cs.CL cs.AI ·submitted 2026-10-24 23:33 UTC · v2

Abstract

Large language models increasingly act as partners in everyday communication. In these interactions, useful assistance may require not only answering, but also asking the right questions that surface knowledge gaps, assumptions, and alternatives. In this study, we refer to such epistemic question-asking as model curiosity, and introduce a theory-grounded taxonomy that distinguishes curiosity-oriented questions from generic model questioning. Across four conversation datasets, we find that curiosity-oriented questions remain rare (17-28% of all questions), but are associated with more exploratory and epistemically rich subsequent user responses, with varying patterns across datasets. We further conduct a human study to evaluate the usefulness of model curiosity, finding that curiosity can encourage exploration, especially in advice, creative, and research contexts. These findings have implications for building LLMs that ask more selectively to support deeper exploration and human-AI collaboration.

Comment
Preprint under review

Closest papers

Nearest neighbours by meaning across the whole index.

CuriousTogether: Implications of Curiosity and Cultural Grounding in Multi-Agent LLM Interactions

cs.CL cs.AI ·2026-10-31 ·Angana Borah, Zoha Hayat Bhatti, Zhijing Jin, Rada Mihalcea
similarity 0.71
Abstract · Preprint under review

Large Language Models (LLMs) are increasingly deployed in multi-agent settings, exhibiting emergent collective behaviors, yet the role of curiosity as a driver of such dynamics remains understudied. We introduce CuriousTogether, a framework evaluating curiosity-driven multi-agent LLM interactions across three complementary dimensions: novelty-seeking, epistemic and social curiosity. Across eight tasks spanning reasoning, creative generation, and social bias mitigation, curiosity-guided multi-agent settings yield improvements over non-curious ones on seven out of eight tasks, with gains of up to 20.6% in story generation (semantic diversity) and a 14.9 pp reduction in stereotype rates. Furthermore, country-conditioned cultural grounding show benefits for story generation and social tasks, but can hurt precision-oriented reasoning. Finally, we show that inference-time multi-agent curiosity-based approach offers favorable quality-token trade-offs, compared with single-agent baselines. Together, these findings support curiosity-guided interaction as a practical mechanism for improving multi-agent collaboration, with downstream benefits for reasoning, creative, and societal tasks.

0.15

The Emergence of Causal Curiosity from Prior Causal Belief Networks

cs.SI ·2026-08-23 ·Zhuoyu Shi, Xintong Jiang, Bohan Jiang, Fred Morstatter
similarity 0.64
Abstract · Presented as a 15-minute talk at NetSci 2026

Causal curiosity is foundational to human cognition. It is the desire to understand why events happen, what mechanisms underlie them, and how outcomes can be explained or anticipated. It motivates exploration, sustains attention, and fuels the search for new knowledge. However, despite consensus on the importance of causal curiosity, little is known about how causal curiosity arises from existing belief systems. In our work, we examine how causal curiosity emerges from prior knowledge structures. With Reddit data from 2020 to 2023, and leveraging language models to extract cause-and-effect relationship pairs and identify causal curiosity-driven questions, our findings reveal that causal curiosity is not random or independent, but largely rooted in prior knowledge structure. Particularly, \textit{positive} nouns are more likely to be the object of causal curiosity. Moreover, our findings indicate that concepts that serve more as \textit{causes} are more likely to appear in causal curiosity than those that serve more as effects. Lastly, our results also suggest that causal curiosity emerges from the \textit{central} of the prior belief network. These novel insights reveal that causal curiosity is not random but systematically grounded in prior knowledge structures, and suggest their implication to facilitate the human learning process by motivating people to actively explore and construct deeper understandings rather than passively receiving information.

0.31

Clarify User Expertise: Towards Proactive Conversational Agents Tailoring Responses to User Proficiency

cs.AI cs.CL ·2026-08-23 ·Zhihong Cao, Chen Huang
top venue similarity 0.64
Abstract · Findings of EMNLP 2026

In the context of information seeking, conversational agents are undergoing an evolution from reactive tools to proactive, personalized assistants. A critical aspect of this evolution is the ability to tailor strategic interactions to a user's unique needs and expectations. Unlike existing studies that focus on proactively clarifying query ambiguities, we center on clarifying the user's expertise in order to tailor responses for better user comprehension. We find that existing agents struggle to determine user expertise from queries alone, a limitation that prevents them from dynamically adapting their responses. To address this gap, we introduce PASSING to empower the agent to proactively clarify a user's expertise through targeted inquiries. This is achieved by our What-to-ask and How-to-ask strategies, induced by LLM self-play. Our extensive experiments also show our superiority. We believe that PASSING represents a crucial step towards creating more human-centric conversational agents.

0.33

On Open-Ended Information Seeking for Information Elicitation Agents

cs.AI cs.CL ·2026-10-05 ·Victor De Lima, Grace Hui Yang
code/data similarity 0.61
Abstract

Information elicitation is an open-ended information-seeking problem in which an interaction can unfold in many potentially valuable directions, requiring an elicitor to continually determine which information to pursue as new information emerges. In agentic elicitation, these decisions may be delegated to a foundation model, yet how model choice shapes the resulting information-seeking behavior remains understudied. We study how judgments about information value vary across LLMs and how these differences shape sequential information seeking. We first examine these judgments across 11 LLMs spanning multiple model families and parameter scales, using a shared set of information and elicitation objectives. We then develop a controlled elicitation simulation in which different models encounter the same information space and use the same selection rule, isolating these judgments from question generation and respondent behavior. Using this setting, we characterize the breadth-depth behavior that emerges from model-specific information-seeking preferences over the course of elicitation. We further examine how interaction history changes the evaluation and subsequent selection of prospective information. We test the robustness and boundaries of these findings through sensitivity analyses and ablations over the opportunities available to the elicitor, the response labels used to operationalize information-seeking preferences, the presence of interaction history, and whether redundancy is explicitly relevant to the assessment. The project code, data, and trajectory files are available at https://github.com/infosenselab/open-elicitation.

0.30

Sampling Is Not Curiosity: Why LLM Agents Should Investigate

cs.AI ·2026-11-07 ·Alfonso Amayuelas, Piotr Piękos, Xin Eric Wang, William Yang Wang, Jürgen Schmidhuber +1 more
top venueposition similarity 0.61
Abstract · Accepted to the 40th Conference on Neural Information Processing Systems (NeurIPS 2026). Position Paper Track

LLM agents are increasingly used for open-ended tasks, very common in research scenarios where they are required to explore, investigate, or act curiously. At inference time, an LLM is a fixed map from context to next-token distribution, the pretrained weights determine the function, and only its conditioning changes as context accumulates. Mechanisms like temperature, best-of-N, tree search, or RAG vary how the distribution is sampled or what it is conditioned on, but do not update the agent's model of the environment. We argue that current LLM agents do not explore curiously; they explore stochastically. From how curiosity is understood in the RL literature, it requires a predictive structure over how the environment responds to the agent's actions, which improves online from current interaction, drives action selection through its predicted improvement, and persists beyond the context window. Additionally, in its open-ended form, the agent should intrinsically originate what to investigate. Thus, we propose a framework defining curiosity in LLM agents, reserving the term for systems that satisfy it. In doing so, we identify the research directions its implementation opens up.

0.26

When Does a Recommendation Spark Curiosity? Theory, Measurement, and Field Evidence

cs.IR econ.GNcs.LG ·2026-11-11 ·Pan Li, Alexander Tuzhilin
survey similarity 0.61
Abstract

Curiosity, the drive to close the gap between what one knows and what one wants to know, pulls consumers beyond their familiar content, sustains engagement, and breaks them out of the filter bubbles of repetitive, relevance-only recommendations. Despite its importance, curiosity is hardly incorporated into modern recommender systems for lack of a formal measure. The information-gap theory of curiosity provides no formal quantitative model that a recommender system can operate on, and existing proxy metrics do not accurately measure the curiosity that a recommended item evokes. To fill this research gap, we formalize the information-gap theory into five axioms of curiosity and construct the canonical formulation of a computational measure of the curiosity that a recommended item evokes in a consumer. We validate our curiosity measure through a survey-based study, in which it matches consumers' self-reported curiosity and outperforms alternative proxy metrics. We subsequently build a curiosity-aware recommender system that incorporates this measure into the utility function design, and we show through offline experiments on three real-world datasets that it significantly outperforms the state-of-the-art methods. Furthermore, we conduct a large-scale online controlled experiment at a major video-streaming platform in Asia, where we show that our method significantly increases click-through rate, video views, and time spent over the latest production system, leading to tangible economic impact for the company. Our method has since been deployed on the platform and remains in operation. Our findings establish consumer curiosity as a measurable and actionable objective for recommender systems, with important managerial implications for digital platforms to recommend what consumers wonder about.

0.18

Re-Search: Dissecting LLM Ideation Through a Two-Player Questioning Game

cs.AI ·2026-11-10 ·Muhan Gao, Hangxiao Zhu, Xinqi Su, Yu Zhang, Daniel Khashabi +1 more
similarity 0.59
Abstract · Preprint. 15 figures, 10 tables

Research ideation is iterative: researchers refine their ideas step by step based on feedback. Yet existing evaluations obscure this search process, making it difficult to understand how LLMs explore the space of research ideas and what limits their progress. We introduce Re-Search, which adapts the format of Twenty Questions to research ideation: given only the research problem of a published paper, a model must rediscover the paper's core idea by asking yes-or-no questions. Built from 200 ICML 2026 papers, Re-Search tracks how a model's idea evolves as it asks questions and receives binary oracle feedback, isolating ideation from execution. Across six recent LLMs, nearly all progress happens within the first 30 of 100 questions, which largely decide how the game ends; after that, most models plateau. Through controlled interventions on the candidate questions and the hypothesis space, we find that the bottleneck is generation, not judgment: models recognize a good idea or a good question when one is offered, but often cannot produce it on their own. We further analyze the ideation traces and find that models fail by either over-exploiting one direction or over-exploring too many. These findings point to concrete design principles for autoresearch systems: since models can judge candidates they cannot produce, enriching the search with externally sourced ideas and questions may be more effective than improving any single model's generation ability.

0.20

How You Ask Shapes What You Get: A Theory-Seeded Measurement of Articulation in Advice-Seeking LLM Conversations

cs.CL ·2026-08-30 ·Juneha Baek, Suhyeon Lee, Donghyuk Shin
top venueposition similarity 0.59
Abstract

Users articulate the same advice-seeking request in different ways: some specify detailed constraints, others gesture at a vague need. Prior work treats this variation as noise to be averaged away; we instead treat it as a stable, measurable structure in the input distribution. We ask whether articulation (how people ask) forms latent dimensions separable from topic (what they ask about), and whether it is associated with how language models respond. We extract interpretable features from 16,447 advice-seeking prompts pooled from public chat corpora (WildChat, LMSYS, and ShareChat) and recover a small set of latent articulation factors that replicate across train/test splits and across corpora. Because this structure is largely separable from topic, the populations it defines cut across topics and stay invisible to topic- or task-based evaluation. The factors define a handful of recurring articulation styles, one of which stands out: a long-form but information-poor style, roughly one in six prompts in the largest corpus, where models return shorter, vaguer answers and do not ask for clarification even though under-specification is exactly the condition that warrants it. The contrast holds within every topic group and length quintile, and is not under-specification alone -- a second, equally under-specified style does draw clarifying questions. Two independent human annotators reproduce this contrast. We argue that benchmarks should stratify on articulation, and we offer the extracted structure as a measurement instrument for doing so.

0.43