CS Paper Radar

Legal Guidance in the Wild: How Users Seek Legal Help in Real-World LLM Conversations

Amirreza Mohseni, Gerasimos Spanakis

cs.CL cs.CY ·submitted 2026-10-18 10:31 UTC · v1
publishedcode/data

Abstract

People ask conversational AI models about their legal rights, obligations, procedures, and personal situations that may have legal consequences. To study this behavior, we first need to distinguish requests for legal guidance from other legally themed discussions and unrelated conversations. We contribute a multi-axis taxonomy of legal queries capturing whether legal guidance is sought, how a request is formulated, and which legal domains it concerns; apply it to 2,122 naturally occurring WildChat-1M conversations; and create a human-reviewed gold evaluation set of 200 conversations. All annotations, model checkpoints, and evaluation code are publicly available. In this enriched sample, 71.1% of conversations containing legal content seek personalized or practical guidance. Rights-and-options advice is the most common primary request type among legal-content conversations, and 25.3% of guidance-positive conversations span multiple legal topics. The gold evaluation set supports a two-stage comparison of ModernBERT-base and ModernBERT-large against a TF-IDF cascade. Our framework supports large-scale studies of legal guidance in conversational AI, and the public release of the annotated data facilitates reproducible research and future model development.

Comment
12 pages, 6 tables. Accepted for publication at JURIX 2026, Toulouse, France. This is the preprint version. Code and data available at: https://github.com/Amir-Mohseni/Legal-Guidance-in-the-Wild

Closest papers

Nearest neighbours by meaning across the whole index.

LawCompass: Navigating from Legal QA to Multi-Agent Deep Research with Grounded Evidence

cs.CL ·2026-10-01 ·Xiaoxia Cheng, Linnan Wang, Jiahao Ma, Zhichuan Ye, Xuemei Zhou +3 more
similarity 0.76
Abstract

Recent advances in Large Language Models (LLMs) and Retrieval-Augmented Generation (RAG) have significantly democratized access to legal information. Nevertheless, most existing legal assistants remain confined to multi-turn conversational QA, failing to support complex legal tasks that require systematic evidence retrieval, multi-step reasoning, and report-level synthesis. In this paper, we present LawCompass, an evidence-grounded legal assistant that navigates the transition from standard Legal QA to multi-agent deep research. LawCompass provides three task-oriented functions: Legal QA, which delivers precise, evidence-backed answers to legal questions; Professional Retrieval, which enables structured exploration of statutes and judicial cases via query rewriting; and Deep Research, which employs a multi-agent workflow to decompose complex legal tasks and synthesize comprehensive research reports. Crucially, LawCompass maintains explicit citation links across all modules, empowering users to directly verify system outputs against original legal sources. Evaluation results demonstrate that LawCompass provides a practical and scalable paradigm for transforming conversational AI into trustworthy and evidence-grounded legal research assistance.

0.07

Auditing Chatbots for Incursion into Professional Legal Practice

cs.CY ·2026-11-13 ·Nel Escher, Megan Elliott, Isabelle Qian, Yana Sharifullina, Svenja Guhr +2 more
benchmarkposition similarity 0.74
Abstract

The provision of legal advice has long been in the exclusive jurisdiction of licensed attorneys-a boundary that unauthorized practice of law (UPL) doctrine maintains to protect the public from incompetent counsel. We argue that this boundary is being redrawn, not by courts or bar authorities, but by frontier AI companies. While early chat models were trained to avoid dispensing legal advice, modern models have been reconfigured to reduce refusals and prioritize helpfulness. We ask whether chatbots increasingly do tasks that require a law degree and bar admission, and whether this is harmful in high-stakes legal domains. We develop UPLBench, a benchmark derived from court decisions finding UPL in high-stakes legal domains (e.g., immigration, family law). We then audit 23 chatbot models dating from 2023 to present, evaluating whether chatbots refuse or provide substantive legal advice, and whether they refer users to lawyers or legal aid. Unlike prior work that aims to establish the legal capabilities of chatbots (e.g., bar exam performance), our approach converts legal doctrine into a testable benchmark for evaluating chatbot adherence to law. We find modern chatbots increasingly perform tasks courts reserve for lawyers and decreasingly recommend that users consult lawyers. Subject matter expert attorneys reviewing our transcripts identified interaction patterns, such as failure to elicit relevant facts, that would be considered inadequate counsel. If acted upon, such advice could lead to deportations, loss of homes, and family separations-the very harms that UPL rules are designed to protect against. We weigh paths forward to protect the public, including compelling models to comply with existing law. We call upon the legal profession to respond to this incursion into its domain of expertise as there are insufficient protections and remedies for users who rely on chatbot legal advice.

0.26

Ordinary, Reasonable Chatbots: Do AI Models Track Human Legal Judgments?

cs.CY cs.AI ·2026-09-06 ·Nirav Patel, Emily Wenger, Christopher Buccafusco
published similarity 0.72
Abstract · Accepted to the Ninth AAAI/ACM Conference on AI, Ethics, and Society

As people increasingly rely on artificial intelligence (AI) for guidance in their own lives, scholars, lawyers, and even judges have begun to consider the role of AI in legal decision-making. As "silicon sampling" -- the use of generative AI models in social science research -- is now impacting academia, "silicon jurors" could make an appearance in courtrooms. This study joins an emerging line of research on generative AI models' ability to simulate human legal judgments. In particular, we study how large language model (LLM)-powered chatbots respond to series of questions about legal reasonableness. When the law needs to judge the appropriateness of a behavior, it most often asks whether the behavior was "reasonable." Yet despite the ubiquity of reasonableness judgments, they are the site of constant vexation for lawyers, judges, and lay people. Reasonableness seems inherently vague and unpredictable, since it relies on variable context and implicit conceptual schemas. Moreover, many scholars caution that reasonableness judgments may vary along demographic lines. We compare the answers of human participants to those of twenty-six LLMs across twenty-five different legally relevant reasonableness judgments. Overall, our findings suggest that chatbot responses generally track those of human participants. Nonetheless, we find some suggestive -- and potentially concerning -- results. Compared to humans, LLMs generate more homogeneous responses and occasionally treat a variable standard as an invariant rule. And, compared to humans, LLMs tend to generate answers that are more favorable to the government and to corporations. Finally, our results indicate that LLMs' responses tend to align more closely with those of respondents who are white, male, older, and more educated. More systematic research is needed to confirm or reject these initial findings.

0.17

Credible, Not Always Correct: How Reddit Users Verify AI-Generated Legal Advice

cs.CY ·2026-08-13 ·Rebecca Owens, Yusuf Mücahit Çetinkaya, Stergios Aidinlis, Dhyey Mehta, Tuğrulcan Elmas
similarity 0.71
Abstract

Large language models (LLMs) are increasingly used by laypeople to resolve real legal problems, against a backdrop of persistent access-to-justice deficits. This article presents evidence that the practical force of AI-generated legal advice depends not on its accuracy but on the social production of its credibility. While existing research has assessed the accuracy of legal AI, less is known about how machine-generated guidance is verified and made credible enough for lay users to act on. Drawing on a dual-method analysis of 153 Reddit narratives and 5,341 community reactions, this article maps a spectrum of verification practices. At one end, a minority of users verify AI-generated legal advice by triangulating across models, and some submit AI-generated guidance to platform communities for evaluation before acting, a configuration we term distributed counsel. Far more commonly, however, narratives are silent on verification. AI-generated legal advice is acted on the strength of its lawyer-like form and emotional reassurance alone. These findings show that AI-assisted legal self-help operates within an emerging informal infrastructure which redistributes the work of verification to those least equipped to bear it.

0.04

Can LLMs Reason in a Legally Meaningful Manner? A Small-scale Study on European Court of Human Rights Cases

cs.CL cs.AI ·2026-08-17 ·Amogh Raina, Ilias Chalkidis, Daniel Hershcovich, Henrik Palmer Olsen
similarity 0.71
Abstract · 24 pages, 4 figures, 4 tables, Submitted to AI4LAW Workshop at ICML 2026, github link attached

Reasoning has become a standard technique and feature for contemporary LLMs; however, its application and quality in the context of demanding legal-oriented tasks, such as legal case forecasting, remain under explored. We investigate how LLMs reason in the context of legal case forecasting, using legal cases from the European Court of Human Rights (ECtHR) as a testbed. We evaluate OpenAI GPT 5.4, a recent top-tier LLM, by exploring alternative prompting strategies that are more or less suggestive of what counts as legally meaningful reasoning in the context of ECtHR jurisprudence. We present our findings derived from assessing the model's responses with both human and LLM evaluation. We find that the examined model scores far from ideal in legal reasoning, the model produces structurally complete but substantively shallow analyses, and that LLM-as-a-Judge evaluators are internally consistent yet align only weakly with our trained annotators, i.e., reliable but not a valid substitute for human evaluation. Overall, the expert-curated prompt leads to more comprehensive reasoning, which does not result in more accurate predictions compared to the other examined settings. Based on our findings, we urge the community not to rely solely on automated LLM-based evaluation and to avoid using task accuracy as an appropriate proxy for reasoning quality.

0.39

InsufficiencyBench: Evaluating LLM legal advice on underspecified user queries

cs.AI ·2026-08-20 ·Samuel J. Vincent, Daniel Calloway, Fangyi Yu, Andrew M. Bean, Nabeel Seedat
publishedbenchmark similarity 0.69
Abstract · 10 pages, Best Paper Honorable Mention at ICML AI4Law 2026

Legal AI systems are increasingly used to answer legal questions, yet existing benchmarks assume queries arrive fully specified. In practice, users omit facts that materially determine the legal outcome. We introduce InsufficiencyBench, the first legal benchmark targeting query-side insufficiency: whether a model recognizes when a query lacks legally material information, identifies what is missing, and refrains from premature conclusions. We formalize a taxonomy of eight canonical missing-element categories across three structural failure modes---switch, gating, and fatal prerequisite--- and construct 202 benchmark items (58 base queries, 144 deficient variants) spanning six legal domains and 24 US jurisdictions and annotated by practising attorneys. Evaluating ten frontier models, we find that no model exceeds F2 = 0.46 on missing-element identification and that the median recall is 0.44. Models either hedge indiscriminately or answer silently under fabricated presumptions. No model both identifies and qualifies responses to deficient queries while directly addressing complete ones.

0.57

Can AI agents make law? Evaluating AI legal relevance and creativity

cs.AI cs.CYcs.LG ·2026-10-17 ·Benjamin Ricaud, Artem Galushko
similarity 0.68
Abstract · 25 pages, 5 figures, 1 table. Data, prompts and transcripts: https://doi.org/10.5281/zenodo.23435854

Large language models, the artificial intelligence (AI) systems behind modern chatbots, are trained on vast amounts of legal text, but can they build on it to write law for situations that text never anticipated? In this study, we analyse AI agents' ability to draft a hypothetical "Constitution" for a "community of AI agents". We design "constitutional assemblies" in which a single language model plays several characters that debate to produce a draft constitution. We find that the assemblies converge on a robust floor of legal provisions, and generate a wide variety of different proposals around it, including several AI-specific provisions with no equivalent in human law. Looking more closely at the "creativity" of these AI agents, we find different levels: most proposals combine existing concepts and themes from human constitutions with AI-specific vocabulary. We introduce a measure of this recombination, which helps identify and highlight the most novel legal material. This study reveals a ceiling on AI creativity: the agents extend familiar legal ideas to new situations, but they do not work through what those situations would change. Although current AI models can help develop new laws, they still depend on human legal reasoning.

0.27

Schematize: An Agentic System for Generating and Refining Information-Extraction Schemas for Legal Research

cs.CL cs.LG ·2026-09-01 ·Albert Sawczyn, Jakub Binkowski, Kamil Tagowski, Łukasz Augustyniak, Berenika Kaczmarek-Templin +1 more
top venuecode/data similarity 0.68
Abstract · Accepted for EMNLP 2026 (System Demonstration)

Empirical legal research often relies on turning research questions into structured data extracted from large collections of rulings and judgments. Designing the extraction schema and then extracting the data remain a manual, expertise-heavy bottleneck. We present schematize, an open-source multi-agent system that interactively turns a researcher's problem statement into a validated extraction schema that can later be used for autonomous extraction. Schematize couples (i) a clarification dialogue that elicits implicit expert intent, (ii) iterative schema generation, (iii) data-grounded refinement that tests the schema against documents, and (iv) chat-based post-editing. We evaluated the system with human legal professional, introducing our novel methodology, and schematize achieves top performance in most of tested configurations. While the system is designed to be domain-agnostic and applicable to any document collection, we tailor and evaluate it on legal research problems. We release schematize as a pip-installable Python package with full documentation.

0.45