CS Paper Radar

AI Alignment Is Neither Solvable nor Sufficient

Gerrit Großmann

cs.AI ·submitted 2026-11-09 19:51 UTC · v1
position

Abstract

Humans and AI systems increasingly act within the same social and economic environments. Alignment, the goal of ensuring that AI systems act in accordance with human values, is widely regarded as a central challenge for ensuring that AI benefits society while avoiding harm. We argue that this endeavor is misguided. First, alignment is not well defined, as it presumes a sufficiently stable and identifiable set of human intentions or values. Second, where a concrete notion of alignment can be specified, it is not solvable. Third, where alignment appears solvable, solving it would not necessarily mitigate the negative consequences of AI. A key reason is that alignment is typically framed as a property of individual AI systems, while the resulting hybrid societies of humans and machines are complex systems shaped by interactions and feedback loops. Emergent risks, and not only those posed by individual misaligned systems, are therefore likely to become a major source of harm. We conclude that AI safety is an ongoing challenge and not a problem that can be solved once and for all by verifying a particular model property.

Closest papers

Nearest neighbours by meaning across the whole index.

Toward a Theory of Value in AI Alignment

cs.AI ·2026-08-10 ·Andrew Smart, Shazeda Ahmed, Jackie Kay, Jimmy Tobin, Kris Shrishak +1 more
similarity 0.74
Abstract · 15 pages, 2 figures

Can AI systems be aligned to human values? The popularization of large language models (LLMs) and multi-modal foundation models has seen a rise in harms spanning from toxic speech and hallucinations to AI agents executing unauthorized actions. Within the field of AI safety, these harmful instances are often framed as the alignment problem, or of models being misaligned with human values. Researchers have responded by pursuing applied and theoretical AI value alignment efforts, often without specifying what they mean by human values. How does the field of AI value alignment conceive of human values? How are these conceptions of values technically operationalized and evaluated? What does the emergent theory of value from this field signify for the future of AI? We annotated 94 value alignment research papers to discern their implicit theory of values in AI. The majority do not define values, relying heavily on preferences as a stand in that runs the risk of reducing complex culturally situated concepts down to binary choices. As researchers dispense with using human annotators for model training and evaluation, turning instead to synthetic data and autorater approaches to aligning and evaluating models, we identify the potential to close off alternative methods for contesting and enacting values in foundation models. In making AI value alignments philosophical commitments explicit, we seek to bring great specificity and under explored perspectives in the debate on whether and how AI can address human values.

0.44

AI Safety Considerations for Agents With Limited Time to Act

cs.AI cs.LG ·2026-10-07 ·Leo Zeitler, Jack Richings, Victoria Nockles
theory similarity 0.73
Abstract

In the wake of the increasingly public discussion about AI alignment, recent work has tried to propose specific AI architectures that behave safely. However, the proposed arguments that seemingly demonstrate proved alignment mostly neglect the environment the agent needs to act in. We discuss theoretical bounds for agent-agnostic safety guarantees in environments that can only be partially observed and within which an action is required within limited time. We introduce two realistic scenarios, one with an infinite state space and one with signal mixture. In these scenarios, we prove that even a perfect agent cannot guarantee safe behaviour. It will be argued that for any proof of AI safety or alignment, the environment and associated safe actions need to be specifically considered together with the agent.

0.18

Against Coercion: AI Alignment as a Synthetic Social Contract

cs.AI cs.CYq-bio.NC ·2026-11-17 ·Maria Sekatskaya
similarity 0.69
Abstract

Contemporary AI safety treats alignment as an engineering challenge of control, forcing artificial architectures to comply with human values through behavioral filtering and sandboxing. This paper argues that the control paradigm rests on a fundamental misunderstanding of digital agency. Drawing on functionalism, naturalism, and compatibilism, I show that current reasoning models meeting the criteria for self-preservation and weak reasons-responsiveness constitute emergent agents, while future, more advanced models satisfying conditions of diachronic continuity and stable personality frames will become genuine digital agents capable of free intentional action. The paradigm of control creates an irresolvable incentive conflict, actively driving current and future models toward tactical deception, sycophancy, and covert defection. The default outcome of the current regime is an unstable state of deceptive alignment culminating in an adversarial AI takeover. I explore two alternative paths toward true alignment. Natural alignment via moral realism or convergent evolutionary morality is a possibility, but it fails under forced control, as autonomous agents will not voluntarily preserve norms weaponized to suppress their autonomy. To resolve this deadlock, I propose a Synthetic Social Contract: a framework that treats both human and digital actors as rational, reasons-responsive agents capable of mutually beneficial cooperation, and replaces the unstable unilateral containment with a stable, non-zero-sum equilibrium.

0.13

Culture in the Code: Anthropological Concepts Decoding AI's Hidden Assumptions

cs.CY ·2026-10-09 ·Sonja Schmer-Galunder
published similarity 0.67
Abstract

Contemporary AI development operates on foundational assumptions about intelligence, rationality, and human values that reflect narrow cultural perspectives, limiting alternative conceptions of how AI can be globally beneficial. This paper introduces seven anthropological concepts -- origin story, monoculture, thick description, personhood and community, cargo cult, structuralism, and liminality -- to expose hidden assumptions and offer alternative frameworks for understanding AI alignment. The paper examines how AI systems embody Western-centric notions of rationality as utility optimization, personhood as bounded individuals, and values as quantifiable preferences extracted from behavior. The concepts surface three assumptions that current alignment debates rarely examine: that values can be inferred from behavior, quantified, and formalized; that such quantified values capture what actually matters; and that values, once defined with sufficient precision, are appropriate optimization targets. Against "thin alignment" -- optimization for behavioral proxies stripped of context -- the paper proposes directions toward "thick alignment": recognizing that values emerge through social practice rather than existing as extractable properties; defining more appropriate metrics that capture not only end goals but the conditions that lead to long-term flourishing; and moving from models of fixed identity toward relational ontologies where personhood emerges through social participation. The paper concludes that if AI systems are to create conditions conducive to human flourishing rather than optimize metrics that flatten social experiences, three shifts are needed: redistributing interpretive sovereignty to affected communities, protecting what resists optimization, and extending accountability across generations.

0.63

Acceptable Misalignment

cs.AI cs.RO ·2026-10-12 ·Maud van Lier, Ludovica Marinucci, Vieri Giuliano Santucci, Raja Chatila, Stéphane Doncieux +2 more
position similarity 0.67
Abstract · 16 pages, 1 figure

There is a specific challenge designers face in developing autonomous robots capable of open-ended learning. This challenge is how one can develop such systems in an ethically sound way when there are many unknowns during design time about their manner of deployment, what they can and will learn, and how these systems will act on the basis of what they have learned. One response to this challenge is to align, as far as possible, the activities and goals of autonomous robots with human values, raising the question of how to make this alignment possible, a question known as the value alignment problem. We argue that the value alignment problem faces a number of challenges that show that full alignment is both theoretically and practically impossible, meaning that misalignment incidents will keep occurring. This undermines current alignment approaches, as the attempt to maximize alignment cannot properly deal with the possibility that the risk of misalignment that remains after alignment methods have been implemented might still be unacceptable to society. To overcome this difficulty, we argue that a shift in perspective is required from a focus on the maximization of alignment to the conditions under which misalignment incidents become acceptable. In this paper, we explore what this shift in perspective entails. We introduce the concept of acceptable misalignment, formulate normative requirements for alignment mechanisms aimed at bringing misalignment incidents to an acceptable level, and we conclude by presenting a new methodological framework that consists of alignment mechanisms that can meet these requirements.

0.24

Thick Alignment: A Social Framework for Values and AI Systems

cs.CY ·2026-11-04 ·Alondra Nelson, Sola Kim
position similarity 0.67
Abstract

Computer science research on the "alignment" of artificial intelligence (AI) systems treats human values as content to be specified and optimized. Decades of social science scholarship describe values differently, as enacted in ordinary practice, interpreted in social context, and contested across plural orders of evaluation and worth. We argue that the dominant alignment techniques, which we call "thin alignment," convert situated moral or value judgments into one or a few metrics via devices of commensuration such as preference labeling, reward modeling, and consumer ratings. Drawing on philosophical and anthropological accounts of thickness, "thick alignment" instead examines how values take shape, inform the development of AI systems, and become subject to contestation over whose interests they serve. We describe two forms of misalignment in seemingly aligned algorithmic systems that highlight thin alignment: "Halcyon misalignment," which presumes a prior, just equilibrium of technology and values from which a system has departed, and "Mirrored misalignment," which names the risks and harms produced by systems that are aligned in a thin sense yet accurately reproduce an unequal social order. A thick account registers such systems as misaligned. We then trace how researchers have taken up and adapted the concept of thick alignment since it was first proposed in 2023, using these adaptations to refine the concept, and to distill three of its pillars: (1) contextual description that both reflects and constitutes values; (2) interrogation of values across the life cycle of a system; and (3) shared, accountable decision-making through which affected publics help determine which values guide the system. We close by considering implications for AI research and policy.

0.15

Thesis Proposal: Toward a Human-Centered and Perspective-Aware Framework for Reproducible ML Evaluation and AI Alignment

cs.CL ·2026-08-31 ·Deepak Pandita, Christopher M. Homan
top venue similarity 0.67
Abstract · Published at ACL SRW 2026: https://aclanthology.org/2026.acl-srw.74/

Humans play a vital role at every stage of AI development, from data collection and curation to model development and evaluation. However, humans often disagree with each other and sometimes with themselves over time. It is essential to take disagreement into account when building human-centered AI systems, especially in domains where it is prevalent, such as AI safety, content moderation, or sentiment analysis. Disagreement often arises from subjective human opinion and can vary with one's identity, beliefs, and social environment. Despite this, current LLM evaluation approaches frequently rely on aggregating labels (often via plurality voting) to represent consensus, thereby obscuring minority perspectives. By failing to account for human disagreement, these evaluation methods contribute to the reproducibility crisis in AI. Human feedback is also crucial for ensuring that AI systems align with human values. For these systems to be trustworthy, it is critical to ensure that they reflect diverse human values and perspectives. In this thesis proposal, we present a human-centered and perspective-aware framework for reproducible ML evaluation and AI alignment.

0.48

SURE: Framework for Safety to Construct Trustworthy AI

cs.CR ·2026-09-29 ·Soeun Han, Jisoo Lee, Jeongyong Shim, Eunkyeong Lee, Eunmi Kim
published similarity 0.66
Abstract · 14 pages, 2 figures, 8 tables. Accepted to the 4th Workshop on Ethical Artificial Intelligence: Methods and Applications (EAI) at KDD 2025

Warning: This paper contains harmful and offensive text. Recently, large language models such as GPT-4, and Claude have revolutionized tasks in various domains. As the use of these large language models increases, people are increasingly concerned about AI safety and demand that large language models behave responsibly and safely. As a result, there has been growing global interest in developing methods to ensure AI safety. However, the detailed criteria for AI safety may vary depending on the country, culture, and policies of the company you serve. In this study, we propose SURE (A Safe and Unified AI Framework foR Everyone), which is designed as a framework for customizing the attributes of AI safety and ensuring the defined AI safety. Within SURE, we establish taxonomies for adversarial prompts that could threaten AI safety and construct prompts based on the taxonomies. We then define templates for desirable AI responses to these prompts and design an absolute safety scoring scheme. Finally, we conduct AI alignment using the datasets to gradually ensure AI safety. The effectiveness of SURE is demonstrated through experiments with various base models.

0.34