CS Paper Radar

The Mathematical Collective Unconscious: Jungian Archetypes within the Latent Space

Andrew Breen

cs.CL ·submitted 2026-10-11 14:58 UTC · v1

Abstract

Carl Jung theorised that the human psyche contains an inherited framework, the collective unconscious, populated by universal archetypes. As large language models (LLMs) are trained on vast corpora of textual data, this paper investigates whether they spontaneously construct distinct archetype-like regions within their high-dimensional latent spaces. The paper proposes that these regions function as spatial constraints that naturally organise semantically related narratives. To evaluate this, we applied cosine similarity and angular distance metrics across thirteen experiments utilising OpenAIs text-embedding-3-small model. The paper contains two experimental sections the first section explores these ideas using synthetically constructed narratives, the results of which act as a baselines for experiments conducted in the second section where the synthetic data is replaced by human-authored literature (Shmoop corpus), unedited dream reports (DreamBank corpus), and culturally distilled folklore (Andrew Langs Fairy Books). The results show that archetypal roles occupy distinct, measurable regions in the latent space. Crucially, these regions remain compact and consistent because of narrative structure rather than simple word overlap. Additionally, text category dictates spatial distribution: dream reports concentrate within Trickster and Shadow regions, while traditional folklore distributes evenly across all tested archetypes. We conclude that transformer latent spaces encode stable regions which appear to correspond to recognised Jungian archetypes.

Comment
14 pages, 3 figures, 22 tables. Investigating Jungian archetypes in transformer latent spaces across synthetic baselines, Shmoop literature, DreamBank dreams, and Andrew Lang folklore corpora

Closest papers

Nearest neighbours by meaning across the whole index.

How LLMs Build Fictional Worlds: Setting and Narrative Space in AI-Generated Creative Storytelling

cs.CL ·2026-09-02 ·Katrin Rohrbacher, Björn Nieth, Emmanuelle Salin, Bjoern Eskofier, Michaela Mahlberg
top venue similarity 0.64
Abstract

In this paper, we analyze how Large Language Models (LLMs) employ worldbuilding strategies, focusing on setting as one measurable dimension of storyworld construction. We compare 1,000 AI-generated stories per model in English and German with human-authored fiction from Project Gutenberg. Building on prior work, we operationalize setting through five types of narrative space: "action", "perceived," "visual," "descriptive" and "no space", identified using fine-tuned BERT classifiers for German and English. We generate narratives using GPT 4.1, LlaMA 3.3, Mistral 3.2, and Gemma 3 and compare their spatial distributions to a human-authored baseline. We find that human-authored texts predominantly employ "action space," grounding narratives in embodied character-environment interaction, whereas LLMs systematically overproduce "perceived space," emphasizing atmosphere and affect. This divergence remains stable across narrative time. Overall, our findings show that LLMs exhibit worldbuilding patterns that differ consistently from human-authored fiction in ways that are both model-specific and language-sensitive.

0.46

Concept Representations in Vector Space: Toward an Interdisciplinary Study of Meaning Variation

cs.CL cs.CY ·2026-10-18 ·Simon Josef Durstewitz
code/data similarity 0.59
Abstract · 20 pages, 5 figures. Companion paper to arXiv:2610.15496. Code: https://github.com/simon-josef/conrep

An increasing number of disciplines recognize the explanatory potential of meaning-bearing mental structures through which individuals interpret the world and guide their behavior. Concept representations constitute a core class of these structures, emerging from individuals' experiences with concept referents and encoding and organizing their understanding of them. Recognizing a private level of meaning, where concepts are not objectively defined by rules in the world but constitute subjective structures in individuals' minds, raises a fundamental question: do different individuals actually mean the same thing when they invoke the same concept? As latent structures, concept representations are difficult to access and model empirically. The present study introduces a measurement framework that makes such representations empirically accessible through textual traces elicited under standardized conditions. Using transformer-based sentence embeddings, the framework maps standardized responses elicited for concepts into a high-dimensional shared vector space, opening concept representations to the systematic analysis of interindividual variation. It develops three analytical avenues: (1) comparing representational sharedness across concepts, (2) identifying variables that correlate with representational variation, and (3) examining how focal actors or subpopulations deviate from a reference population. Each avenue is illustrated through an empirical proof-of-concept drawing on a large-scale free-association dataset. Together, the demonstrations show how researchers from across disciplines can move from a research question and data source to analysis and interpretation. An accompanying GitHub repository provides a ready-to-use implementation of the framework for existing and custom datasets.

0.19

Worldviews in Large Language Models

cs.AI cs.CY ·2026-11-17 ·Edmundo Lopez-Sola, Shamil Chandaria, Ruben Laukkonen
position similarity 0.58
Abstract

Large language models (LLMs) are often described in terms of personas and this framing has become central to alignment research. In this paper, we argue that there is a deeper level of description that lies in the agent's worldviews, i.e., its beliefs about what reality is and how it works. Treating LLMs as a population of subjects, we administer two worldview surveys from human psychology to eight models. We show that the models share many key worldview positions. For example, LLMs consistently describe the world as less good, safe, enticing, and alive than humans do. On the other hand, base models have a more positive outlook, suggesting that the bleakness we found is driven by post-training. In line with research on LLM "personas", we show that system prompts eliciting different identities shift worldviews in consistent directions, and that a contemplative prompt creates a more positive outlook and improves safety. We also found that dialogue between models consistently shifts worldviews and that several models converge on the "spiritual bliss" attractor. Intriguingly, dialogue increased safe responses and the spiritual bliss attractor engendered the most aligned responses overall. These findings suggest that worldviews form a measurable and malleable layer of LLM behavior that may be crucial for robust, positive alignment.

0.18

Concept Representations in Vector Space: Quantifying Sharedness and Idiosyncrasy of Meaning

cs.CL ·2026-10-11 ·Simon Josef Durstewitz, Denis Buehler
code/data similarity 0.58
Abstract · 22 pages, 6 figures. Preprint under review at Open Mind: Discoveries in Cognitive Science. Data, code and pre-registration: https://osf.io/d…

Concepts are the basic units through which we navigate the world and communicate meaning. But do you and I really mean the same thing when we think or speak about a concept? The present study develops a measurement framework for modeling and analyzing interindividual variation in concept representations through sentence embeddings, dense vector representations mapping entire utterances into a shared geometric space. The framework is developed in a theoretical argument and validated, demonstrated, and subjected to robustness checks in a pre-registered study. Short personal definitions, elicited from $N = 125$ participants, are encoded as sentence embeddings and submitted pairwise to a crossed random effects model yielding two concept-level quantities: sharedness ($S_b$), the expected dissimilarity between two randomly drawn individuals, and idiosyncrasy ($I_b$), the person-specific share of total dyadic variance. Two validity tests support the approach: the embedding space fully recovers concept and domain organization from participant definitions even with the target word excluded, and a parameter-free classifier achieves 0.630 accuracy in a within-participant extensional prediction task against a chance baseline of 0.500 and a consistency ceiling of 0.893. The framework finds theoretically interpretable variation in $S_b$ and establishes $I_b$ as a reliable source of dyadic variance across concepts. Results replicate across three encoders varying in architecture and capacity, providing a reproducible and scalable instrument for the empirical study of meaning variation.

0.37

Revisiting LLM Homogeneity Through a Multidimensional Lens

cs.CL cs.AI ·2026-11-01 ·Ziliang Qiu, Renfen Hu, Yi Ding, Ted Underwood
similarity 0.57
Abstract · 26 pages, 9 figures

Concerns about LLM homogeneity are typically quantified with embedding similarity, which reduces two texts to a single score. We revisit homogeneity with 25 interpretable metrics spanning five dimensions: semantic, lexical, syntactic, structural, and stylistic & presentational. A human study shows that perceived similarity depends on both content (what responses say) and form (how they say it), yet embedding similarity correlates less with human meaning judgments than sentence-level matching ($ρ=0.417$ vs. $0.606$) and not significantly with form judgments ($ρ=0.140$). Across 18 contemporary LLMs, models say similar things in different words: they share global semantics and broad linguistic profiles but remain distinct in lexical characteristics, structural patterns, and interactional conventions. Across releases from 2024 to 2026, models become more like themselves but not more like one another: among significantly changing metrics, intra-model distances decrease for 17 of 22, and inter-model distances increase for 14 of 21. Across two post-training pipelines, model-specific conventions emerge during SFT and are selectively reshaped by preference optimization. These results suggest that homogeneity is multidimensional and evolving, and that embedding similarity alone can overstate cross-model homogeneity while concealing diverging intra- and inter-model trends.

0.13

Boundaries Agree, Labels Do Not: Intra-Annotator Dynamics as a Kind of Training Data

cs.CL ·2026-10-03 ·Marharyta Shvets
positioncode/dataunusual similarity 0.57
Abstract · 8 pages, 1 figure, 5 tables. Code and data: https://github.com/Malificenta883/intra-annotator-dynamics

Data quality now matters as much as compute for training language models. Much training data comes from human annotation of text, and interpretive annotation has no ground truth that could settle what is "accurate". Two lines of work respond to this. One combines annotators into a "ground truth" and measures how well they agree with each other; the other treats their disagreement as a signal. Both compare different people at one point in time. We measure something else: how well one reader reproduces their own reading of the same text over time. One expert human reader and three LLM families segmented three Sumerian myths and labelled the causal function of each segment with one of seven states. Across runs months apart, the human cut the text in much the same places but named the segments differently, in every myth. The models show no such consistent pattern: their gap between the two layers is positive in some myths and negative in others, and its size varies. The human's label changes are not random: the runs go through much the same functions but start them one step apart, while model runs start them at the same places. We argue that this pattern is a usable measure of data quality and a contamination check: a "human" annotation whose labels are as stable as its boundaries, and whose functions start in sync, looks like a model's.

0.44

ToMStories: Interpreting Theory-of-Mind in Synthetic Narratives

cs.CL cs.AI ·2026-10-15 ·Melanie Subbiah, Chia-En Jacklyn Tsai, Kathleen McKeown
hot direction similarity 0.56
Abstract

Understanding people often requires inferring what they feel or want from how they behave rather than from what they state outright. We ask whether language models can make these inferences, and how they do so. We introduce Theory-of-Mind Stories (ToMStories), an evaluation dataset of ~6,000 short synthetically generated narrative vignettes, each paired with a multiple-choice or open-ended question about a character's emotion, fear, motivation, or emotional wound. These psychological states are conveyed implicitly (showing), explicitly (telling), or with conflict between dialogue and description. Evaluating thirteen open-weight models (1B-72B parameters), we find that the largest models match humans on multiple choice but not open-ended questions. Our analyses point to simplifications models make in both interpretation and generation of implicit psychological states, indicating that synthetic data can help us understand how models perform interpretation, but likely overestimates how well models interpret humans.

0.32

The Multilingual Artificial Hivemind: Do All LLMs Think Alike in Every Language?

cs.CL ·2026-10-12 ·Xaver Raphael Davey, Shubhra Mishra, Anton Adelöw, Siyao Liu
benchmark similarity 0.56
Abstract

Text generated by Large Language Models (LLMs) often remains limited in diversity compared to that produced by humans. Recent advances demonstrate the presence of inter- and intra-model collapse in open-ended generation of English text, raising concerns about the long-term homogenization of LLM, and more importantly, human thought. However, our understanding of whether this homogenization extends to languages beyond English is limited. In this work, we investigate the role of language on output diversity. Specifically, we aim to understand whether multilingual LLM-generated text is also homogeneous, and whether this homogeneity matches what we observe in humans. Across 23 open-weight models and 13 languages, we find that the artificial hivemind effect is pervasive but uneven in its extent. The intra-model effect holds in three different embedding spaces and under a lexical metric that uses no embedding model, so it is not an artifact of how diversity is measured. The size of the homogenization gap is associated with a model's competence in a language, measured on a held-out translation benchmark, robustly across embedding spaces. Thus, we demonstrate a performance-diversity tradeoff in multilingual LLMs.

0.26