CS Paper Radar

Event Memory and Narrative Dynamics: A Large Language Model Framework for Multidimensional State Spaces

Joshua Sariñana

cs.CL ·submitted 2026-10-12 15:34 UTC · v1
code/data

Abstract

Studying event memory requires defining events and their relationships within remembered experience. Autobiographical narratives provide evidence of this organization, but their analytical units must first be established. This study introduces a large language model framework for constructing event representations from narratives and modeling their structure and dynamics with excerpt-level traceability. Explicit boundary rules and a feature schema informed by hippocampal models of episodic memory and navigation guide event construction. In a proof-of-concept application to interviews from five participants, the framework constructed 256 event-states. Multiple correspondence analysis embedded these states in feature-based spaces, with analyses focused on a selected 4-D geometry and 10-D and 13-D reference geometries. Consecutive event-states were significantly closer than expected under randomized narrative order. In the selected 4-D ten-basin solution, similarity between basin-state feature profiles corresponded with similarity between one-step routing profiles; context, mechanism, and theme differentiated full-system pathway engagement. A successor representation modeled expected basin-state occupancy across successive steps. Correlations between basin-centroid distances and complete successor-profile distances were positive across all five basin solutions, with exploratory tests supporting correspondence in at least two solutions across all three geometries. These findings connect feature-based event representations with observed narrative transitions and modeled multistep organization. The framework translates hippocampal principles into source-linked event boundaries and state representations, providing an analytical basis for testing neural accounts of event segmentation and predictive organization during naturalistic recall.

Comment
60 pages, including supplementary materials. Code and data: https://github.com/joshua-sarinana/narrative-state-spaces

Closest papers

Nearest neighbours by meaning across the whole index.

Narrative Lookahead in LLMs: Event-Level Decodability, Predictive Advantage, and Steering

cs.CL ·2026-10-13 ·Donghoon Jung, Min Kim, Seojin Choi, Songeun Chae, Seohyon Jung
similarity 0.63
Abstract

Do language models carry information about narrative events before writing them, and how far ahead? We examine narrative lookahead through salient, state-changing events rather than tokens or response-level attributes. We extract 23,355 LLM-annotated events from 2,000 stories generated by four open-weight LLMs, labeling them along three nonexclusive dimensions of change: within agents, between agents, and in the story world, with human validation on a subset. Event segmentation and plot-independent labels enable comparisons across stories at horizons measured in events rather than in tokens. At event ends, we probe hidden states for upcoming event types and compare predictions with text-only predictors using matched prefixes. Across four models, future event types are decodable above prevalence baselines for at least four subsequent events, but probes significantly outperform both primary text-only predictors only for the next event. In exploratory steering with OLMo-3.1-32B, a probe-derived direction shifts the proportion of the target event type in both intended directions at higher strengths. Our event-level approach links the prediction of future narrative developments to interventions that reshape subsequent event composition.

0.22

Shared Worlds, Private Minds: Structured Memory for Long-Form Writing as World Creation

cs.CL cs.AI ·2026-09-26 ·Qiuyu Tian, Xiaowen Gu, Hang Su, Jianghan Chao, Haojie Yin +7 more
benchmark similarity 0.62
Abstract

LLM agents that write long-form fiction need an explicit memory of the evolving storyworld to keep new events consistent with established facts. Such memory must keep heterogeneous narrative information distinct, integrate story developments across granularities, and recover dependencies that a writing request leaves implicit. We present NarraWorld, a structured memory system for long-form writing that treats memory construction as world creation. From a shared evidence-grounded graph, NarraWorld derives four connected views: world facts, per-character beliefs, open developments, and hypothetical branches (possible-world continuations). Hierarchical aggregation with atomic closure consolidates events into scenes, plotlines, and plots, keeping each higher-level node traceable to its constituent source spans. For retrieval, planned reconstruction infers a query's dependencies from the current narrative situation and a preview of memory, then assembles the relevant records within a token budget. Across three writing benchmarks, NarraWorld achieves the strongest aggregate results. Its memory also transfers to situated role-playing and largely preserves recall on a general-purpose long-term memory benchmark, paving the way for agents that sustain coherent storyworlds across diverse narrative tasks.

0.23

Balancing Evidence and Interpretation: Historical Grounding Ratio as a Design Parameter for AI-Generated Urban Storytelling

cs.HC ·2026-08-25 ·Fuyang Zhang, Maurice Benayoun
hot direction similarity 0.60
Abstract · 34 pages, 11 figures, 4 tables

Location-aware generative systems can now select historical archives and real-time contextual information based on a user's surroundings to automatically generate narratives for urban heritage walks. Yet when multiple sources jointly inform generation, existing systems provide neither a clear representation of how much content from each source actually appears in the output nor an operational means of measuring it. We introduce the Historical Grounding Ratio (HGR), defined as the proportion of claim-bearing information units in a generated narrative that are supported by historical archives. HGR turns the realized share of historical evidence in a narrative into a directly measurable design parameter. In GeoDrama, a mobile narrative system, we created three conditions that used a common retrieval procedure and comparable evidence-bundle sizes while varying the allocation of information from different sources during generation. We evaluated how changes in HGR affected narrative experience through a within-subject walking study with 18 participants. Increasing HGR significantly strengthened the perceived relevance between narrative content and the specific location. However, historical understanding, integration with the visible scene, appropriateness of the amount of information, and intention to explore further did not increase monotonically with HGR; all four measures were highest in the intermediate, balanced condition. These findings show that designing location-aware generative interfaces involves not only retrieving relevant material but also determining how information from different sources composes the final output. HGR offers an operational measure for comparing information-allocation strategies and their experiential consequences.

0.38

MemoryVLN: From Ego-Aware Memory Representation to Cross-Context Memory Reuse in Vision-Language Navigation

cs.RO cs.AI ·2026-10-13 ·Xueyao Wei, Yifei Wang, Delun Li, Shaoan Wang, Junzhi Yu +2 more
similarity 0.58
Abstract

Large vision-language models (LVLMs) have shown strong potential for embodied vision-language navigation (VLN), yet their performance degrades on long-horizon trajectories due to context-length limits, redundant historical observations, and unstable spatial alignment across time. These issues make it difficult to both compress long navigation histories and reliably reuse past spatial experience. To address these limitations, we propose \textbf{MemoryVLN}, a unified memory-driven navigation system built around memory construction and management. During memory construction, \emph{Long Sequence Compression} employs forgetting-curve-inspired temporal sampling to preserve dense recent evidence and sparse yet representative distant observations under a limited token budget. \emph{Ego-Aware Memory Representation} further integrates 2D semantic tokens, 3D geometric tokens, and 6D agent poses, allowing each memory to encode both what was observed and where it was observed. During memory management, \emph{Hierarchical Memory Bank} maintains in-episode and context-level memories through cross-context warm-start and confidence-controlled write-back. \emph{Memory Enhancement} then retrieves the Top-$K$ relevant memories according to the current navigation state and fuses them with the current visual tokens. Together, these mechanisms transform raw navigation history into compact, spatially grounded, selectively retrievable, and reusable navigation experience. Extensive experiments on R2R-CE and RxR-CE demonstrate consistent improvements over the state-of-the-art baselines by a substantial margin (i.e., 2\% and 6.5\% in successful rate).

0.40

Language Models Have Interpretable Narrative Mechanisms

cs.CL ·2026-10-09 ·David Yiyang Liu, Aditya Joshi, Paul Dawson, Andrew Piper
similarity 0.57
Abstract · 24 pages, 5 figures, 16 tables

We investigate whether language models contain internal components that contribute to representing narrativity, the degree to which a text exhibits narrative properties. Across GPT-2-Small, Gemma-2-2B, and Llama-3.1-8B, we identify attention heads, MLP neurons, and sparse autoencoder features whose activations correlate with narrativity. Ablating selected neuron and feature sets increases next-token prediction loss more for high-narrativity than for low-narrativity texts, and reduces the narrativity of open-ended generations. On downstream benchmarks, the largest effects occur in story completion and narrative question answering, although they vary across models and languages; results on confabulation and hallucination benchmarks are mixed. These findings provide causal evidence that selected sets of narrative-associated components contribute to model behaviour, while their internal organisation, relation to narrative theory, and broader functions remain open questions.

0.19

Steering Readerly Dynamics: Trajectory-Guided Story Generation with Large Language Models

cs.CL ·2026-10-30 ·Danrui Li, Yiwei Zhao, Mubbasir Kapadia, Lingxiao Li
similarity 0.56
Abstract · 55 pages, 20 figures, 18 tables, including references and the appendix

Large language models (LLMs) are increasingly used to generate stories, but these stories struggle to reproduce engaging readerly dynamics, the evolving reader responses that shape narrative experience. To address this challenge, we propose a framework that learns readerly dynamics from high-quality human-written stories and uses them to guide story generation. Instead of directly modeling high-dimensional story content, we train a small LLM to predict future reader responses as low-dimensional trajectories. We then leverage the strong instruction-following capability of a larger, off-the-shelf writer LLM to generate story segments that follow these predicted trajectories within a given story setting. Our framework improves trajectory-based fidelity to human-written stories by 12%-35% while largely preserving story coherence.

0.11

Peak-DNA: Recurrent Morphology in Global Narrative Propagation

cs.CR ·2026-10-27 ·Joosung Kim, Luyonghe Li, Shanwen Wu
published similarity 0.56
Abstract · 8 pages. Accepted and presented at ASONAM 2026, Rabat, Morocco, August 24-27, 2026. Proceedings publication forthcoming

Global narrative streams exhibit noisy, fragmented, and asynchronous amplification bursts, making direct waveform comparison unreliable for recurrence analysis. This paper introduces Peak-DNA, a framework for identifying recurrent propagation morphology in global narrative streams. The proposed framework transforms hourly GDELT activity into normalized macro-peak episodes through denoising, macro-peak consolidation, and temporal alignment, and compares propagation morphology using DTW-based similarity analysis. Using GDELT narrative streams, we analyze five high-amplification narrative domains: Iran, Defense, AI, Space/Elon, and Quantum/PQC. The results show that amplification events repeatedly converge toward morphology-level propagation patterns within each narrative domain. DTW-based similarity analysis further demonstrates strong intra-domain structural compactness despite heterogeneous publication dynamics and severe observational noise. These findings suggest a measurable morphology layer beyond semantic content or anomaly intensity, providing an initial structural foundation for recurrence-aware narrative monitoring, propagation family discovery, and longitudinal Narrative Genome analysis.

0.42

How LLMs Build Fictional Worlds: Setting and Narrative Space in AI-Generated Creative Storytelling

cs.CL ·2026-09-02 ·Katrin Rohrbacher, Björn Nieth, Emmanuelle Salin, Bjoern Eskofier, Michaela Mahlberg
top venue similarity 0.55
Abstract

In this paper, we analyze how Large Language Models (LLMs) employ worldbuilding strategies, focusing on setting as one measurable dimension of storyworld construction. We compare 1,000 AI-generated stories per model in English and German with human-authored fiction from Project Gutenberg. Building on prior work, we operationalize setting through five types of narrative space: "action", "perceived," "visual," "descriptive" and "no space", identified using fine-tuned BERT classifiers for German and English. We generate narratives using GPT 4.1, LlaMA 3.3, Mistral 3.2, and Gemma 3 and compare their spatial distributions to a human-authored baseline. We find that human-authored texts predominantly employ "action space," grounding narratives in embodied character-environment interaction, whereas LLMs systematically overproduce "perceived space," emphasizing atmosphere and affect. This divergence remains stable across narrative time. Overall, our findings show that LLMs exhibit worldbuilding patterns that differ consistently from human-authored fiction in ways that are both model-specific and language-sensitive.

0.46