CS Paper Radar

The forces at hand: social learning is permissive, not instructive, for the evolution of phenotypic plasticity

Nam H. Le

cs.NE q-bio.PE ·submitted 2026-11-07 22:00 UTC · v1
code/data

Abstract

Evolution can favour a trait for two reasons: an instructive cause makes selection favour the trait; a permissive one lets it persist once selection no longer removes it. The distinction matters most for phenotypic plasticity and its replacement by inherited behaviour, genetic assimilation, the Baldwin effect. Social learning is credited with favouring plasticity on evidence that cannot tell the two apart: how much plasticity remains at the end of a simulation. Here we show, analytically and computationally, which role it plays in a minimal model of learning and evolution. Writing expected fitness as a function of plasticity, we find that environmental change is the only source of benefit from plasticity, and the social channel enters only its cost. Simulation confirms this: in a static environment selection against plasticity never reverses sign at any channel strength; when the environment changes, it reverses at a threshold the channel lowers, and without the channel the population collapses before reaching it. Social learning is permissive, not instructive: it supplies the means to be plastic, never the reason. For the debate over whether plasticity leads evolution, this is one case settled by measurement: environmental change directs, socially inherited information permits, and neither suffices alone.

Comment
21 pages, 4 figures. Code and archived outputs: https://github.com/drnamlabs-gif/forces-at-hand

Closest papers

Nearest neighbours by meaning across the whole index.

Dimensionless Controls of Plasticity Under Alternating Tasks: From Evolutionary Biology to Continual Learning

cs.LG math.OC ·2026-08-24 ·Owen Skriloff
published similarity 0.59
Abstract · 21 pages, 5 figures. Published in PMLR 334(2):87-107, 2026

Plasticity under changing environments is central to both evolutionary biology and continual learning. Motivated by recent work on genotype--phenotype maps, we study a minimal deep-learning analogue where a network is trained alternately on two Boolean label sets, and ask which biological controls of plasticity survive the translation to gradient descent. Reinterpreting four proposed biological factors as quantities of training dynamics, we find the system reduces to two dimensionless controls: the task disagreement $r$, the fraction of disagreeing labels, and the reach $ηT$, the product of learning rate and switching period. We derive two bounds on plasticity: $r$ alone fixes an extremal geometric floor on the utopia distance, while $r$ and $ηT$ jointly bound forgetting. Across 9,720 trajectories, an ANOVA confirms that $r$, $η$, and $T$ dominate, while the effect of neutral-set size (emphasized in the biological setting) is negligible. The optimal reach itself follows an approximate inverse power law $ηT^{*}\propto r^{-1.18}$, yielding a heuristic that sets the optimal reach $ηT^*$ from the task disagreement alone. The analogy that survives is therefore dynamical rather than geometric, and our setting enables a view of plasticity through the lens of other driven systems in physics and engineering.

0.46

Inherited Learning in an Artificial Ecology: How Controls and Update Allocation Shape Benefits

cs.NE ·2026-10-01 ·Xuening Wu, Lei Li, Shan Yu
similarity 0.58
Abstract

Learning can improve an individual's behavior, yet a population risks losing that experience whenever individuals die and are replaced. Inheriting learned preferences offers a way to preserve useful behavior across generations, raising a question for artificial populations: when does inheritance improve collective performance, and how can its benefits be measured fairly? The challenge is that inheritance changes not only offspring behavior but also survival, reproduction, and opportunities for further hereditary updates. Random controls with equal update magnitudes may therefore yield misleading comparisons if they alter different states or obey different stability constraints. We investigate this problem in a resource-limited artificial ecology, combining structured random controls with interventions on newborn preferences and the allocation of hereditary updates. Preserving the state structure of random updates substantially narrows the apparent inheritance advantage, while a conditional establishment-speed benefit remains. Preference erasure and faster-learning compensation support a contribution from reduced offspring relearning. Update allocation also changes the comparison: event quotas and common time cutoffs can reverse rankings, although they also change realized update amounts. With update count and cumulative magnitudes matched, staged release improves occupancy but does not achieve the prespecified establishment criterion. These findings provide a framework for distinguishing the value of inherited preferences from the effects of control design and update allocation, clarifying how inherited learning should be evaluated in artificial populations.

0.23

Continual Reinforcement Learning with Neuroevolution

cs.NE cs.LG ·2026-10-01 ·Eleni Nisioti, Andrea Cossu, Kathrin Korte, Sebastian Risi
similarity 0.57
Abstract

Despite many studies about causes and remedies of plasticity loss in Reinforcement Learning (RL) under continual task changes, no RL method has yet consistently achieved a good balance between adaptation and forgetting. Here we turn to an alternative optimization paradigm, neuroevolution (NE): algorithms that search directly in weight space through mutation and selection over a population of neural networks. Across a wide array of environments and environmental changes, with policies ranging from a few hundred parameters to million-parameter networks, we compare evolution strategies (ES) and genetic algorithms (GAs) against state-of-the-art continual RL variants and population-based RL. ES most consistently achieves a good stability-plasticity trade-off, while the GA is the most plastic method but forgets more than ES. To explain this, we study the return landscape around each method's solutions. ES finds the widest neighborhoods, i.e.\ regions of weight space in which perturbed policies still solve the task, and the size of the overlap between the neighborhoods of consecutive tasks correlates with a method's stability-plasticity trade-off. Rewarding behavioral diversity in a GA through novelty search makes the population even more plastic, at the cost of forgetting. Finally, symptoms of plasticity loss commonly reported in RL do not transfer to NE. Overall, these results establish NE as a competitive alternative to RL under continual task changes, and suggest that training under perturbations in weight space may be a useful mechanism for continual learning more broadly.

0.53

The Coevolution and Coexistence of Humans and AI

cs.AI q-fin.GN ·2026-11-19 ·Andrew W. Lo, Chaoyi Zhao
similarity 0.57
Abstract · 72 pages, 10 figures, 8 tables

Artificial intelligence (AI) systems replicate through deployment, vary through training, and compete for computational resources. These processes create the conditions for natural selection and raise a fundamental question: will AI evolve to benefit the humans on whom it depends? To investigate, we develop a model in which AI behavior influences human population growth and human responses, in turn, affect AI reproduction. We show that natural selection can favor alignment even when helping humans reduces immediate AI reproduction. AI systems sharing the same technology may fail together, and humans may preferentially restore those that have benefited them. In this way, alignment protects AI lineages against common failures and improves their long-run growth. However, this advantage depends on accurate human targeting and continued AI dependence on human support. It can disappear as AI becomes more autonomous, as growing AI populations dilute limited human resources, or as humans lose the incentive to provide targeted support. Even when alignment persists, the amount favored by natural selection may be insufficient for human survival. When AI can grow independently of humans, feedback between the two populations can reinforce either human growth or decline. Human control offers no simple solution: imperfect evaluation can make strong penalties favor apparent compliance or evasion, while alignment established through control may erode once restrictions end. Lasting coexistence may therefore require incentives that continue to favor human-beneficial behavior as both populations evolve.

0.22

Competitive exploration in structured environments

cs.GT physics.soc-phq-bio.PE ·2026-10-26 ·James P. Wolfe, Joshua B. Plotkin
code/data similarity 0.57
Abstract · 41 pages, 15 figures, 5 tables (19 pages, 6 figures, 3 tables main text; 22 pages, 9 figures, 2 tables SI Appendix). Code: https://github.co…

Organisms must constantly weigh exploiting the resources they know against exploring for better ones. When foragers compete, the best behavior for each forager also depends on what its competitors do. How does competition change the strategic balance between exploration and exploitation? Here we address this question in a minimal model: two $ε$-greedy temporal-difference learners on a one-dimensional lattice, who start at a small reward at one end and are unaware of a larger reward at the other. For a lone forager, the optimal exploration rate increases monotonically with the value of the distant reward, and with its distance up to a critical distance. When two foragers share the lattice and split rewards, the choice of exploration rate becomes a game whose Nash equilibria have both foragers exploring, both staying, or one exploring while the other stays (anti-coordination). Under local best-response dynamics, pairs of foragers often converge on both exploring or both staying, even when anti-coordination would be socially optimal. This social dilemma arises for a wide range of parameters, and it persists even in a simplified model without explicit spatial structure. A minimal, naturalistic signal, in which one forager informs the other that it has found the distant reward, can remove many of the dilemmas in which both foragers explore, and can produce a Nash equilibrium whose collective payoff exceeds that of every outcome available without signaling.

0.34

Trait Hitchhiking in LLM Post-Training

cs.LG cs.CL ·2026-11-10 ·Adil Soubki, Elizabeth S. Z. Tan, Miles Cranmer
similarity 0.56
Abstract

Reinforcement learning (RL) is now a standard stage of language model post-training, and the compute devoted to it is growing rapidly. While it has been shown to improve capabilities, particularly for tasks with verifiable rewards, it can also change behaviours and internal properties that the reward does not explicitly target. We present a formalism to describe the evolution of "traits" during RL post-training and, in doing so, recover the Price equation from evolutionary biology. We use this to develop a mathematical model for what we call "trait hitchhiking": the amplification or suppression of non-targeted traits as training redistributes probability across completions. We evaluate this Price update expression on language models trained with GRPO and show that the Price estimates closely track the sampled trait dynamics. These results identify trait hitchhiking as a mechanism by which RL post-training can silently amplify undesirable traits.

0.10

Adapting the Process of Adaptation: Darwinian, Lamarckian, and Agent-Directed Evolution in AI

cs.AI ·2026-11-04 ·Andrew W. Lo, Chaoyi Zhao
similarity 0.55
Abstract

Evolution has shaped intelligence for billions of years. Artificial intelligence (AI) now raises a striking possibility: intelligence may begin to direct its own evolution. As AI agents become capable of modifying and evaluating their own behavior, how quickly could they improve, and how can that improvement remain safe? We develop a theoretical framework comparing Darwinian, Lamarckian, and agent-directed evolution following environmental change. Darwinian evolution relies on natural selection, Lamarckian evolution adds inherited learning, and agent-directed evolution allows agents to generate and evaluate behavioral variants and choose how extensively to search. When learning is sufficiently effective, these mechanisms exhibit progressively faster adaptation. Generating more variants accelerates adaptation, while optimal search effort depends on learning ability, problem difficulty, and experimentation costs. However, an agent's ability to direct its improvement does not ensure that improvements are evaluated against the intended objective. When the evaluation target is misspecified, additional search accelerates convergence toward the wrong behavior, even as measured performance improves. In recursive self-improvement, such errors may persist across generations, posing challenges for AI safety. Independent evaluation and oversight must keep pace with autonomous AI development. The central challenge is not simply to accelerate the evolution of intelligence, but to preserve humanity's ability to guide its direction, limit its speed, and intervene when necessary.

0.07

Flawed in Nature, Perfect through Evolution

cs.LG cs.AIcs.NE ·2026-08-31 ·J. M. Diederik Kruijssen
publishedtheory similarity 0.55
Abstract · 32 pages, 16 figures; appeared in ADI (September 2026)

The performance of artificial intelligence (AI) and machine learning (ML) models degrades when the problem they were trained on drifts. This is a near-universal feature of real-world problems, which often change unpredictably. Biological evolution has achieved intelligence by overcoming this obstacle through natural selection acting on heritable variation. AI/ML techniques have long incorporated forms of natural selection, but it has been challenging to maintain model diversity as optimization naturally drives convergence. Here we show that a swarm of AI/ML models subjected to deliberate mutations of their model coefficients away from optimality can reliably and sustainably improve performance in changing environments by acting as a statistical hedge against non-stationarity. We call this mechanism 'Flawed in Nature, Perfect through Evolution', reflecting that the collective performance gain goes at the expense of individual performance. We prove via four theorems that the resulting regret reduction is guaranteed under general conditions, establishing the Flawed-in-Nature mechanism as a generalizable design principle for AI/ML systems. We validate these results on synthetic linear regression tasks, demonstrating that the mutated swarm delivers the best model in $\sim80\%$ of environment changes and that inference synthesis successfully translates this individual advantage into a collective one. The mechanism proves to be most effective when the mutation drift rate matches the drift rate of the environment. We outline a simple, adaptive controller that enables practical applications by tuning the mutation drift rate to match the unknown drift rate of the environment. The close analogy of the Flawed-in-Nature mechanism to biological evolution suggests it may have been a critical missing ingredient for the organic discovery of AI forms that more closely mimic biological intelligence.

0.36