CS Paper Radar

Evolutionary games on networks with negative edge-based environmental feedback

Katherine Betz, Feng Fu, Naoki Masuda

cs.SI physics.soc-phq-bio.PE ·submitted 2026-11-08 00:09 UTC · v1
published

Abstract

Environmental feedback can fundamentally alter the game payoff structure underlying the evolution of cooperation. How feedback-evolving games interact with population structure under non-weak selection remains incompletely understood. We study an evolutionary game on networks in which each edge has a binary environmental state that determines the payoff matrix used by the two connected individuals. By assumption, cooperation tends to improve the local environment, which in turn favors defection, thereby creating negative feedback between strategies coupled with the environmental condition. We analyze the model under strong selection using a mean-field approximation, a pair approximation that tracks both strategy pairs and edge environments, and agent-based simulations. In well-mixed populations, the feedback can generate bistability between full cooperation and full defection, as well as sustained oscillations arising through a Hopf bifurcation. Sparse networks (i.e., with low nodes' degrees) can eliminate bistability, suppress oscillations, and produce stable intermediate levels of cooperation. The pair approximation captures these effects and generally agrees more closely with simulations on sparse networks than the mean-field approximation. Our results show that edge-based environmental feedback and network structure, such as density of edges, interact to determine whether the fraction of cooperators stabilizes or oscillates over time.

Comment
8 figures

Closest papers

Nearest neighbours by meaning across the whole index.

An Evolutionary Computation Framework for Multi-Agent Q-Learning with Mean-Field Environmental Feedback

cs.MA cs.AI ·2026-09-05 ·Lichen Wang, Shijia Hua, Linjie Liu
similarity 0.66
Abstract

Multi-agent reinforcement learning in networked populations is governed by the interaction between individual adaptation, local encounters, and changing environmental conditions. To study this interaction, we formulate a coupled learning--environment model in which agents update stateless $Q$-values on a fixed graph, while their population-average behavior drives an environmental variable that dynamically modifies the payoff matrix. Under a first-order mean-field closure, we derive a deterministic transport equation for the population distribution of $Q$-values and couple it with a projected discrete update for the environmental state. The resulting model is evaluated against finite-network Monte Carlo simulations on random regular, Erdős--Rényi, Barabási--Albert, and random geometric graphs. Across the tested parameter ranges, the mean-field system reproduces the main macroscopic cooperation and environmental trajectories, and the trajectory-level root-mean-square error generally decreases with population size and average degree. The analysis further shows that environmental feedback reshapes the learned action-value ordering, while reinforcing feedback can produce pronounced dependence on the initial learning bias and resource level. The environmental timescale also plays an important role: a rapid response can drive the resource state to a boundary before learning adapts, whereas a slower response preserves the interaction between behavioral learning and environmental recovery. These results provide a population-level description of coupled reinforcement learning and environmental dynamics and characterize the performance of the mean-field approximation within the tested network and parameter ranges.

0.20

Strategic Origins of Network Structure

cs.GT physics.soc-phcs.SIecon.GN ·2026-10-17 ·Christoph Riedl, Rory Smead
theory similarity 0.61
Abstract

The structure and dynamics of complex networks are intimately linked. Despite immense progress in statistically characterizing these systems, a generalized mechanistic framework explaining why specific mesoscale structures emerge remains elusive. Here we introduce the game-graph equilibrium, the stable rest point of a payoff-driven partner-choice dynamic, analogous to a Nash equilibrium. This reveals network structure as the fossilized record of strategic interaction. We prove analytically that two-type games have exactly four network topologies, which are their exhaustive thermodynamic phases: assortative, disassortative, and two core-peripheries. This result generalizes to $K^K$ topological classes for $K$-type interactions. Furthermore, four distinct Nash equilibria produce core-periphery topologies, yet their payoffs reveal whether the underlying dynamic is cooperative or exploitative. To recover the generating dynamics from observed networks, we develop mechanistic inference by constraining a block model to lie on a low-dimensional, game-theoretic manifold. Applied to real-world networks, the model yields interpretable quantities, distinguishes states that look identical to conventional methods, predicts network topologies it has never seen without retraining, and controls its own complexity without hand-tuned penalties. Networks such as international trade are well described by the model despite the hard constraint, suggesting that real-world systems are organized by payoff-driven partner choice. Our framework resolves a foundational ambiguity by offering a precise, mechanistic definition of communities: strategic equivalence.

0.43

Collective Hysteresis and Multistability in Threshold Networks

cs.SI math.DSnlin.AO ·2026-09-05 ·Moses Boudourides
theory similarity 0.60
Abstract

In a mechanistic model of the dawn chorus, Kaye showed that heterogeneous activation thresholds and a shared feedback signal determined by the population's active fraction can produce abrupt collective activation and hysteresis. We extend this mechanism to a network of interacting agents. Each node has a continuous activation level, and a nonnegative row-stochastic matrix determines how node activities contribute to individual feedback. We prove that sufficiently weak feedback yields a unique globally attracting equilibrium. For all feedback strengths, the homogeneous dynamics exactly reproduce Kaye's scalar equation; consequently, network topology does not alter the folds or cusp of the homogeneous branch, and no heterogeneous mode becomes unstable before the homogeneous mode. For equitable partitions, the network admits an exact quotient system in which nodes within a block receive the same aggregate input from every block. When blocks are uncoupled, the quotient reduces to independent copies of Kaye's scalar equation. We show that every assignment of stable scalar equilibria to blocks persists under sufficiently weak interblock coupling, producing a combinatorial family of stable quotient equilibria that lift to stable full-network equilibria and remain under small perturbations that break exact equitability. For two symmetrically coupled blocks, branches with unequal block activities terminate at a pair of symmetry-related cusp bifurcations. Near the onset of bistability, we derive scaling laws for the interblock coupling at which these bifurcations occur, the activity difference between the blocks at bifurcation, and the corresponding shift of the external stimulus from the scalar cusp. Numerical continuation confirms the scaling laws for gamma, logistic, and normal threshold distributions.

0.21

Neural networks and games

cs.NE cs.GTcs.LGecon.TH ·2026-11-03 ·Philip R. Neary
similarity 0.59
Abstract

Hopfield neural networks and noncooperative games provide seemingly different approaches to understanding how collective outcomes emerge from local interactions. In a neural network, individual units adjust their states according to local signals; in a game, players choose actions to maximise individual payoffs. I establish an exact equivalence between symmetric binary Hopfield networks and binary-action games that admit a quadratic potential. The equivalence identifies stable network configurations with pure-strategy Nash equilibria, and asynchronous neural updating with best-response dynamics. More broadly, the storage and retrieval of memories in neural networks correspond, respectively, to the design and selection of equilibria in games.

0.29

Stable Coexistence in Ecologies and Games

cs.GT math.DSq-bio.PE ·2026-09-08 ·Türkü Özlüm Çelik, Vincenzo Antonio Isoldi, Irem Portakal, Giulio Zucal
similarity 0.58
Abstract · Comments are welcome!

We study feasible stable equilibria of Lotka-Volterra systems and their higher-order extensions. We complete the classification of impossible ecological interaction networks with at most four species and extend several of these impossibility results to families with arbitrarily many species. We then show that these sign-pattern obstructions are specific to the pairwise Lotka-Volterra model: arbitrary prescribed growth rates and pairwise coefficients can be supplemented by higher-order interactions so as to admit a feasible asymptotically stable equilibrium. Through the correspondence with replicator dynamics, we interpret feasible equilibria of higher-order Lotka-Volterra systems as totally mixed symmetric Nash equilibria of symmetric multiplayer games, derive bounds on their number, and study their robustness under perturbations of the payoff tensors. We conclude by showing that every impossible ecology determines a nonempty open class of symmetric two-player games with no totally mixed evolutionarily stable strategy.

0.25

Graphon Design for Human-Machine Coordination under Bounded Rationality: Optimality of Stochastic Block Models

eess.SY cs.GT ·2026-08-28 ·Zhewei Wang, Vu Anh Phi, Marcos M. Vasconcelos
published similarity 0.57
Abstract · Accepted for presentation at the IEEE Conference on Decision and Control 2026

Coordination is a desirable feature in multi-agent systems, ranging from robotic swarms to socioeconomic networks. This paper is concerned with promoting coordination among heterogeneous agents, e.g., machines and humans, interacting in a stag-hunt game. In our model the agents exhibit bounded rationality at different levels, which leads to uncertainty and a propensity for errors during learning and decision-making processes. This paper addresses the problem of designing a network topology that maximizes a global metric of coordination under such constraints. While optimizing over the discrete space of finite graphs is generally computationally intractable, we employ a mean-field approach to lift the problem into the space of graphons. Within this framework, we analyze agents following a logit learning dynamics. Using calculus of variations, we show that for systems with a bimodal rationality profile, it suffices to search for optimal graphons in the ensemble of stochastic block models. We then propose a water-filling algorithm to find a locally optimal graphon. Finite graphs can then be sampled from the optimized graphon, bypassing the inherent combinatorial complexities of discrete graph optimization.

0.26

Bayesian Replicator Dynamics and the Inversion of Strict Dominance in Bimatrix Games

cs.GT cs.MA ·2026-10-26 ·Jaime Ruiz-Serra, Nihat Ay, Michael Harré
similarity 0.57
Abstract · 18 pages, 3 figures

Replicator dynamics, the central model of evolutionary game theory, describe populations evolving under selection and agents learning by trial and error. They also admit a third use: continuous-time Bayesian inference, in which an agent planning against an opponent accumulates evidence for each candidate strategy. Here we show that this use divides all two-player games into two classes. With the standard expected-utility payoff, the dynamics can be expressed as Bayesian updating only in games (with any number of actions) where no player has a dominant strategy. The logarithmic payoff of Ay and Erb (2005) admits the Bayesian representation in every game. Coordination, anti-coordination, and cyclic games share qualitative dynamics under both payoff definitions, with equilibria displaced and selection thresholds shifted. In contrast, the flows of every game with a dominant strategy are reversed between the payoff definitions, with the strictly dominant strategy eliminated under logarithmic payoffs. Cooperation therefore emerges in the Prisoner's Dilemma, and games of common interest converge to mutual defection. For two-action games the classification is complete and rests on an exact Hamiltonian structure shared by both payoff definitions. The structure gives a behavioural test: cycles in the classic Matching Pennies game have amplitude-independent period (isochronous) under logarithmic payoffs, but not under expected utility. Logarithmic evidence integration thus determines which strategic outcomes dynamical selection can reach, wherever learning approximates Bayesian updating.

0.23

Equilibrium Statistics and Stability in Random Two-Population and Three-Population Evolutionary Games

cs.GT ·2026-11-17 ·Zhao Song, Manh Hong Duong, The Anh Han
similarity 0.57
Abstract

Multi-population matrix evolutionary games provide a framework for studying adaptation and strategic interactions among heterogeneous agents. When payoffs are uncertain, however, analysing a specified game does not reveal how frequently different evolutionary outcomes occur or how their probabilities depend on modelling assumptions. We study two- and three-population games with two strategies per population and both within- and between-population pairwise interactions, with payoffs fixed during each evolutionary trajectory. For two populations, we derive equilibrium-existence probabilities and analytical stability results for generic games and three structured classes: diversity, exclusive, and avoidance games. For generic two-population games, independent Gaussian sampling of payoff entries and of replicator coefficients produces different equilibrium statistics. Interaction structure further distinguishes coexistence from attraction: diversity and exclusive games share the same interior-existence probability, but only exclusive games admit asymptotically stable interior equilibria. Avoidance games admit transversely attracting equilibrium families without locally asymptotically stable individual points. For generic three-population games under independent payoff sampling, we obtain existence probabilities for all equilibrium types and joint existence-and-stability probabilities for boundary equilibria. Monte Carlo simulations support the analytical predictions and quantify multistability, while phase portraits illustrate initial-condition dependence. Under the same Gaussian payoff-sampling protocol, simulations show a lower frequency of fully mixed equilibria but a higher frequency of multistability for three populations than for two.

0.37