CS Paper Radar

Symmetry-breaking in a discrete-choice LQG mean field game

Ali Akbar Rezaei Lori, Piyush Grover

eess.SY math.DSmath.APmath.OCnlin.AO ·submitted 2026-10-05 03:31 UTC · v2

Abstract

Mean-field games provide a continuum framework for modeling the dynamics of large, interacting populations of non-cooperative agents. This paper studies symmetry-breaking in a finite-horizon, two-choice min-LQG mean-field game in which identical agents with linear stochastic dynamics choose one of two equally desirable terminal destinations, while trading off control effort against social pressure to conform. The model has an odd symmetry between the two destinations and therefore always admits a symmetric, dynamic Nash equilibrium in which the population splits evenly between them, producing a deadlock collective state at final time. Numerical studies have suggested that, as the penalty for social nonconformity increases, this symmetric equilibrium loses stability as a fixed point of an associated scalar, self-consistency map, and asymmetric consensus Nash equilibria emerge, where most agents select the same destination. By analyzing the linearized forward-backward PDE system through the scalar map representation, we provide a proof of this loss of stability of the symmetric equilibrium. Together with the odd symmetry of the map, this implies the existence of symmetry-broken mean-field game equilibria corresponding to consensus on either destination.

Comment
26 pages, 4 figures. Originally submitted for review 5/18/26. v2 fixes issue with proof of lemma 4.3 related to terminal differentiability of the linearized scalar map, and other minor issues/typos

Closest papers

Nearest neighbours by meaning across the whole index.

Infinite Horizon Mean-Field Terminal Value Problem

eess.SY math.OC ·2026-09-11 ·Uğur Aydın, Tamer Başar, Naci Saldi
similarity 0.62
Abstract · 39 pages, 2 figures

We introduce a class of finite- and infinite-horizon discrete-time control problems for studying macroscale systems in discrete time, which we refer to as mean-field terminal value problems (MFTVPs). An MFTVP takes a terminal \(Q\)-function as input and, starting from this terminal \(Q\)-function, seeks an indefinite backward evolution of optimal policies and state measures, as required for an infinite-horizon non-stationary mean-field equilibrium (MFE) of a discrete-time mean-field game (MFG). We study the existence and uniqueness properties of this problem. As an application, using the uniqueness properties of MFTVPs, we show that, in the average-cost setting (and in the discounted setting for sufficiently small discount factors), MFTVPs can be used as an intermediate step to develop approximation schemes between finite-horizon MFEs and average-cost MFEs (respectively, stationary MFEs). In contrast to approaches that use infinite-horizon MFGs as intermediate problems, MFTVPs can be employed when the discount factor is sufficiently small (or, in the average-cost setting, when the drift factor is sufficiently small), together with a regularizer, to approximate a stationary MFE. Assuming uniqueness of the solution of a MFTVP, the restrictions we impose on the Lipschitz parameters of the system are weaker than the contraction conditions available for regularized stationary MFGs, and our approximation scheme remains applicable even in the presence of multiple stationary MFEs.

0.31

Beyond Nominal Equilibria: Risk-Averse Multi-Population Mean-Field Games

cs.GT math.OCcs.LGeess.SY ·2026-10-07 ·Bhavini Jeloka, Siddhartha Ganguly, Panagiotis Tsiotras
similarity 0.61
Abstract · Submitted to a conference; comments are welcome

Recent advances in mean-field games and its multi-population variants enable large-scale heterogeneous multi-agent systems to be modeled through representative agents and their associated mean-field distributions. However, existing approaches do not explicitly account for uncertainty in the behavior of other populations. To this end, we introduce a new paradigm: risk-averse multi-population mean-field games, where each population optimizes a worst-case expected reward over dynamically feasible ambiguity sets of mean-field flows of a subset of the other populations. Employing an occupation-measure formulation along with tools from set-valued analysis, we establish, under mild assumptions, several theoretical properties of the multi-population game, including the geometric properties of the ambiguity sets and the existence of a novel risk-averse multi-population mean-field equilibrium. Further, we derive contractivity results of the fixed-point operator under entropy regularization and show that it can be utilized to learn the equilibrium. Finally, we propose a risk-averse fictitious-play scheme and show that exploitability decays to zero, despite the additional nonlinearity introduced by the worst-case objective. We report several numerical experiments to illustrate convergence and risk-averse behavior.

0.28

Optimization Frameworks & Learning Algorithms for Discrete-Time Mean Field Games

cs.LG math.OC ·2026-11-01 ·Xin Guo, Mathieu Laurière
similarity 0.60
Abstract

This monograph introduces discrete-time mean field games with finite state and action spaces, emphasizing optimization formulations and learning algorithms. Starting from Markov decision processes and finite-player stochastic games, it develops the notion of mean field Nash equilibrium, establishes existence and uniqueness results under suitable assumptions, and explains how mean field equilibria yield approximate equilibria in large finite-player games. Building on the linear programming formulation of Markov decision processes, occupation measures and primal-dual formulations connect equilibrium computation with mathematical optimization. The monograph presents fixed-point iterations, fictitious play, online mirror descent, and optimization-based methods, discussing their convergence properties and limitations. Numerical examples illustrate crowd motion, traffic routing, epidemic management, and the computation of multiple equilibria. It combines examples, theoretical results, and implementable algorithms, with bibliographic notes providing connections to the broader literature.

0.22

Asynchronous Replanning in Two Population Linear Quadratic Mean Field Games: Information Requirements and Stability

eess.SY math.OC ·2026-09-10 ·Yuxin Jin, Wang Yao, Xiao Zhang
similarity 0.59
Abstract

We study asynchronous continuation replanning in a two-population linear--quadratic mean field game with deterministic open-loop controls and heterogeneous, possibly erroneous initial information. At exogenous opportunities, one population recomputes its continuation response from the physical aggregate state reached, with the opponent's active plan frozen. The state--plan target needed to initialize replanning is recoverable from local aggregate observations if and only if a kernel-inclusion condition holds; full recovery of the hidden initial input is unnecessary. For revisions accumulating before the terminal time, spectral stability of the limiting two-response cycle yields bounded physical execution and a finite state left limit. The zero-extended continuation plans then converge strongly to the mean field equilibrium restarted from that state. A scalar counterexample shows that well-posed continuation problems and a convergent physical state can coexist with divergent remaining plans. We also construct an exact causal implementation from local aggregate observations and establish finite-population robustness on every fixed finite opportunity prefix. Revision records match with probability tending to one, and the mean-square implementation error truncated to the matching event is \(O(N_*^{-1})\), where \(N_*\) is the smaller population size.

0.37

Stable Coexistence in Ecologies and Games

cs.GT math.DSq-bio.PE ·2026-09-08 ·Türkü Özlüm Çelik, Vincenzo Antonio Isoldi, Irem Portakal, Giulio Zucal
similarity 0.57
Abstract · Comments are welcome!

We study feasible stable equilibria of Lotka-Volterra systems and their higher-order extensions. We complete the classification of impossible ecological interaction networks with at most four species and extend several of these impossibility results to families with arbitrarily many species. We then show that these sign-pattern obstructions are specific to the pairwise Lotka-Volterra model: arbitrary prescribed growth rates and pairwise coefficients can be supplemented by higher-order interactions so as to admit a feasible asymptotically stable equilibrium. Through the correspondence with replicator dynamics, we interpret feasible equilibria of higher-order Lotka-Volterra systems as totally mixed symmetric Nash equilibria of symmetric multiplayer games, derive bounds on their number, and study their robustness under perturbations of the payoff tensors. We conclude by showing that every impossible ecology determines a nonempty open class of symmetric two-player games with no totally mixed evolutionarily stable strategy.

0.25

Equilibrium Statistics and Stability in Random Two-Population and Three-Population Evolutionary Games

cs.GT ·2026-11-17 ·Zhao Song, Manh Hong Duong, The Anh Han
similarity 0.56
Abstract

Multi-population matrix evolutionary games provide a framework for studying adaptation and strategic interactions among heterogeneous agents. When payoffs are uncertain, however, analysing a specified game does not reveal how frequently different evolutionary outcomes occur or how their probabilities depend on modelling assumptions. We study two- and three-population games with two strategies per population and both within- and between-population pairwise interactions, with payoffs fixed during each evolutionary trajectory. For two populations, we derive equilibrium-existence probabilities and analytical stability results for generic games and three structured classes: diversity, exclusive, and avoidance games. For generic two-population games, independent Gaussian sampling of payoff entries and of replicator coefficients produces different equilibrium statistics. Interaction structure further distinguishes coexistence from attraction: diversity and exclusive games share the same interior-existence probability, but only exclusive games admit asymptotically stable interior equilibria. Avoidance games admit transversely attracting equilibrium families without locally asymptotically stable individual points. For generic three-population games under independent payoff sampling, we obtain existence probabilities for all equilibrium types and joint existence-and-stability probabilities for boundary equilibria. Monte Carlo simulations support the analytical predictions and quantify multistability, while phase portraits illustrate initial-condition dependence. Under the same Gaussian payoff-sampling protocol, simulations show a lower frequency of fully mixed equilibria but a higher frequency of multistability for three populations than for two.

0.36

Horizon-Independent Contraction for Continuous-Time Discounted Regularized Mean-Field Games

cs.GT eess.SYmath.OC ·2026-08-27 ·Junji Yan, Uğur Aydın, Tamer Başar
similarity 0.56
Abstract · 34 pages. Full version including complete proofs

We study contraction properties of non-stationary continuous-time mean-field games (MFGs) under discounting and entropy regularization. The state of the representative agent evolves according to a controlled continuous-time Markov chain, and both the state and action spaces are finite. In contrast to the undiscounted case, we show that, under a sufficiently large discount rate, finite-horizon MFGs admit a horizon-independent contraction condition, which also coincides with the corresponding infinite-horizon non-stationary contraction condition. As a byproduct, we obtain an explicit convergence rate between finite- and infinite-horizon mean-field equilibria. For each finite horizon, we further derive a refined contraction criterion from the spectral radius of a positive operator that majorizes the propagation of policy errors, and show that its large-horizon limit agrees with the horizon-independent contraction factor. Finally, we provide an explicit error bound between discounted and undiscounted finite-horizon regularized equilibria.

0.32

Metric-Based Equilibrium Selection in Noncooperative Differentiable Games

cs.GT eess.SY ·2026-10-05 ·Karan Mahesh, Runyu Zhang, Michael R. Benjamin, Gioele Zardini
similarity 0.56
Abstract · 8 pages, 2 figures

Metric conditioning can change which equilibrium attracts learning dynamics without moving the equilibria of a differentiable game. We study how to use state-dependent symmetric positive-definite (SPD) metrics to select among known equilibria by keeping a designated equilibrium attracting while making a rival unstable. Building on classical results on matrix stability under positive-definite multiplication, we characterize when such destabilization is possible and show how restricting the metric to act independently on each player limits the stability changes that can be achieved at differential Nash equilibria. We then combine a stabilizing metric at the selected equilibrium with a destabilizing metric at the rival through smooth interpolation, yielding a single metric field that preserves every equilibrium of the game while assigning the desired local stability types. We also derive a step-size condition for implementing the method in discrete time. The approach is validated on a continuous-commitment stag hunt and an entropy-regularized iterated prisoner's dilemma, where it selects the desired equilibrium in both settings.

0.28