CS Paper Radar

An α-potential linear approximation for LQ differential games

Balint Varga, Gergely Lorant Kiss, Andreas Schwung

eess.SY math.OC ·submitted 2026-11-18 20:29 UTC · v1

Abstract

Feedback Nash equilibria of infinite-horizon linear-quadratic (LQ) differential games are characterized by coupled algebraic Riccati equations (cAREs), whose numerical solution generally relies on iterative algorithms and can be highly sensitive to their initialization. Motivated by the $α$-potential-game framework, this letter proposes an $α$-potential linear approximation for constructing a systematic, game-dependent initialization. For an N-player LQ game, a reference potential game is constructed. Its equilibrium requires solving only one standard algebraic Riccati equation. The original cAREs are subsequently linearized around this reference solution, yielding a coupled linear system whose solution provides player-specific corrections and hence an approximate feedback Nash equilibrium. The resulting approximation is used to initialize three standard cARE solvers. Numerical experiments on $10^4$ randomly generated two-player games show that the proposed initialization reduces the mean number of iterations. Further experiments for $N=2,\ldots,13$ show that the reduction in iteration count persists as the number of players increases.

Closest papers

Nearest neighbours by meaning across the whole index.

Infinite-Horizon Inverse Linear-Quadratic Differential Games with State- and Control-Dependent Noise

eess.SY ·2026-08-18 ·Lucas Günther, Karl Handwerker, Felix Thömmes, Balint Varga, Sören Hohmann
similarity 0.66
Abstract

This paper presents a method to solve the inverse problem for N-player infinite-horizon linear-quadratic (LQ) differential games with state- and control-dependent noise. For this stochastic setting, we derive necessary and sufficient conditions for linear feedback Nash equilibria, which take the form of coupled stochastic algebraic Riccati equations. We then derive a kernel representation of these equations to explicitly characterize the set of all cost function parameter combinations across players that are consistent with observed equilibrium trajectories, thereby solving the associated inverse problem. Numerical results illustrate the approach and confirm the theoretical findings, highlighting the inherent ambiguity of the inverse problem.

0.45

Differential Games for Compositional Handling of Competing Control Tasks

cs.MA ·2026-09-01 ·Joshua Shay Kricheli
benchmarkcode/data similarity 0.62
Abstract · Thesis submitted in partial fulfillment of the requirements for the Master of Sciences degree, The Department of Computer Science, The Facul…

We introduce a novel Divide and Conquer control design methodology leveraging differential games in single-agent, multi-objective dynamical systems. The proposed framework associates each control objective with a virtual input and establishes a non-cooperative, finite or infinite horizon differential game among representative players. Each player optimizes a distinct virtual cost function tailored to its specific goal, the full system state, and the other virtual inputs, while accounting for the remaining players' optimal policies. By establishing a Nash Equilibrium for this game, we synthesize a composite controller that achieves a stable balance across competing objectives, providing control engineers with an intuitive and modular framework for parameter re-tuning throughout the design cycle. We provide formal mathematical derivations for both continuous-time and discrete-time dynamical systems, targeting large-scale single-agent applications where complex, dynamically conflicting control objectives make global weighting intractable. To demonstrate the methodology, we developed an open-source Python package implementing a novel numerical algorithm for solving Coupled Algebraic Riccati Equations arising in infinite-horizon differential games. We evaluate the approach on two benchmark case studies: an inverted pendulum on a cart and a non-linear hierarchically controlled quadrotor. The resulting closed-loop performance is compared against the classical Linear Quadratic Regulator (LQR) across various transient and steady-state control metrics, demonstrating superior trajectory tracking and robust multi-objective regulation.

0.29

Efficient Equilibrium Computation in Colonel Blotto Games

cs.GT cs.DSecon.TH ·2026-11-03 ·Martin Bichler, Abheek Ghosh
similarity 0.62
Abstract · 75 pages

Colonel Blotto is a fundamental resource-allocation game in which two players divide their budgets across battlefields, and the higher allocation on each battlefield wins its value. The problem of computing an equilibrium efficiently has remained unresolved for its classical continuous version with arbitrary budgets and with values that may vary across battlefields but are the same for both players. We give a fully polynomial-time approximation scheme that computes an $\varepsilon$-Nash equilibrium in time polynomial in the input length and $1/\varepsilon$, and nearly linear in the input length for fixed $\varepsilon$. For sufficiently balanced budgets and battlefield values, we also compute exact equilibria in linear time.

0.13

General-Sum Linear Regulator Games for Positive Systems

eess.SY math.OC ·2026-08-24 ·Alba Gurpegui, Monika Tomar, Takashi Tanaka
publishedtheory similarity 0.60
Abstract · 6 pages and 3 figures. Accepted for presentation at the 65th IEEE Conference in decision and control 2026 (CDC)

This paper studies a continuous-time general-sum non-cooperative game with linear costs, positive linear system dynamics, and elementwise linear input constraints. In the finite-horizon case, we present a verification theorem characterizing feedback Nash equilibria, in terms of absolutely continuous solutions of a coupled system of vector-valued ordinary differential equations, realized by time-varying feedback laws. Unlike linear-quadratic differential games, whose Riccati-based equilibria scale quadratically with the state dimension, this formulation scales linearly. However, the resulting piecewise-constant feedback saturates between its constraint bounds rather than varying smoothly, and additional mathematical challenges arise when characterizing the solutions of the differential equations, which are generally discontinuous due to the switching nature of the feedback gains. In this work, we study the case where switching occurs only at isolated time instants. In the infinite-horizon case, under stabilizability assumptions, the equilibrium is characterized by coupled vector-valued algebraic equations. For this game, we propose iterative methods to compute both finite and infinite-horizon equilibria. The approach is illustrated through a large-scale pollution game.

0.26

A Simple Algorithm Breaking the 1/3 Barrier for Approximate Nash Equilibria in Bimatrix Games

cs.GT cs.DM ·2026-10-04 ·Dongchen Li, Hanyu Li
similarity 0.59
Abstract

The PPAD-completeness of computing Nash equilibria in bimatrix games has driven extensive research into polynomial-time algorithms for $ε$-approximate Nash equilibria. Determining the strongest approximation guarantee achievable in polynomial time is a fundamental question in the complexity of approximate Nash equilibria. Despite sustained efforts, breaking the $1/3$ barrier has long been regarded as a difficult open problem. In this paper, we give an affirmative answer by proposing a simple, symmetric deterministic polynomial-time algorithm that has no tunable hyperparameters and achieves an approximation guarantee of approximately $0.30954+δ$. The main idea is to enrich the optimization framework of Tsaknakis and Spirakis with building blocks drawn from our work on strategy mixing and automated approximation analysis, yielding a new algorithmic structure that provides a conceptual explanation for the improved guarantee.

0.49

Game-Theoretic Control with Constrained Potential Surgery

cs.RO ·2026-09-25 ·Zhiyuan Zhang, Panagiotis Tsiotras
similarity 0.59
Abstract

Constrained general-sum dynamic games are a popular formulation for highly interactive multi-agent planning problems. In recent years, Generalized Nash Equilibrium (GNE) solvers have achieved real-time performance for small dynamic games. However, solution speed still remains a bottleneck, and controlling even a small number of agents (e.g., more than four) in a dynamic task remains elusive. In addition, Newton solvers that focus on the first-order conditions are vulnerable to non-Nash saddle points, limiting the usefulness of the provided solution. In this work, we propose a fast and versatile interior point solver for constrained dynamic games, along with a computationally efficient second-order correction that increases the probability of converging to a local GNE solution in constrained dynamic games. The performance of the proposed method is evaluated on numerical benchmarks and a physical experiment involving scaled race cars.

0.24

Payoff-Based Certificates for Convergence to Pure Nash Equilibria under Replicator Dynamics

cs.GT ·2026-11-16 ·Daisuke Hirota
similarity 0.58
Abstract · 18 pages, 1 figure

For finite bimatrix games, we give a payoff-based sufficient condition $E>0$ for an interior initial state to converge to a specified strict pure Nash equilibrium under replicator dynamics. The construction combines lower bounds on the growth rates of log probability ratios between target and alternative actions with a first integral of a two-dimensional comparison system. It allows one player's payoff advantage to compensate for the other's disadvantage, certifying convergence even when a target action initially loses probability. For rational inputs and integration base points with algebraic exponentials, we give a finite exact test. We obtain closed-form box probabilities and, when all nontarget actions are included, closed-form upper bounds on convergence time. In two-action coordination games, choosing the base points at the sign thresholds recovers the full basin of attraction. Experiments on random games show that basin coverage shrinks rapidly with the number of actions. For $n=4,5,6$, median entry times are approximately 70% of median box-entry times without shifts and 40% for a union over 16 shift choices. Extensions cover multiplayer games through cooperative comparison systems and explicit boxes, and discrete-time exponential-weights learning under explicit step-size conditions.

0.39

Critic-Free Policy Iteration for Continuous-Time Zero-Sum Games: A Policy-Space Riccati Approach

eess.SY ·2026-09-10 ·Jiacheng Wu, Yang Zhu, Hongye Su
similarity 0.58
Abstract

This paper develops a critic-free policy iteration (PI) method for continuous-time linear zero-sum games. The central idea is to characterize the saddle-point policies directly in the joint policy space, rather than treating the quadratic value matrix as an iterative variable. A policy game Riccati equation (PGRE) is introduced whose unknowns are policy gains only. Its solutions are shown to be in one-to-one correspondence with the symmetric solutions of the game algebraic Riccati equation. Based on a stabilizing anchor, PI is performed directly in the actor space. The actor-space Jacobian is nonsingular at every stabilizing policy, and the resulting policy sequence coincides with that of simultaneous PI. For unknown dynamics, a data-driven algorithm uses a single batch of data and nullspace projection of endpoint increments to eliminate the value matrix, yielding an actor-only regression. A necessary and sufficient rank condition for unique policy recovery is established and shown to be iteration-invariant, demonstrating that critic identifiability is unnecessary. A power systems frequency-regulation example verifies convergence and policy recovery, while scalability tests demonstrate substantial reductions in computational and memory requirements.

0.31