CS Paper Radar

Mean-covariance turnpikes in Wasserstein distributionally robust linear-quadratic control

Yanzhi Wu, Zhengping Ji

eess.SY math.OC ·submitted 2026-08-27 11:34 UTC · v1
theory

Abstract

We study long-horizon Wasserstein-penalized minimax control for discrete-time stochastic linear systems with empirical disturbance data, in which adversarial disturbance distributions induce time-varying mean and covariance dynamics, making standard turnpike arguments not directly applicable. For possibly uncentered data, we characterize the generally nonzero mean reference through a reduced convex-concave Hamiltonian saddle problem. We prove horizon-uniform, two-sided exponential turnpike estimates for the mean state, adjoint, control, worst-case disturbance mean, and closed-loop covariance, showing that they spend the majority of time near static references when the horizon is long. We further construct a hybrid policy combining time-independent affine feedback with finite-horizon steering over a terminal layer, proving that its worst-case cost gap decays exponentially with the terminal-layer length uniformly in the horizon, which helps reducing the computation cost for long-horizon robust controls. Numerical examples illustrate the estimates and their dependence on the Wasserstein penalty.

Closest papers

Nearest neighbours by meaning across the whole index.

Distribution Steering via Sliced Optimal Transport Control

cs.LG math.OCeess.SYstat.ML ·2026-08-13 ·Kaito Ito, Anqi Dong
similarity 0.63
Abstract · 39 pages

Distribution steering seeks feedback laws that drive the state law of a dynamical system between prescribed initial and terminal distributions. Optimal transport provides a natural geometric approach, but its implementation generally requires a transport map or coupling in the full state space. Sliced optimal transport avoids this full-dimensional construction through one-dimensional projections. Yet, the resulting projected maps specify only directional displacements and do not by themselves prescribe a realizable feedback law. To this end, we develop a finite-horizon control framework based on sliced optimal transport. At each sampling instant, a projected optimal transport map defines a directional terminal condition, whose minimum-energy realization yields a randomized single-direction controller. Averaging over projection directions gives a deterministic sliced feedback. For the single-integrator dynamics, the averaged feedback makes the sliced Wasserstein distance to the target non-increasing. For Gaussian endpoint laws, it is affine, preserves Gaussianity, and steers the mean and covariance to their prescribed terminal values. We further identify a law-dependent gain that yields linear decay of the sliced Wasserstein distance together with an explicit characterization of the control energy. We also prove that the randomized controller converges to the averaged sliced flow as the sampling period vanishes. Finally, we extend the construction to linear dynamical systems. Reachability-normalized coordinates allow instantaneous realization of the sliced velocity for uniformly fully actuated systems, while local controllability Gramians provide exact finite-step realization for general controllable systems. Numerical examples illustrate the resulting distributional flows.

0.10

Online Constrained Control of Storage Systems via Simplex Disturbance-Action Policies

eess.SY ·2026-09-07 ·Kamiar Asgari, Michael J. Neely
theory similarity 0.61
Abstract

We study online control of a scalar storage system with nonnegative adversarial resource arrivals and state-dependent action constraints. The adversarial, time-varying cost depends on both state and action. At each time, the controller selects a feasible action before the current resource arrival and cost are revealed. To handle the coupling between feasibility and online learning, we introduce Simplex Disturbance-Action Control (SDAC), whose policies have $H$ nonnegative parameters summing to at most one. Every fixed SDAC policy is feasible by construction. Our online SDAC controller updates these parameters using entropic online mirror descent while preserving feasibility along the time-varying trajectory. We prove a regret bound of $O\!\left(\sqrt{T\log(H+1)}\right)$ relative to the best fixed SDAC policy and a minimax lower bound showing that the dependence on $T$ is tight. We also introduce infinite-memory SDAC policies, which include every feasible fixed-fraction policy. SDAC policies approximate this class with an error that decreases geometrically with $H$. For a suitable choice $H=Θ(\log T)$, the resulting regret against infinite-memory SDAC policies is $O\!\left(\sqrt{T\log\log T}\right)$. The framework applies to energy-harvesting batteries and other storage-constrained resource systems.

0.48

Reinforcement learning for constrained stochastic linear--quadratic control in continuous time

cs.LG math.OC ·2026-10-26 ·Weiping Wu, Qitong Pan, Xun Li, Peng Wu
similarity 0.61
Abstract

We study continuous-time stochastic linear--quadratic control with a scalar state and nonnegative control constraints. With quadratic running costs, randomized exploration can change the optimal mean feedback. We introduce an auxiliary problem without entropy in which the conditional policy mean is nonnegative and the covariance is prescribed in proportion to the squared state. Moment reduction and state separation yield two regional Riccati equations and characterize the finite-horizon value function and optimal conditional mean. We give a sufficient control--cost compatibility condition under which this mean coincides with the optimal feedback of the original constrained problem. For time-invariant coefficients, we characterize the undiscounted infinite-horizon optimum and establish mean square asymptotic stability under the stated assumptions. For unknown dynamics, we develop model-free actor--critic schemes for finite and infinite horizons. Numerical experiments compare the learned policies with their analytical targets and examine the effect of exploration on the optimal mean.

0.25

Optimal input design via Frank-Wolfe

eess.SY math.OC ·2026-09-08 ·Fethi Bencherki, Bruce Lee, Nikolai Matni, Anders Rantzer
published similarity 0.60
Abstract · 7 pages, 4 figures

We study optimal input design over a finite horizon for linear dynamical systems. The goal is to minimize a weighted inverse-covariance (information) criterion subject to an energy budget. The set of covariances achievable by causal policies is convex but lacks a tractable explicit description, ruling out projection-based methods. We show that Frank--Wolfe applies naturally: each linear minimization subproblem is a budget-constrained finite-horizon linear quadratic (LQ) problem, solvable by a Riccati recursion and one-dimensional bisection over a Lagrange multiplier. Using smoothness of the objective over the feasible set, we establish an $\mathcal{O}(1/M)$ convergence rate for the objective value, while strong convexity yields an $\mathcal{O}(1/\sqrt{M})$ rate for the iterates. We further extend the framework to input design for system identification with unknown dynamics and adaptive online LQR, and illustrate the approach numerically.

0.38

Finite-Sample Approximation of Hessian-Guided Perturbed Wasserstein Gradient Flows

cs.LG stat.ML ·2026-10-07 ·Ryotaro Kawata, Atsushi Nitanda, Taiji Suzuki
theory similarity 0.60
Abstract

Wasserstein gradient flow extends gradient descent to probability measures. Its Hessian-guided perturbed variant (PWGF) adds Gaussian perturbations to escape saddle points in nonconvex problems. We investigate when its approximation by finitely many interacting particles remains accurate over growing time horizons. Our analysis retains the curvature accumulated along the population-driven reference path: negative curvature can amplify approximation errors, while subsequent positive curvature can damp their influence. This captures favorable scenarios in which temporary instability is compatible with accurate tracking over growing horizons. Under regularity assumptions and a prescribed common perturbation schedule, we prove particle and objective-value tracking bounds on a high-probability event for reference paths satisfying explicit conditions on accumulated curvature. To handle state-dependent Gaussian jumps, we construct a population-first coupling that preserves the reference particles' conditional independence and reduces jump errors to covariance comparison. We verify the conditions in a variance-plus-cosine model, where curvature recovery yields a growing-horizon tracking guarantee. We also establish local attraction, transverse descent, and positive second variation in two regions of a regularized matrix-factorization model, motivating a positive-negative-positive curvature pattern.

0.16

Linear Exponential Quadratic Gaussian Covariance Steering

cs.AI math.OCcs.LGeess.SY+1 ·2026-09-11 ·Chiran B. Cherian, Yasemin Isik, Abhishek Halder
theory similarity 0.59
Abstract

We formulate and analyze the linear exponential quadratic Gaussian (LEQG) covariance steering problem in continuous time over a given deadline (finite time horizon). The solution for this problem can be seen as a risk-sensitive Schrödinger bridge between Gaussian endpoints in the linear quadratic setting. Unlike the risk-neutral case, the LEQG covariance steering controller--still a linear state feedback--can no longer be written in closed form. We show that the optimal controller is parameterized by a symmetric matrix solving an algebraic equation that encodes the implicit dependence on the risk-sensitivity parameter. We explain how the structure of this optimal controller significantly generalizes the existing results for the risk-neutral case. Building on these results, for the matched noise and input channel case, we prove the existence-uniqueness of solution for the LEQG covariance steering problem in the neighborhood of the known risk-neutral optimal solution. We give an illustrative numerical example.

0.22

Continuous-Time Covariance Steering with Common Free-Final Time: Finite-Horizon Solutions and Infinite-Horizon Limits

eess.SY math.OC ·2026-08-10 ·Akan Selim, Fengjiao Liu, Siddhartha Ganguly, Panagiotis Tsiotras
similarity 0.59
Abstract · 38 pages, submitted to a journal

This article studies the optimal common free-final time problem for steering the state covariance of a continuous-time stochastic linear system between prescribed initial and terminal covariance matrices. We first establish a deterministic reformulation of the SDE-constrained free-final time stochastic optimal control problem (SOCP). For the ensuing SOCP, we provide necessary conditions for optimality and establish sufficient conditions for the optimal common final time to be finite. Subsequently, we characterize the asymptotic behavior of the finite-horizon optimal solutions as the final time tends to infinity, the invariant sets and trajectories associated with this limiting regime, and derive the sensitivity of the Hamiltonian with respect to the common final time. Finally, leveraging these sensitivities, we develop a trust-region line-search algorithm together with an infinite-horizon case detection method, and demonstrate its performance on three different problems: (a) an illustrative covariance-steering example, (b) a demonstration of spacecraft maneuver using covariance control, and (c) Gaussian mixture to Gaussian mixture steering.

0.41

Receding Horizon Control and Dissipativity - Optimal Control, Games and Uncertainty

eess.SY math.OC ·2026-09-29 ·Sophie Hall, Jonas Schießl, Sergio Grammatico, Timm Faulwasser
publishedsurvey similarity 0.59
Abstract · To appear at IEEE CDC 2026

We provide a tutorial overview of receding horizon control across deterministic, stochastic, multi-agent, and game-theoretic settings. We contrast the minimizer of an optimal control problem with the equilibrium of a game in terms of cost and constraint handling to motivate the difference of MPC schemes involving multiple agents/players. Interestingly, dissipativity theory and the turnpike property have turned out to be a unifying thread and system-theoretic backbone across all these schemes. This paper is the first to give an overview of results, summarizing fundamental insights, drawing parallels, and highlighting technical differences in dissipativity and turnpike analysis across economic, game theoretic, and stochastic settings. We also explore recent trends in numerical methods for games. We conclude by pointing to a list of open challenges.

0.32