CS Paper Radar

Linear Exponential Quadratic Gaussian Covariance Steering

Chiran B. Cherian, Yasemin Isik, Abhishek Halder

cs.AI math.OCcs.LGeess.SYstat.ML ·submitted 2026-09-11 05:54 UTC · v1
theory

Abstract

We formulate and analyze the linear exponential quadratic Gaussian (LEQG) covariance steering problem in continuous time over a given deadline (finite time horizon). The solution for this problem can be seen as a risk-sensitive Schrödinger bridge between Gaussian endpoints in the linear quadratic setting. Unlike the risk-neutral case, the LEQG covariance steering controller--still a linear state feedback--can no longer be written in closed form. We show that the optimal controller is parameterized by a symmetric matrix solving an algebraic equation that encodes the implicit dependence on the risk-sensitivity parameter. We explain how the structure of this optimal controller significantly generalizes the existing results for the risk-neutral case. Building on these results, for the matched noise and input channel case, we prove the existence-uniqueness of solution for the LEQG covariance steering problem in the neighborhood of the known risk-neutral optimal solution. We give an illustrative numerical example.

Closest papers

Nearest neighbours by meaning across the whole index.

Continuous-Time Covariance Steering with Common Free-Final Time: Finite-Horizon Solutions and Infinite-Horizon Limits

eess.SY math.OC ·2026-08-10 ·Akan Selim, Fengjiao Liu, Siddhartha Ganguly, Panagiotis Tsiotras
similarity 0.68
Abstract · 38 pages, submitted to a journal

This article studies the optimal common free-final time problem for steering the state covariance of a continuous-time stochastic linear system between prescribed initial and terminal covariance matrices. We first establish a deterministic reformulation of the SDE-constrained free-final time stochastic optimal control problem (SOCP). For the ensuing SOCP, we provide necessary conditions for optimality and establish sufficient conditions for the optimal common final time to be finite. Subsequently, we characterize the asymptotic behavior of the finite-horizon optimal solutions as the final time tends to infinity, the invariant sets and trajectories associated with this limiting regime, and derive the sensitivity of the Hamiltonian with respect to the common final time. Finally, leveraging these sensitivities, we develop a trust-region line-search algorithm together with an infinite-horizon case detection method, and demonstrate its performance on three different problems: (a) an illustrative covariance-steering example, (b) a demonstration of spacecraft maneuver using covariance control, and (c) Gaussian mixture to Gaussian mixture steering.

0.41

Mean-covariance turnpikes in Wasserstein distributionally robust linear-quadratic control

eess.SY math.OC ·2026-08-27 ·Yanzhi Wu, Zhengping Ji
theory similarity 0.59
Abstract

We study long-horizon Wasserstein-penalized minimax control for discrete-time stochastic linear systems with empirical disturbance data, in which adversarial disturbance distributions induce time-varying mean and covariance dynamics, making standard turnpike arguments not directly applicable. For possibly uncentered data, we characterize the generally nonzero mean reference through a reduced convex-concave Hamiltonian saddle problem. We prove horizon-uniform, two-sided exponential turnpike estimates for the mean state, adjoint, control, worst-case disturbance mean, and closed-loop covariance, showing that they spend the majority of time near static references when the horizon is long. We further construct a hybrid policy combining time-independent affine feedback with finite-horizon steering over a terminal layer, proving that its worst-case cost gap decays exponentially with the terminal-layer length uniformly in the horizon, which helps reducing the computation cost for long-horizon robust controls. Numerical examples illustrate the estimates and their dependence on the Wasserstein penalty.

0.19

Control Realization of Schrödinger Bridges over Discrete-Time Nonlinear Systems via Maximum-Entropy Distribution Steering

eess.SY math.OC ·2026-10-13 ·Kaito Ito, Kenji Kashima
similarity 0.58
Abstract · 16 pages

This paper shows how a Schrodinger bridge (SB) structure emerges from maximum-entropy (MaxEnt) distribution steering of discrete-time nonlinear systems. We also establish that the resulting bridge can be realized by an optimal control policy. We consider general state and input costs, non-Gaussian endpoint distributions, and input constraints. Assuming the existence of a feasible policy with finite objective value, we show that the state-path measure under a MaxEnt optimal control policy is the unique SB. The reference measure of this SB is induced by an optimal policy of the corresponding terminal-unconstrained problem. Moreover, we give an equivalent characterization of the optimal state-path measure using a killed reference and its normalized Feynman--Kac measure, thereby interpreting the state cost as killing. We then characterize the finite-cost feasibility by the existence of an endpoint coupling having finite Kullback--Leibler divergence from the reference endpoint distribution. For compactly supported marginals with bounded target density, we derive reachability-based sufficient conditions guaranteeing this feasibility. We further provide specializations to fully actuated control-affine and reachable linear systems.

0.20

Square Root Gauss-Newton iLQR

cs.RO math.OC ·2026-09-17 ·Maximilian Haas-Heger, Jur van den Berg
similarity 0.57
Abstract · 16 pages, 2 figures, ISRR 2026

The iterative Linear Quadratic Regulator (iLQR) is a widely used algorithm for nonlinear trajectory optimization. At each iteration, it solves a local linear-quadratic approximation of the problem via dynamic programming, propagating a quadratic cost-to-go function. If the Hessian of the cost-to-go approximation is positive-semidefinite, one can derive a square root formulation of iLQR that propagates its Cholesky factor instead. This offers significant numerical advantages - much as square root Kalman filters improve upon their conventional counterparts - particularly when iLQR is used within an augmented Lagrangian framework for handling constraints, where large penalties degrade conditioning. Previous square root formulations of iLQR and related algorithms exist, but they are either numerically suboptimal, algorithmically complex, or both. In this paper, we show that the key to an effective square root formulation lies in the Gauss-Newton (weighted least-squares) structure of the cost function: this yields a positive semidefiniteness property that extends beyond the Hessian to the full augmented cost-to-go matrix, and enables a backward pass of remarkable simplicity in which each step reduces to a single QR-decomposition, from which the feedback gain and propagated Cholesky factor are extracted directly.

0.23

Equivalence Between Continuous-Time Risk-Sensitive Control and Rényi Divergence Minimization

eess.SY math.OC ·2026-09-07 ·Shinji Kataoka, Kaoru Teranishi, Yasumasa Fujisaki
theory similarity 0.57
Abstract · 6 pages, 1 figure

In this study, we show that a continuous-time risk-sensitive control problem is equivalent to a Rényi divergence minimization problem over trajectory path measures. Reformulating stochastic optimal control as probabilistic inference via Kullback-Leibler (KL) divergence minimization avoids the computational intractability of the Hamilton-Jacobi-Bellman equation. However, standard KL control is inherently risk-neutral, and recent minimax extensions remain restricted to risk-averse settings. Our equivalence result resolves this limitation by offering a unified probabilistic framework for arbitrary risk attitudes in continuous-time nonlinear systems. Based on Girsanov theorem, we explicitly map the risk sensitivity to the Rényi divergence order, deriving a noise-dependent control penalty scaled by risk preference. This formulation seamlessly modulates tail-weighting behaviors, interpolating between zero-forcing for risk-averse policies and mass-covering for risk-seeking policies. These findings bridge stochastic control and information-theoretic inference, providing a foundation for sampling-based control algorithms.

0.31

Data-Driven Stochastic LQR Control with Probabilistic Guarantees and Uncertainty Refinement

eess.SY ·2026-11-03 ·Amir Modares, Themistoklis Charalambous, Hamidreza Modares
similarity 0.55
Abstract

This paper presents a probabilistic framework for the direct, data-driven synthesis of the stochastic linear- quadratic output-feedback control for linear systems sub- ject to process and measurement noise. Using delayed input-output measurements, we derive a lifted parameter- ization together with an equivalent lifted linear quadratic cost, enabling controller synthesis without explicitly identi- fying the lifted dynamics. Two complementary closed-loop formulations, based on trajectory and covariance represen- tations, are then developed, whose uncertainties depend only on the realized but unknown lifted noise. We char- acterize the relative performance of the two formulations in finite-data regimes. High-probability uncertainty bounds are developed for realized noises, leading to a convex optimization solution to the problem, whose feasibility cer- tifies probabilistic mean-square stability (p-MSS) and per- formance guarantees. To reduce conservatism, Gaussian zonotopes are used to refine uncertainty sets by elimi- nating noise realizations inconsistent with measured data, and a novel intersection rule enables the consistent fusion of data-driven and physics-informed information. These components are integrated into an adaptive framework that unifies indirect (identification-based) and direct (control- oriented) data-driven linear-quadratic output-feedback con- trol. Unlike existing direct data-driven LQR methods that verify stability a posteriori, our by-construction approach achieves robust stability alongside reduced conservatism and superior performance. Simulation results show that the proposed controller approaches the ideal optimal solution while outperforming existing data-driven methods under noisy measurements.

0.19

Safe Ergodic Control for Multi-Robot Systems via Quadratic Programming

cs.RO ·2026-10-04 ·Yo Toyomoto, Mohamed Elobaid, Bryce L. Ferguson, Alberto Quattrini Li, Shinkyu Park
similarity 0.55
Abstract

Ergodic control drives robots to spend time in each region in proportion to a spatial distribution of interest, making it well suited for dense spatiotemporal environmental monitoring. Existing safe ergodic controllers rely on offline trajectory optimization or hierarchical architectures, which limit real-time applicability and decouple the ergodicity objective from the safety constraint. This paper presents a quadratic programming (QP)-based controller that treats ergodicity and safety jointly. We first introduce a Gaussian-kernel ergodic metric that, unlike the classical indicator-based metric, is time differentiable. This allows the exponential decay of the metric to be imposed as a time-varying control barrier function (CBF) constraint, relaxed by a slack variable, alongside hard CBF constraints for region containment and inter-robot collision avoidance. We establish that the resulting QP remains feasible from any safe initial configuration and that, up to the slack term, the ergodic metric decays exponentially. Simulations show improved performance over baseline methods, and experiments with three aerial vehicles validate the work on real hardware.

0.16

The BAR-SOT Method: Long-term Average Cost Control as Stochastic Optimal Self-Transport

eess.SY math.OCmath.PR ·2026-09-16 ·Sharan Srinivasan, Berke M. Turkay, Harsha Honnappa
similarity 0.54
Abstract

We reformulate average-cost (ergodic) control of a Markov jump process as a finite-horizon stochastic optimal transport (SOT) problem that jointly optimizes over the controlled evolution and the marginal law from which it starts and returns to (i.e., a self-transport). The constraint relating the marginal flow to the controlled generator is the basic adjoint relationship (BAR), so we call the resulting problem BAR-SOT. For any time horizon T>0, its optimal value is a constant scaling of the long-run average-cost rate. We give three equivalent formulations (through controlled processes, a Fokker--Planck constraint, and relaxed marginal measures) and show that the optimal dual is a stationary potential plus a term linear in time, with slope equal to the rate. A relative-entropy penalty on the control yields a cost-tilted Schrodinger bridge problem, computable by a Sinkhorn-type iteration when every transition rate is controlled, whose value converges to the unregularized optimum as the penalty vanishes. We develop the theory for finite Markov decision processes and then for general controlled Markov jump processes. A neural parametrization of the dual, trained as a physics-informed neural network (PINN), that encodes Harrison's equivalent-workload formulation (see Harrison 2000) matches the strong reinforcement-learning baseline of Dai and Gluzman (2022); numerically conditioning the fit of a sub-dominant transverse correction then improves on both that baseline and the best priority heuristic. On the input-queued switch, a graph-attention parametrization of the dual improves on the strongest matching heuristic we are aware of, with a parameter count that does not grow with the switch size.

0.37