CS Paper Radar

Continuous-Time Covariance Steering with Common Free-Final Time: Finite-Horizon Solutions and Infinite-Horizon Limits

Akan Selim, Fengjiao Liu, Siddhartha Ganguly, Panagiotis Tsiotras

eess.SY math.OC ·submitted 2026-08-10 22:08 UTC · v1

Abstract

This article studies the optimal common free-final time problem for steering the state covariance of a continuous-time stochastic linear system between prescribed initial and terminal covariance matrices. We first establish a deterministic reformulation of the SDE-constrained free-final time stochastic optimal control problem (SOCP). For the ensuing SOCP, we provide necessary conditions for optimality and establish sufficient conditions for the optimal common final time to be finite. Subsequently, we characterize the asymptotic behavior of the finite-horizon optimal solutions as the final time tends to infinity, the invariant sets and trajectories associated with this limiting regime, and derive the sensitivity of the Hamiltonian with respect to the common final time. Finally, leveraging these sensitivities, we develop a trust-region line-search algorithm together with an infinite-horizon case detection method, and demonstrate its performance on three different problems: (a) an illustrative covariance-steering example, (b) a demonstration of spacecraft maneuver using covariance control, and (c) Gaussian mixture to Gaussian mixture steering.

Comment
38 pages, submitted to a journal

Closest papers

Nearest neighbours by meaning across the whole index.

Linear Exponential Quadratic Gaussian Covariance Steering

cs.AI math.OCcs.LGeess.SY+1 ·2026-09-11 ·Chiran B. Cherian, Yasemin Isik, Abhishek Halder
theory similarity 0.68
Abstract

We formulate and analyze the linear exponential quadratic Gaussian (LEQG) covariance steering problem in continuous time over a given deadline (finite time horizon). The solution for this problem can be seen as a risk-sensitive Schrödinger bridge between Gaussian endpoints in the linear quadratic setting. Unlike the risk-neutral case, the LEQG covariance steering controller--still a linear state feedback--can no longer be written in closed form. We show that the optimal controller is parameterized by a symmetric matrix solving an algebraic equation that encodes the implicit dependence on the risk-sensitivity parameter. We explain how the structure of this optimal controller significantly generalizes the existing results for the risk-neutral case. Building on these results, for the matched noise and input channel case, we prove the existence-uniqueness of solution for the LEQG covariance steering problem in the neighborhood of the known risk-neutral optimal solution. We give an illustrative numerical example.

0.22

Certifiable Explicit Model Predictive Control for Spacecraft Rendezvous under Bounded Disturbances

eess.SY ·2026-08-23 ·Diogo Silva, Daniel Silvestre
similarity 0.61
Abstract · 12 pages, 5 figures, 2 tables. Submitted to IEEE Transactions on Control Systems Technology

Two properties of optimization-based controllers such as model predictive control (MPC) limit their use in space flight. The online computing time varies and can exceed the sampling period, and the closed-loop behavior carries no formal guarantee. Explicit MPC, where a parametric solution of the optimization problem is computed, replaces the on-board optimization with a lookup table of piecewise-affine functions with a fixed execution time. However, it has been regarded as only applicable to small horizons, since the number of regions bounds the memory the table occupies and admits only an exponential bound in the horizon. This paper builds on recent developments in parametric solutions of quadratic programs and nonconvex reachability analysis to provide an entire pipeline for spacecraft rendezvous controllers under the Clohessy-Wiltshire dynamics. For this application, efficient data structures can be constructed to encode the control law, both from a computing time and a memory standpoint. In addition, the controller can be verified offline with a guaranteed closed-loop stability certificate by resorting to reachability analysis with hybrid zonotopes. At a 51-step horizon the rendezvous law occupies 10.5 MB and is evaluated in under 300 ns. The occupied memory would fit for instance the CubeSat flight computer ARM9-class AT91RM9200 meaning that the horizon limitation does not hold when the partition is built with the parametric solvers and data structures shown in this paper.

0.16

Reinforcement learning for constrained stochastic linear--quadratic control in continuous time

cs.LG math.OC ·2026-10-26 ·Weiping Wu, Qitong Pan, Xun Li, Peng Wu
similarity 0.61
Abstract

We study continuous-time stochastic linear--quadratic control with a scalar state and nonnegative control constraints. With quadratic running costs, randomized exploration can change the optimal mean feedback. We introduce an auxiliary problem without entropy in which the conditional policy mean is nonnegative and the covariance is prescribed in proportion to the squared state. Moment reduction and state separation yield two regional Riccati equations and characterize the finite-horizon value function and optimal conditional mean. We give a sufficient control--cost compatibility condition under which this mean coincides with the optimal feedback of the original constrained problem. For time-invariant coefficients, we characterize the undiscounted infinite-horizon optimum and establish mean square asymptotic stability under the stated assumptions. For unknown dynamics, we develop model-free actor--critic schemes for finite and infinite horizons. Numerical experiments compare the learned policies with their analytical targets and examine the effect of exploration on the optimal mean.

0.25

Mean-covariance turnpikes in Wasserstein distributionally robust linear-quadratic control

eess.SY math.OC ·2026-08-27 ·Yanzhi Wu, Zhengping Ji
theory similarity 0.59
Abstract

We study long-horizon Wasserstein-penalized minimax control for discrete-time stochastic linear systems with empirical disturbance data, in which adversarial disturbance distributions induce time-varying mean and covariance dynamics, making standard turnpike arguments not directly applicable. For possibly uncentered data, we characterize the generally nonzero mean reference through a reduced convex-concave Hamiltonian saddle problem. We prove horizon-uniform, two-sided exponential turnpike estimates for the mean state, adjoint, control, worst-case disturbance mean, and closed-loop covariance, showing that they spend the majority of time near static references when the horizon is long. We further construct a hybrid policy combining time-independent affine feedback with finite-horizon steering over a terminal layer, proving that its worst-case cost gap decays exponentially with the terminal-layer length uniformly in the horizon, which helps reducing the computation cost for long-horizon robust controls. Numerical examples illustrate the estimates and their dependence on the Wasserstein penalty.

0.19

Certificate-Carrying Distributed Model Predictive Control on Product Manifolds with $\mathrm{SO}(3)$

eess.SY math.OC ·2026-09-25 ·Shengjun Zhang, Tingyi Liu, Lei Xu, Tao Yang
theory similarity 0.59
Abstract · 12 pages, 3 figures. Submitted to Automatica

This paper studies constraint certification in synchronous distributed model predictive control (DMPC) when neighboring predictions change between sampling instants. Before the parallel local solves, each agent communicates a shifted prediction and an announced update budget. A hard trajectory trust region makes that budget enforceable, while an edge-wise feasibility cap computed from the shifted packets keeps the fallback feasible without using any current optimizer output. Distance and relative-attitude constraints are tightened with explicit Lipschitz constants and two budget layers: one accounts for the simultaneous neighbor update and the other retains a checkable shift reserve. We prove hard pairwise constraint satisfaction and recursive feasibility under stated nominal-execution and terminal assumptions, give the additional residual caused by execution error, and derive a local practical value-decrease bound. A spacecraft formation example uses hard terminal and pairwise constraints, a geodesic relative- attitude constraint on $\SO$, and reproducible terminal-set checks. Comparisons with fixed, trajectory-only, and windowed online margins show that the proposed budget reduces conservatism while preserving a positive shifted-feasibility margin.

0.22

Towards Co-Designed Event-Triggered Extremum Seeking

eess.SY math.OC ·2026-08-10 ·Roberto Luo, Pedro Henrique Silva Coutinho, Victor Hugo Pereira Rodrigues, Tiago Roux Oliveira, Miroslav Krstic
similarity 0.58
Abstract · 7 pages, 3 figures

This paper studies event-triggered gradient-based multivariable extremum seeking for nonlinear maps with polytopic Hessian uncertainty. Unlike existing event-triggered extremum-seeking methods, which first fix the controller (typically diagonal) and then design the triggering mechanism, the proposed approach jointly synthesizes the controller and the triggering mechanism through a co-design framework that admits both diagonal and full controller gain matrices. The co-design problem is formulated as a convex optimization problem with linear matrix inequality constraints. Its solution guarantees exponential convergence of the average closed-loop system with a prescribed decay rate while maximizing the admissible triggering threshold to reduce communication. Lyapunov and averaging analyses establish exponential stability of the event-triggered system, and Zeno-freeness is proved to guarantee implementability. Numerical results illustrate that diagonal gains cannot achieve the same triggering thresholds and decay rates as the full controller gain matrices, highlighting the benefits of exploiting Hessian coupling information.

0.07

Optimal input design via Frank-Wolfe

eess.SY math.OC ·2026-09-08 ·Fethi Bencherki, Bruce Lee, Nikolai Matni, Anders Rantzer
published similarity 0.58
Abstract · 7 pages, 4 figures

We study optimal input design over a finite horizon for linear dynamical systems. The goal is to minimize a weighted inverse-covariance (information) criterion subject to an energy budget. The set of covariances achievable by causal policies is convex but lacks a tractable explicit description, ruling out projection-based methods. We show that Frank--Wolfe applies naturally: each linear minimization subproblem is a budget-constrained finite-horizon linear quadratic (LQ) problem, solvable by a Riccati recursion and one-dimensional bisection over a Lagrange multiplier. Using smoothness of the objective over the feasible set, we establish an $\mathcal{O}(1/M)$ convergence rate for the objective value, while strong convexity yields an $\mathcal{O}(1/\sqrt{M})$ rate for the iterates. We further extend the framework to input design for system identification with unknown dynamics and adaptive online LQR, and illustrate the approach numerically.

0.38

Diffusion-Based Multiple-Shooting Indirect Optimal Control for Fuel-Optimal Spacecraft Trajectory Generation

eess.SY cs.LG ·2026-09-12 ·Saeid Tafazzol, Ehsan Taheri, Ryne Beeson
benchmarkcode/data similarity 0.57
Abstract · Submitted to IEEE Control Systems Letters (L-CSS) for possible publication

Diffusion-based generative models (DMs) have found applications in control problems, and in particular robotics, where the DMs enable exploration of possible control solutions. A critical shortcoming of these applications is that they have lacked optimality guarantees. This is a problem for their potential use in fuel-optimal spacecraft trajectories that are characterized with long time-horizons and bang-bang profiles. Alternatively, indirect optimal control methods ensure explicit satisfaction of necessary conditions, but are highly sensitive to the initial costate estimation needed to solve the resulting Hamiltonian boundary-value problems (HBVPs). To alleviate this sensitivity and enlarge the convergence domain of HBVPs, advanced indirect methods have been developed that use smoothing approaches and continuation. We propose a diffusion-based multiple shooting indirect control method that combines the exploration capability of DMs with indirect method to generate fuel-optimal spacecraft trajectories. We benchmark our method against an advanced indirect method on a fuel-optimal Earth-Mars low-thrust transfer problem, showing higher convergence robustness than the advanced indirect method that is based on random costate initialization. Code and visualizations are available at https://saeidtafazzol.github.io/Diffusion_Indirect_Control/.

0.21