CS Paper Radar

SD-DPC: Sparse Dictionary Differentiable Predictive Control

Ali Reza Daneshvar Garmroodi, Jan Drgoňa

eess.SY cs.LGmath.OC ·submitted 2026-10-01 20:40 UTC · v2
benchmark

Abstract

We present sparse dictionary differentiable predictive control (SD-DPC), a framework for learning sparse, interpretable feedback policies for nonlinear systems from data. A prediction model is first identified by rollout-based sparse identification of nonlinear dynamics (SINDy), building on gradient-based and multistep formulations. The policy is then parameterized as a sparse combination of dictionary functions and trained by differentiating a constrained finite-horizon predictive-control objective through this model, so that its terms are selected by closed-loop performance rather than by imitating a previously trained controller. The result is an explicit feedback law with only a handful of terms. Across three benchmark control problems, SD-DPC satisfies the constraints in almost all test scenarios, outperforms a policy distilled onto the same terms by up to an order of magnitude, and requires orders of magnitude less memory and online computation than an optimization benchmark, while admitting explicit sensitivity bounds.

Comment
Revised the experimental setup details in Table I and the evaluation reporting, corrected the numerical results in Table II, and clarified the training and validation protocols. The main conclusions are unchanged

Closest papers

Nearest neighbours by meaning across the whole index.

Fast-DeePC: Fast Data-Enabled Predictive Control using Soft-constrained Scheme

eess.SY ·2026-10-09 ·Terry Zhang, Jan Drgona, Malika Sader, Di Liu, Liang Wu
similarity 0.65
Abstract · 8 pages, submission to ACC 2027

Data-enabled predictive control (DeePC) replaces the explicit system model of model predictive control with a data-driven predictor built directly from recorded input-output trajectories, but the original hard-equality formulation keeps its coordinate vector as an online decision variable whose size grows with the offline data length, so the online problem grows more expensive as more data is used to enrich the behavioral representation. This article proposes Fast-DeePC, a framework which relaxes this consistency relation into the control objective with a quadratic ridge on the coordinate vector in place of the customary sparsity-promoting penalty, admitting a closed-form, offline elimination of the coordinate vector and reducing the online problem to a fixed-size box-constrained quadratic program solved by a structure-exploiting interior-point method. On identical soft quadratically regularized problems, the result matches a general-purpose solver's solution and is up to two orders of magnitude faster.

0.24

Scaly: an Optimizing Compiler for Optimal Control

eess.SY math.OC ·2026-10-30 ·Tudor A. Oancea, Colin N. Jones
benchmarkcode/data similarity 0.63
Abstract

We present Scaly, an open-source optimizing compiler for optimal control, written in Python, that generates fast C code. Scaly provides a modeling language embedded in Python for the parametric optimization problems that arise in model predictive control and moving horizon estimation, and computes the sparse derivatives that standard optimization solvers need. Scaly accepts general nonlinear programs but applies optimizations specific to optimal control, which preserve the repeated structure of a problem, such as the stages of a horizon, through differentiation down to the generated loops. The generated C depends only on the C math library and never allocates memory dynamically. On three benchmark problems, Scaly evaluates the Hessian of the Lagrangian up to 26 times faster than CasADi, with smaller binaries and build times that stay nearly constant with the horizon. With the same solver, Scaly shortens the solver time per control step on every benchmark, by a factor of up to 9.

0.43

Policy-Conditioned Koopman Representations for Parameterized Closed-Loop Systems

eess.SY ·2026-11-13 ·Kiran G. Krishnan, Shankar A. Deka
similarity 0.61
Abstract

Predicting the response of a nonlinear system across different feedback controllers requires a model that captures how the closed-loop dynamics change with the controller parameters. In a finite-dimensional Koopman model, these changes may affect both the latent dynamics and the observable coordinates used to represent them. In this paper, we propose a policy-conditioned Koopman representation framework to address this problem. This framework allows a single learned model to predict a family of closed-loop trajectories without retraining for each controller. We test the framework on four nonlinear prediction benchmarks, where the model stays below a 15% error threshold on every system, while each baseline exceeds it on at least one. As an example application, the resulting surrogate supports one-shot feedback-parameter selection: an optimization at the initial state selects a controller that then operates with fixed parameters and ongoing state feedback. On nonlinear control benchmarks including MuJoCo, the selected controllers stabilize every system with 3 to 97 times less online computation than nonlinear model predictive control. These results demonstrate how policy-dependent coordinates can support both prediction across closed-loop systems and controller selection without repeated online trajectory optimization.

0.15

A Scalable Learned Iterative Solver for Nonlinear MPC via Temporal Decomposition

cs.LG math.OCeess.SY ·2026-10-09 ·Lukas Lüken, Sergio Lucia
benchmark similarity 0.61
Abstract · 16 pages, 7 figures, 7 tables

Nonlinear model predictive control (NMPC) can be applied to large nonlinear systems with complex objectives while enforcing constraints, but the cost of solving the underlying optimization problems limits real-time application for systems with fast dynamics or many states. Neural networks can reduce this online cost by approximating the control law, but may violate constraints and typically require many precomputed optimizer solutions for training. The learning-based iterative solver for constrained optimization (LISCO) instead learns to predict primal-dual steps toward satisfaction of the Karush-Kuhn-Tucker (KKT) conditions through self-supervised training without precomputed solutions, but its dense, monolithic architecture grows with the prediction horizon. We remove this horizon dependence by exploiting the temporal structure of the problem in the solver architecture, which makes the network size independent of the horizon while leaving the training loss and the solver iteration unchanged. A closed-loop resampling strategy further aligns the training distribution with closed-loop operation at no additional sampling cost. On an economic NMPC benchmark of a CSTR cascade, the proposed solver scales to larger problems than monolithic LISCO and achieves median speedups of up to a factor of four over IPOPT. In closed loop, it achieves comparable control performance to IPOPT with no observed constraint violations.

0.32

Taylor-Informed Predictive Cost Adaptive Control for Quadrotors with Online Gravity-Trim Adaptation

eess.SY ·2026-09-03 ·Tam W. Nguyen
similarity 0.60
Abstract · 6 pages, 4 figures

This paper develops Taylor-informed predictive cost adaptive control (PCAC) for quadrotors with online gravity-trim adaptation. First-, second-, and third-order expansions of the nonlinear dynamics about nominal hover define sparse sampled-data dictionaries for row-wise recursive least-squares identification with variable-rate forgetting. At each step, the identified predictor is linearized at the current state, and its Jacobian is fixed over the prediction horizon. The identified vertical dynamics also estimate the vehicle mass and gravity-trim input, eliminating fixed nominal gravity compensation. Simulations with an abrupt payload change and aggressive helix tracking show that the higher-order predictors improve prediction and tracking while preserving the standard PCAC formulation.

0.29

Taylor-Informed Indirect Adaptive Predictive Control Using Jacobian-Frozen Affine Predictors

eess.SY ·2026-09-03 ·Tam W. Nguyen
benchmarkcode/data similarity 0.60
Abstract · 6 pages, 3 figures

This paper develops a Taylor-informed indirect adaptive predictive control framework for nonlinear sampled-data systems using Jacobian-frozen affine predictors. A finite Taylor expansion approximates the sampled nonlinear dynamics, and recursive least squares (RLS) identifies its polynomial coefficients online. At each sampling instant, the Jacobian of the identified map is evaluated at the current operating point and frozen over the prediction horizon, yielding an affine predictor for model predictive control. In contrast to generic nonlinear feature dictionaries, the implemented polynomial dictionary is a forward-Euler/Taylor-structure-informed reduced dictionary. Exact joint-odd symmetry eliminates even-total-degree monomials, whereas additional forward-Euler-informed pruning constitutes a deliberate model reduction. Numerical simulations on an unstable nonlinear benchmark compare different Taylor degrees. The results show that higher-order models improve tracking accuracy as the operating point moves farther from the expansion point while maintaining comparable control effort. The complete MATLAB implementation is publicly available to facilitate reproducibility.

0.46

Tensor-Train Weak SINDy: Identifying High-Dimensional Nonlinear Dynamics

cs.LG cs.CEstat.ML ·2026-09-08 ·Will Houser, Vanja Dukic, David M. Bortz
similarity 0.60
Abstract · 34 pages, 8 figures

Weak Sparse Identification of Nonlinear Dynamics (WSINDy) provides a noise-robust approach for learning dynamical systems from data without requiring numerical differentiation. However, for high-dimensional systems, tensor-product libraries of candidate functions grow exponentially with the state dimension, making standard WSINDy expensive in both computation and memory. The Multidimensional Approximation of Nonlinear Dynamics (MANDy) addresses this scaling through a tensor-train (TT) representation of the candidate library, but does not provide a mechanism for sparse model selection. Here, we combine these approaches to develop TT-WSINDy, which performs the weak-form transformation, regression, and sparsification in TT format. We show that the TT formulation recovers the corresponding WSINDy regression problem and derive polynomial time and memory complexity bounds for the tensor-train sparsification procedure. Numerical experiments demonstrate robustness to measurement noise and computational savings for high-dimensional systems.

0.19

On Convergence of Gradient Temporal-Difference Learning with Regularized Corrections and Eligibility Traces

cs.LG math.OC ·2026-11-04 ·Jingyi Jin, Martha White, Hao Wang
similarity 0.59
Abstract · 66 pages, 1 figure. Submitted to the Journal of Machine Learning Research

Temporal-difference (TD) learning underlies many prediction and control algorithms, but can diverge when combined with off-policy learning, bootstrapping, and function approximation. TD with Regularized Corrections (TDRC) is theoretically sound and practically simple, but existing convergence theory covers only the one-step case under i.i.d. sampling, while the Huber Bellman-error formulation has not been extended to TDRC or eligibility traces. In this work, we establish convergence of constrained TDRC($λ$) with diminishing stepsizes and non-i.i.d. off-policy data, for state-dependent and history-dependent $λ$-parameters. We also propose TDRC($λ$)-Huber, which preserves the TDRC($λ$) fixed point while reducing sensitivity to large Bellman errors. For both algorithms, we apply an ODE-based weak-convergence method from stochastic approximation theory. For the nonlinear mean dynamics of TDRC($λ$)-Huber, we give an integral small-gain condition that guarantees uniqueness and global asymptotic stability of the target equilibrium. We then establish convergence of the constrained algorithm, derive computable sufficient conditions for convergence, and identify a regularization-based convergence mechanism shared by linear TDRC($λ$) and TDRC($λ$)-Huber. When the mean TD matrix is positive stable, both constrained algorithms converge under sufficiently strong regularization without requiring positive definiteness.

0.23