CS Paper Radar

Trajectory Manifolds for Nonlinear Data-Enabled Predictive Control

Arda Bayer

eess.SY math.OC ·submitted 2026-09-16 17:21 UTC · v2
theory

Abstract

This note establishes a geometric foundation for trajectory-manifold representations of deterministic nonlinear systems in a behavioral setting motivated by data-enabled predictive control. For a discrete-time system $x_{k+1}=f(x_k,u_k)$ with measured state and a $C^r$ transition map, $r\geq 1$, we consider the terminal-state-augmented finite-horizon behavior consisting of all admissible state-input trajectories over a prediction horizon $N$. We prove that this behavior is a $C^r$ embedded submanifold of the ambient trajectory space with intrinsic dimension $n+Nm$, where $n$ and $m$ are the state and input dimensions. Moreover, the rollout map from the admissible initial-state and input coordinates $(x_0,\mathbf u)$ is a $C^r$ diffeomorphism onto the behavior manifold, providing explicit global smooth coordinates. This yields a canonical exact encoder--decoder representation and implies that any exact differentiable latent representation of the full behavior must have latent dimension at least $n+Nm$. The geometric result does not require controllability, stabilizability, or invertibility of the dynamics. Corresponding results are given for zero-order-hold sampled continuous-time systems and fixed-step numerical transition maps. These results provide the deterministic geometric foundation for subsequent data-driven approximation and predictive-control development.

Comment
15 pages

Closest papers

Nearest neighbours by meaning across the whole index.

Learning Control-Relevant Koopman Representations from Input-Output Trajectories

eess.SY ·2026-11-19 ·Maria Bartzioka, Mohammad Khosravi
benchmark similarity 0.65
Abstract

Predictive accuracy alone does not ensure that data-driven Koopman representations are suitable for output-feedback control. This paper develops a continuous-time framework for learning control-relevant Koopman representations using only measured input-output trajectories. A causal encoder constructs the lifted state from a finite input-output window, and an additive lifted model is identified by integral regression. We distinguish observability, input-map compatibility, controllability, and data informativity. We characterize compatibility with a constant lifted input matrix, quantify input-map mismatch, and, under exact lifting assumptions, relate iterated Lie brackets to the controllable subspace of the lifted realization. A covariance-normalized finite-horizon observability criterion is optimized subject to separate bounds on output-prediction and temporal-consistency errors. Under the stated exactness and observability assumptions, the encoded lifted state depends only on the current nonlinear state. For approximate representations, we bound the difference between encodings of distinct past trajectories ending at the same state. An exactly liftable controlled system provides analytical ground truth, while a controlled Duffing oscillator illustrates the approximate setting, for which an informative exact additive lifting on an open set is shown to be impossible. On the exact benchmark, encoder initialization determines whether the learned representation recovers the analytical lift. In the reported Duffing experiments, observability promotion improves nominal Gramian measures without improving observer-based estimation or tracking, while updating the lifted-state estimate through the encoder at every sampling instant has a larger effect on tracking accuracy.

0.24

Preserving Unstable Modes Through Inverse Dynamics in JEPA World Models

cs.LG cs.ROeess.SYmath.OC ·2026-10-06 ·Leonardo F. Toso, Yann LeCun, James Anderson, Oumayma Bounou
theory similarity 0.63
Abstract

Robotic systems often exhibit unstable modes, along which small perturbations and disturbances can cause unbounded growth unless corrected through feedback. Controlling such systems from high-dimensional visual observations requires representations that preserve these modes. Joint-embedding predictive architectures (JEPAs) provide a natural framework for learning such representations and their dynamics from visual data. However, we demonstrate that next step prediction combined with anti-collapse regularization does not guarantee that controllable unstable modes are preserved: the training loss can be minimized while these modes are collapsed, making stabilization from the learned representation impossible. To address this, we augment world-model training with an action reconstruction objective (i.e., an inverse dynamics loss) that encourages control-aware representations, namely, visual representations that preserve crucial features for control. We prove that exact action reconstruction makes the encoder injective on the finite-horizon reachable subspace. Thus, the encoder cannot discard any state direction reachable by an action sequence within $H$ steps. Moreover, we show that, as $H$ grows, the dominant eigenspace of the finite-horizon controllability Gramian converges to the controllable unstable subspace. We establish our theoretical results for linear systems and demonstrate empirically that our findings extend to nonlinear visual control tasks (CartPole, Walker2D, and PointMaze), highlighting the benefits of control-aware representation learning.

0.44

Learning Stabilizing Latent Feedback Controllers via Multi-Step Backward Losses

cs.LG math.OCeess.SY ·2026-10-29 ·Paul Lutkus, Lars Lindemann, Stephen Tu
similarity 0.61
Abstract

Can learned latent dynamics models support the design of feedback controllers that provably stabilize the original system? For linear time-invariant systems, we show that learning linear autoencoders and latent dynamics with multi-step prediction-reconstruction losses $\unicode{x2014}$ which we term "backward losses" as they encourage latent trajectories to reconstruct full state trajectories $\unicode{x2014}$ provably recovers the structure needed for stabilization. Specifically, a sufficiently long reconstruction horizon ensures that a minimum ${H}_\infty$-norm controller designed using the learned latent model stabilizes the original system through output-feedback via the corresponding encoder, provided the latent dimension is large enough to capture all non-stable modes of the underlying system. We also show why both reconstruction and a multi-step horizon are essential: forward prediction losses that require only low prediction error along latent trajectories admit global loss minimizers that discard unstable modes regardless of horizon length, while single-step reconstruction losses can yield latent models whose stabilizing controllers fail to stabilize the original system. Finally, experiments on a non-linear flexible-arm system illustrate the practical implications of our results for learning non-linear autoencoders and latent dynamics.

0.08

Policy-Conditioned Koopman Representations for Parameterized Closed-Loop Systems

eess.SY ·2026-11-13 ·Kiran G. Krishnan, Shankar A. Deka
similarity 0.60
Abstract

Predicting the response of a nonlinear system across different feedback controllers requires a model that captures how the closed-loop dynamics change with the controller parameters. In a finite-dimensional Koopman model, these changes may affect both the latent dynamics and the observable coordinates used to represent them. We propose a policy-conditioned Koopman representation framework to address this problem. It allows a single learned model to predict a family of closed-loop trajectories without retraining for each controller. We test the framework on six nonlinear prediction benchmarks, where the mean error of the model stays below a 15% threshold on every system, while that of each baseline exceeds it on at least one. As an example application, the resulting surrogate supports one-shot feedback-parameter selection, in which an optimization at the initial state selects a controller that then operates with fixed parameters and ongoing state feedback. On nonlinear control benchmarks including MuJoCo, the selected controllers stabilize every system from the tested initial state with 1.4 to 21 times less online computation than nonlinear model predictive control, counting the selection itself. The results show that policy-dependent coordinates can support both prediction across closed-loop systems and controller selection without repeated online trajectory optimization.

0.11

Bilinear World Models: Learning Representations with Structured Dynamics for Efficient Control

cs.RO eess.SY ·2026-09-28 ·Antonio Pariente, Ignacio Boero, Nikolai Matni, Alejandro Ribeiro
similarity 0.59
Abstract

World models jointly learn latent representations and dynamics that predict how high-dimensional observations evolve under actions. In this work, we propose a JEPA-style world model in which, rather than learning arbitrary latent dynamics, we restrict them to follow a bilinear parameterization. This structure enables efficient planning and control while shifting the modeling burden onto the encoder, encouraging richer representations that expose the controllable geometry of the system. In particular, this structured parameterization allows us to structurally enforce action recoverability, thereby preventing representation collapse by construction. Although prescribing a bilinear parametrization may appear restrictive, we show that a broad class of nonlinear dynamical systems admits a transformation under which the dynamics become bilinear. Empirically, we show across standard 2D and 3D control tasks that representations with bilinear-parameterized dynamics can be learned directly from high-dimensional observations, reducing planning time by nearly three orders of magnitude while retaining or even improving control accuracy. We also propose more demanding regimes of longer-horizon planning and real-time control, and demonstrate that our method succeeds in both, moving JEPA-style world models beyond short-horizon offline planning.

0.47

Markovian Dynamics Enforcer: Feasibility Preserving Correction on Learned Dynamics Manifolds

cs.LG cs.ROeess.SY ·2026-09-30 ·Kevin Yu, Tao Guo, Constantinos Antoniou, Panagiotis Angeloudis
top venuecode/data similarity 0.58
Abstract · 26 pages, 2 figures, 11 tables. Accepted at NeurIPS 2026. Code available at https://github.com/tsl-imperial/MaDE

Neural trajectory predictors can reach low prediction error while violating dynamics, actuator limits, or state constraints, especially when controls are unobserved and dynamics are partially specified. We introduce the Markovian Dynamics Enforcer (MaDE), a time-invariant post-hoc operator mapping state-transition proposals onto a learned feasible dynamics manifold, trained on feasible states without ground-truth controls. For each transition it infers a control and recomputes the state through a completion model of known physics plus a learned residual. It then corrects that control by gradient-based inequality reduction, so inequality satisfaction is best-effort within an iteration budget. Since every correction iterate re-enters the completion model, the returned state is dynamically consistent by construction relative to that model and the supplied previous-state anchor. MaDE drives dynamics residuals to essentially zero on fully specified simulated systems, and on an underspecified system leaves a smaller true-dynamics residual than the baselines. Designed to attach to arbitrary predictors, the frozen operator is evaluated downstream of recurrent, structured state-space, and transformer predictors. On recorded vehicle trajectories the one-step residual against a kinematic bicycle model is 0.0071 to 0.0072 for MaDE and 0.1703 to 0.1714 for raw predictors. MaDE raises average displacement error by a factor of 1.57 to 1.83.

0.51

PDE-JEPA: Predictive Representation Learning of Latent Dynamics Modeling for Parametric PDEs

cs.AI ·2026-09-28 ·Zhentao Tan, Jianrong Zhang, Ruijie Quan, Yi Yang
code/data similarity 0.58
Abstract

Physical trajectories contain more than snapshots of a system: they also reveal how its states evolve under governing conditions. However, representation learning for parametric partial differential equations (PDEs) has largely relied on reconstruction-based objectives that emphasize recovering observed physical fields. In this paper, we investigate predictive representation pretraining as an alternative to reconstruction-based learning. We find that predictive representations preserve rich physical information, yet this advantage alone does not ensure accurate field evolution. Based on these observations, we introduce PDE-JEPA for parametric PDE dynamics. Specifically, we first train an encoder using a masked-latent prediction to capture the underlying regularities of PDE dynamics. To explicitly adapt the pretrained representation toward a more dynamics-aligned state space, we then introduce a geometry projector that aligns latent trajectory geometry with the evolution geometry of physical fields. Finally, building on this geometry-aligned latent space, we further develop a physics-structured latent predictor that decomposes the dynamics into parameter-independent evolution and parameter-dependent response components. Extensive experiments on nine widely used PDE benchmarks demonstrate that our framework outperforms existing state-of-the-art methods by an average of 33.4\% in-distribution, while achieving an average improvement of 51.4\% when extrapolating to unseen governing parameters. The project page is available \href{https://tanpig-x.github.io/PDE-JEPA/}{here}.

0.33

Learning Intrinsic Dynamics in Latent World Models

cs.AI ·2026-10-15 ·Jiamin Shi, Yuanhong Zhang, Zhiyang Liu, Jiawei Sun, Jingwen Fu
theory similarity 0.58
Abstract · 12 pages, 5 figures

Learning intrinsic dynamics---the relationship between actions and their consequences---is essential for world models. However, visual variations unrelated to the underlying control process can obscure this relationship in learned representations. We investigate the connection between action predictability, defined as the ability to reconstruct an action from consecutive latent states, and the preservation of intrinsic dynamics. Our central hypothesis is that encouraging action predictability discourages representations from discarding the distinctions between different actions and their consequences. We provide two complementary forms of evidence for this connection. Theoretically, we derive a positive lower bound on squared inverse prediction error when the encoder merges distinguishable outcomes of different actions from the same state and appearance, and show that forward prediction can still be exact on those transitions. Empirically, controlled appearance-diversity comparisons, supervision interventions, and latent probes support the role of action prediction in preserving control-relevant transition information. We instantiate action predictability with Concat IDM, which predicts actions from concatenated latent states and updates the shared encoder using action labels already available in offline trajectories, without changing the test-time planner. Across three independent training runs on Push-T with 24 appearances, Concat IDM increases planning success from 9.1% to 77.2%; its paired improvement is 52.9 percentage points larger than that observed with a single appearance. Together, these findings support action predictability as an inductive bias toward intrinsic dynamics and demonstrate the practical benefits of Concat IDM for latent planning under visual diversity.

0.14