CS Paper Radar

Structure-Preserving Learning for Nonlinear Nonholonomic Dynamics

Thomas Beckers, Anthony Bloch, Leonardo Colombo

eess.SY ·submitted 2026-11-12 13:39 UTC · v1

Abstract

Learning the dynamics of mechanical systems subject to nonlinear nonholonomic constraints is challenging, as data-driven models may violate the underlying physical constraints, leading to inconsistent predictions. To address this problem, we develop a constraint-preserving learning framework based on the Lagrange-d'Alembert-Chetaev equations and tangency to the constraint submanifold, which together define an affine space of admissible accelerations. Using the kinetic-energy metric and the Moore-Penrose pseudoinverse, we construct a metric projector and the corresponding Chetaev correction. Embedding this geometric structure directly into a Gaussian process prior ensures that both prior and posterior dynamics satisfy the acceleration constraints exactly. We characterize the resulting reproducing kernel Hilbert space (RKHS), derive an adapted-coordinate representation, and establish nonexpansiveness and consistency transfer. Numerical experiments on a three-dimensional directional flocking system with up to 50 agents demonstrate exact constraint preservation and robustness to constraint-incompatible observations.

Closest papers

Nearest neighbours by meaning across the whole index.

Learning in Inverse Games: Tractable Training with Probabilistic Guarantees

eess.SY math.OC ·2026-10-02 ·Arghya Mallick, Reza Rahimi Baghbadorani, Peyman Mohajerin Esfahani, Sergio Grammatico
similarity 0.64
Abstract

Inverse game theory seeks to learn agents' unknown objectives from observed equilibrium behavior. Existing residual-based approaches can lead to non-convex problems and need not ensure strong monotonicity of the learned game, limiting reliable equilibrium prediction. We develop a tractable convex framework for learning static and dynamic non-cooperative games using first-order and Nikaido-Isoda (NI) loss. Specialized operator parameterizations, including a Helmholtz--Hodge decomposition in a reproducing kernel Hilbert space (RKHS), enforce strong monotonicity for quadratic, nonparametric, non-quadratic, and linear-quadratic dynamic games. We establish finite-sample out-of-sample prediction guarantees, using Rademacher complexity to match existing bounds for the non-quadratic setting. For noisy sequential data, we develop a robust receding-horizon learning scheme whose adaptive regularization admits a maximum a posteriori (MAP) interpretation and is computed using randomized trace estimation. Numerical experiments, including a stylized autonomous-vehicle collision-avoidance application, demonstrate predictive accuracy and robustness to measurement noise.

0.44

Adaptive Control as an Information Gradient Flow: Excitation, Constraints, Energy, and Stochastic Learning

eess.SY ·2026-10-04 ·Omkar Sudhir Patil
similarity 0.63
Abstract

Adaptive control is usually developed through Lyapunov stability, excitation, and parameter convergence, whereas neighboring fields describe learning using convexity, information geometry, variational principles, and stochastic thermodynamics. This paper develops a constrained common language for these viewpoints. For linearly parameterized models, the excitation Gramian is simultaneously the Hessian of accumulated prediction loss and, under Gaussian observations, Fisher information up to scaling. Persistent, finite, and partial excitation become uniform, finite-horizon, and restricted temporal curvature; memory methods retain previously acquired curvature. On a closed convex parameter set, deterministic adaptation is a projected gradient/Onsager flow, with tangent and normal cones recovering projection, while composite learning supplies data-dependent symmetric dissipation. Reflected Langevin dynamics, no-flux Fokker--Planck evolution, and constrained free-energy flow provide the stochastic counterpart. The framework distinguishes information supplied by data from confinement supplied by regularization or hard constraints and connects familiar adaptive-control structures to modern variational and information-theoretic language.

0.31

Manifold Attracting Flow Matching: Physics-Constrained Sampling via Continuous Geometric Dynamics

cs.LG ·2026-11-12 ·Guanyu Chen, Jinchen Wang, Shengze Xu, Xingyu Ren, Tieyong Zeng +2 more
similarity 0.63
Abstract

Generating scientific data under previously unseen equality constraints requires satisfying the prescribed constraints without destroying the physical structure learned from data. Existing inference-time approaches often enforce physical constraints by repeatedly correcting predicted endpoints, but such discrete corrections can distort learned generative structure and introduce unstable feedback. In this work, we propose Manifold Attracting Flow Matching (MAFM), which continuously evolves a persistent anchor through an ODE whose dynamics drive it analytically toward the constraint manifold. Specifically, its geometric correction preserves model-guided tangent motion while prescribing the normal motion to contract constraint violations toward the manifold. This construction separates model tracking from constraint attraction and provides theoretical guarantees for residual contraction and local feedback stabilization. Experiments across geometric and partial differential equation benchmarks demonstrate improved generation quality over variant constraint-guided baselines while maintaining low constraint residuals. MAFM provides a flexible framework for coordinating learned physical structure and explicit constraints through controllable sampling dynamics, without retraining the underlying generative model.

0.05

Fast Non-Parametric Heteroscedastic Imitation Learning With Geometric Priors

cs.RO ·2026-10-06 ·Maximilian Mühlbauer, Arne Sachtler, Markus Knauer, Cem Küçükgenç, Yanlong Huang +2 more
similarity 0.63
Abstract

When learning probabilistic policies from human demonstrations, data-efficient learning and fast adaptations to new scenarios are key requirements. One popular way to achieve intuitive and reliable adaptations is through non-parametric, typically kernel-based, methods. However, existing solutions either fail to account for the geometry of manifolds common in robotics, limiting data efficiency, or, when geometry-aware, provide unreliable uncertainty estimates or require retraining to adapt. We propose a non-parametric approach leveraging geometric priors in scenarios of data scarcity and heteroscedastic uncertainties for probabilistic modeling. We utilize the method to formulate policies based on time or robot state, where non-separable diagonal kernels allow capturing uncertainty relations between degrees of freedom for same-sized in- and outputs. Fast updates, requiring less than 3 ms for a trajectory involving both position and orientation are possible through an optimized formulation. Our approach supports both manifold-valued input and manifold-valued output with large orientation changes. Using task parameterization, adaptation to different object poses is easily possible. We evaluate the approach on a set of toy examples and on real robot manipulation tasks both in autonomous execution and in shared control scenarios.

0.21

Data-Driven Hamiltonian Under Parametric Uncertainty

eess.SY ·2026-11-19 ·Zach Liu, Namhoon Cho, Jason J. Choi
similarity 0.62
Abstract

Hamilton--Jacobi (HJ) reachability computes the states from which a system can be kept out of an unsafe region, but it requires knowledge of dynamics. The data-driven Hamiltonian (DDH), under a black-box dynamics setting, lower bounds the Hamiltonian directly from trajectory data, which produces a guaranteed conservative safe set. However, it needs a Lipschitz constant of the dynamics, and its bound loosens with the distance from the data. We consider dynamics that are linear in unknown parameters through a known feature vector, with a Gaussian prior on the parameters, and use this structure to construct a parametric DDH. From a few short trajectories with noisy velocity measurements, the parametric DDH lower-bounds the Hamiltonian at all states and costates with a probability of at least $1-δ$. The safe set obtained by replacing the Hamiltonian with this bound is then contained in the true safe set with the same probability. For control-affine systems, evaluating the bound amounts to a second-order cone program, so it can be solved efficiently within existing grid-based and neural PDE solvers. We demonstrate the approach on a two-state system and a six-state lunar lander.

0.23

Optimal Control of RKHS Diffeomorphic Flows for Classification and Generative Modeling

cs.LG math.NAmath.OC ·2026-11-17 ·Christopher Chukwuemeka, Andreas Mang
benchmark similarity 0.62
Abstract · 55 pages, 21 figures, 16 tables, 6 algorithms

We develop a unified optimal-control framework that solves supervised classification and likelihood-based density estimation with a single diffeomorphic flow whose velocity lives in a reproducing kernel Hilbert space (RKHS); the two tasks share all structure except the objective. Variable projection eliminates the terminal model (a classifier, or a Gaussian-mixture (GMM) reference), leaving a reduced control problem whose gradient comes from an analytic discrete adjoint. The RKHS parameterization makes the flow's divergence exact and deterministic at the cost of one kernel matrix-vector product, avoiding the stochastic trace estimators and potential-flow restrictions of existing continuous normalizing flows. Because the objective and gradient are deterministic, matrix-free reduced Gauss-Newton (GN) and related second-order solvers are practical for both tasks, which we benchmark against a range of first- and second-order optimizers; the learned map is a diffeomorphism with explicitly controlled regularity. In experiments from dimension 2 to 256, the reduced GN solvers use the fewest iterations of any optimizer tested and, together with joint L-BFGS, the least work; a multiscale kernel improves the density fit, and a trainable GMM reference reduces the deformation needed for multimodal transport at comparable likelihood while lowering the likelihood on real data. The full-model solve is quadratic in the particle count and sub-linear in dimension; a control-point reduction makes the particle-count scaling linear at near-lossless accuracy.

0.35

Stochastic Port-Hamiltonian Gaussian Processes for Learning from Noisy Dynamics on Lie Groups

cs.LG ·2026-11-07 ·Thribhuvan Rapolu, Luke McLennan, Chandrajit Bajaj
code/data similarity 0.62
Abstract · 54 pages, 14 figures

Learning predictive models for dynamics is difficult because observations are often sparse and noisy, while the underlying dynamics evolve on nonlinear configuration manifolds and are affected by environmental dissipation and stochastic disturbances. Standard neural dynamics models can fit short-term trajectories but often violate physical structure, accumulate error over long horizons, or rely on parameterizations that introduce singularities such as gimbal lock. We introduce LieSPHGP, a stochastic Gaussian-process framework for learning rigid body dynamics with port-Hamiltonian structure and stability-aware robustness. LieSPHGP represents motion on Lie groups and Lie algebras, enabling coordinate-consistent optimization without singular parameterizations. Learned mass, potential energy, dissipation, and control components retain physical roles and a separate diffusion term represents stochastic forcing. Each component is modeled by Matérn kernel Gaussian processes which capture uncertainty induced by noisy observations. To improve physical validity, Lie group exponential map updates preserve rotational constraints, while positive-definite damping ensures nonnegative deterministic energy dissipation. The implicit-explicit integrator additionally provides unconditional stability for the frozen linear damping subsystem. The resulting model learns predictive dynamics that are robust to noise, respect rigid body geometry, and capture both intrinsic motion and environmental dissipation. Experiments on various noisy rigid body benchmarks show improved prediction accuracy, stronger long-horizon stability, and better satisfaction of manifold constraints compared with neural dynamics baselines. Code, data and interactive results are available on the project website: https://thribhuvanrapolu.github.io/liesphgp/

0.37

Hamiltonian Metric Learning and Energy-Based Training: A Dissipative Geometric Framework for Optimization

cs.LG math.OCquant-ph ·2026-10-04 ·Sparsho Chakraborty, Mohammad Alamgir, Nishanth M, Akshit Nanda, Ram Prasad Padhy +1 more
benchmark similarity 0.61
Abstract

Optimization in machine learning is usually expressed through iterative rules that update model parameters using information from the loss landscape. In this work, we study an alternative viewpoint in which parameter optimization is treated as the evolution of a dissipative dynamical system. The model parameters are regarded as generalized coordinates, the loss acts as a potential energy, and a positive-definite metric defines the local kinetic geometry of parameter space. Starting from a variational formulation, we derive the corresponding Hamiltonian dynamics, the geometric force generated by a position-dependent metric, and a metric-compatible Rayleigh dissipation law. The resulting continuous system satisfies a monotonic energy-dissipation relation, while its discrete form allows the influence of curvature on the optimization trajectory to be studied directly. We illustrate the framework using a controlled CIFAR-10 image-reconstruction problem for which the optimum is known analytically. With the image Hessian used as the metric, the curvature dependence of the quadratic modal dynamics is removed. We then reparameterize the same image as a matrix product state, producing a genuinely position-dependent metric and a nonzero geometric force. Poincaré return maps provide a complementary phase-space view of the resulting contraction dynamics. These examples establish HAMLET as a geometric, energy-based framework for studying optimization as dissipative motion in parameter space. On a five-seed MNIST MLP benchmark, HAMLET attains the highest mean test accuracy (97.95\%) and the lowest mean test negative log-likelihood (0.0696) among the three evaluated optimizers.

0.20