CS Paper Radar

Statistical Learning of Contractive Dynamical Representations for Composite Adaptive Control

Min Kim, José Leonardo Brenes, Fred Hadaegh, Soon-Jo Chung

eess.SY cs.LGcs.RO ·submitted 2026-09-28 17:59 UTC · v1
published

Abstract

We present a representation-learning framework for composite adaptive tracking control under dynamically coupled disturbances. The framework connects classical disturbance-accommodating control (DAC) to recent last-layer adaptive disturbance-rejection methods. Specifically, we introduce a statistically principled hard expectation-maximization (hard-EM) procedure, with a Kalman smoother in the hard E-step, to identify dynamical representations of disturbance whose latent evolution is uniformly contractive. The learned representation evolves a latent disturbance-excitation state from measured plant features and control inputs and decodes that state into the time-varying disturbance acting on the nominal plant, thereby extending prior "fixed-decay" last-layer adaptive methods to a learned, predictive DAC-style formulation. Combined with Bayesian filtering of the learned latent state, this representation yields a composite adaptive tracking controller with predictive capability and provable exponential convergence to a bounded neighborhood. We validate our approach experimentally on a slippery ground vehicle carrying a liquid-sloshing tank and a pendulum load, and we further assess its robustness on a system of coupled Duffing oscillators. Across both settings, the method achieves accurate disturbance prediction and improved overall tracking performance relative to fixed-decay representation-learning ablations, LTI disturbance-accommodating baselines, and model-based PD baselines.

Comment
9 pages, including an additional one-page appendix in this arXiv version. Accepted to the 2026 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2026)

Closest papers

Nearest neighbours by meaning across the whole index.

EM-KalmanNet: Learned Expectation-Maximization for Adaptive Tracking in Partially Known, Block-Wise Time-Varying State-Space Models

eess.SP ·2026-08-25 ·Ori Cohen, Nir Shlezinger, Tirza Routtenberg
similarity 0.62
Abstract

State estimation in partially known state space (SS) models is challenging when the dynamics or observation model varies across short data blocks. Classical model-based approaches, such as the expectation-maximization (EM) Kalman filter, jointly recover the latent states and the unknown model parameters, but rely on linear-Gaussian assumptions that should accurately describe the system and require numerous forward-backward passes. Consequently, their performance and computational efficiency may deteriorate under complex and non-stationary real-world conditions. On the other hand, learned Kalman smoothers are robust to model mismatch yet cannot adapt at inference to unseen model variations without labeled data. In this work, we propose EM-KalmanNet, an AI-aided tracking algorithm for adaptive smoothing in blockwise time-varying SS models. The method unfolds a fixed, small number of EM-like iterations into a trainable architecture: a parameter-aware RTSNet implements a learned E-step conditioned on the current model-parameter estimate, while a lightweight M-Net implements a learned M-step that updates the state-transition or the observation matrix using empirical moments, residuals, and gradient-related statistics. The two modules are shared across the unfolded iterations and are trained offline via a dedicated three-stage procedure. During deployment, the per-block parameter estimate is propagated between consecutive blocks, enabling observation-driven adaptation without labeled online data or knowledge of the noise statistics. Experiments involving linear and nonlinear models, Gaussian and non-Gaussian noise, Lorenz attractor tracking, and acoustic source localization demonstrate that EM-KalmanNet consistently outperforms model-based and data-driven benchmarks while substantially reducing inference latency relative to the EM-KF.

0.19

Stability-aware Residual Reinforcement Learning Framework for Robotic Manipulator Disturbance Compensation

cs.RO ·2026-09-18 ·Jihong Kim, Joonhyuk Kwon, Hwa Soo Kim, TaeWon Seo, Hyung-Tae Seo
similarity 0.61
Abstract · 14 pages, 9 figures

Although conventional controllers and disturbance observers (DOBs) are the standard for precision tracking in manipulators, they suffer from parameter uncertainty, nonlinear friction, and compound disturbances. This study proposes a residual reinforcement learning DOB framework that pairs an analytical observer with an RL policy. The deterministic baseline operates within a reliable region, whereas the RL policy explicitly targets the residuals that the model cannot capture. To make this compensation disturbance-aware, an estimator network aligns the observation history with a privileged disturbance context, organizing the latent space by disturbance regime and enabling rapid adaptation across disturbance transitions. To guarantee stability, we derived and enforced a state-dependent action bound on the RL policy from an input-to-state stability (ISS) analysis such that the closed loop provably confines the tracking error to a certified envelope for arbitrary policy outputs. Experiments on a 6-DOF manipulator demonstrated consistent improvements in disturbance estimation and tracking, including a 27.8% tracking-error reduction on real hardware under zero-shot sim-to-real transfer and a 38.0% reduction under a base-vibration disturbance that was not observed during training.

0.24

Reinforced Iterative Learning Control for elastic joint arms: Guaranteed cross-trajectory generalization under model uncertainties

cs.RO ·2026-10-20 ·Yuri De Santis, Michele Pierallini, Franco Angelini, Manolo Garabini
published similarity 0.59
Abstract · Accepted for publication in Control Engineering Practice, 2026. 16 pages, 10 figures

Trajectory tracking for compliant robots is challenging due to nonlinear dynamics and modeling uncertainties, often requiring learning-based methods to avoid explicit parameter identification. Iterative Learning Control (ILC) ensures theoretically high precision and preserves the passive compliance of the robot. However, traditional ILC requires a separate learning phase for each new trajectory. Conversely, Reinforcement Learning (RL) generalizes to new trajectories, but practically suffers from high sample complexity and limited tracking precision. This work proposes Reinforced Iterative Learning Control (RILC) that combines the strengths of both approaches to achieve fast adaptation and guaranteed tracking convergence across diverse trajectories. By establishing a concurrent coupling between the two controllers, RILC overcomes the high initial errors and slow adaptation of traditional ILC, enabling high-performance tracking from the very first trials. In this architecture, ILC provides high-quality samples, while RL contributes as a generalizing best-effort policy across iterations. Additionally, a theoretical proof is presented to show that the RL component preserves ILC stability and, under specific conditions, can also reduce the error bound asymptotically. The efficacy of this framework is demonstrated through simulation and experiments on an underactuated 4-degree-of-freedom serial elastic robot using different trajectories and modeling mismatches.

0.39

Nonadaptive Learning in Robust Nonlinear Output Regulation

eess.SY cs.AImath-phmath.OC ·2026-08-18 ·Shimin Wang, Martin Guay, Richard D. Braatz
benchmark similarity 0.59
Abstract

This paper considers robust nonadaptive regulation for general nonlinear systems in an output-feedback setting with arbitrarily high relative degree. We develop a nonadaptive design that combines an input-driven filter and a generic internal model with a recursive backstepping law, thereby recasting the regulation problem as the robust input-to-state stabilization of an augmented error system. Unlike adaptive schemes, the proposed method does not rely on linearly parameterized regressors and does not require the construction of Lyapunov functions having merely nonpositive derivatives. Under standard assumptions on the exosystem, including purely imaginary and simple eigenvalues, together with a minimum-phase input-to-state stability condition on the internal dynamics, we establish global asymptotic regulation and derive explicit, verifiable inequalities for selecting the design gains. The resulting nonadaptive framework guarantees convergence of the estimation and tracking errors even when the controlled-system dynamics are complex or only partially known. The effectiveness of the theoretical results is demonstrated using a benchmark controlled Duffing system.

0.10

Three High Performance Global Tracking Composite Adaptive Controllers for Fully Actuated Euler-Lagrange Systems: Experimental Validation

eess.SY ·2026-09-22 ·Luis Cervantes-Pérez, Jose Guadalupe Romero, Romeo Ortega, Víctor Santibáñez, Jesús Sandoval
similarity 0.59
Abstract

Three adaptive global tracking controllers for fully actuated Euler-Lagrange systems, with verifiable performance improvement over existing designs, are reported in this letter. Two of these controllers ensure global exponential convergence under a weak interval excitation condition. Besides, one of the proposed controllers features a simple adaptive PID-like structure that-unlike classical solutions-avoids the need for additional filtering. We adopt a composite adaptation architecture, invoke a novel parameterization of the system dynamics and use a high performance estimation scheme recently introduced in the literature. Real-time experiments and a comparative study with a learning-based adaptive controller on a two-degrees-of-freedom manipulator arm illustrate the effectiveness of the proposed controllers.

0.21

Adaptive Stability-Constrained Neural Differential Equations for Controlled Dynamical Systems with Unknown Inputs

eess.SY ·2026-08-10 ·Syed Pouladi
similarity 0.59
Abstract

Continuous-time neural models are attractive for identifying nonlinear systems, but a small one-step error can grow rapidly when a learned vector field is rolled out under inputs that differ from those used for training. This paper develops an adaptive stability-constrained neural differential equation (AS-NDE) for systems with measured controls and unmatched, unknown perturbations. The nominal vector field and a state--input-dependent Riemannian metric are learned jointly. Positive definiteness is enforced by construction, while a sampled differential inequality penalizes violations of a prescribed contraction rate. An incremental input-to-state bound is derived: the distance between two trajectories decays exponentially up to gains determined by differences in their controls and disturbances. The statement explicitly accounts for the time derivative of an input-dependent metric, a term that is easily omitted in heuristic stability regularizers. We give a reproducible evaluation protocol for a forced Duffing oscillator and a permanent-magnet synchronous motor (PMSM) model. Because no measured data or executed training runs accompany this draft, all numerical curves and tables are clearly identified as illustrative synthetic placeholders; their PGFPlots coordinates are embedded in the source for direct replacement. The resulting manuscript is intended as a technically consistent starting point, not as evidence of empirical superiority before the prescribed experiments are run.

0.04

Forgetting While Remembering, an Invariant Online Data-Driven Predictive Control Formulation

eess.SY ·2026-09-16 ·Alessandro Chiuso, Florian Dörfler, Keith Moffat
similarity 0.58
Abstract · 8 pages, 3 figures, conference paper (CDC)

Low signal-to-noise ratio (SNR) data is a core challenge of online Data-Driven Predictive Control (DPC) for linear, time-varying systems. This paper proposes a Bayesian, online DPC framework based on autoregressive models with exogenous inputs (ARX) that uses an externally-provided prior, which encodes inductive bias such as smooth system dynamics and stability, to safeguard performance when SNR is low. The posterior estimate of the ARX parameter is propagated forward in time using a Kalman filter with a state equation defined by an adaptation-rate hyperparameter, which is adjusted online to track the rate at which the underlying system dynamics evolve. The Kalman filter's posterior mean and covariance determine the DPC's Final Control Error cost function, which is the posterior expectation of the quadratic cost function. Critically, the Kalman filter's process equation is chosen so that, regardless of the hyperparameter adaptation, the prior distribution is invariant over time. Thus, while old data is forgotten, the prior is not. DPC tracking experiments on a time-varying second-order system demonstrate the efficacy of the proposed method.

0.32

Direct and Indirect Data-Driven Control with Prior Information about the Equilibrium Manifold

eess.SY ·2026-09-24 ·Yi-Chun Liao, Valentina Breschi, Marco M. Nicotra
published similarity 0.57
Abstract · Accepted at the 65th IEEE Conference on Decision and Control (CDC 2026)

By hinging on the assumption that a system to be controlled is fully unknown, many data-driven control approaches do not leverage available or readily inferable priors. In contrast to this viewpoint, this paper analyzes the impact of using the system's equilibrium subspace to inform direct and indirect linear quadratic regulation. For the indirect case, we show how including a constraint on the equilibrium subspace in the identification problem changes the statistical properties of the learned model. In particular, we show that enforcing consistency with respect to the equilibrium subspace leads to a reduction in the estimator variance that, in turn, enhances model-based control performance. In the direct case, we show how this prior can be leveraged to gain insight into the controlled system without requiring an explicit identification step. These results are supported by both numerical and experimental evidence, showcasing the advantages of explicitly leveraging the equilibrium manifold as a prior in data-driven control.

0.25