CS Paper Radar

Image-Driven Control with Application to Thermoforming

Junyong Shim, Klaske van Heusden

eess.SY ·submitted 2026-11-09 21:25 UTC · v1
publishedunusual

Abstract

This paper proposes Image-Driven Control (IDC), an approach to vision-based feedback that operates directly in the image space. IDC offers a direct end-to-end solution in the behavioral framework. Targeting a limited subset of vision-based feedback problems, including applications in manufacturing, the IDC design builds on a computationally advantageous subspace predictive control formulation and offset-free tracking to enable reference tracking in the image space under input and pixel-level constraints. IDC provides a control-theoretic alternative to vision-based feedback systems, enabling improved transparency for analysis and tuning of end-to-end control. It offers straightforward experiment design, an advantage in applications where data collection is expensive. The effectiveness of IDC is shown in a simulation example using a nonlinear high-fidelity model of the heating phase of the thermoforming process.

Comment
6 pages, 2 figures. Presented at the 23rd IFAC World Congress (IFAC 2026), Busan, Republic of Korea, August 2026

Closest papers

Nearest neighbours by meaning across the whole index.

DeoPC: Data-Enabled Output-Feedback Predictive Control for State Regulation

eess.SY math.DS ·2026-11-19 ·Jingyuan Li, Dawei Shi, Ling Shi
similarity 0.51
Abstract · 14 pages, 4 figures

Constrained regulation of the internal state of an unknown linear system is challenging when only input-output measurements are available online. In this work, we develop a data-enabled output-feedback predictive control (DeoPC) framework for constrained state regulation using input-output data. Specifically, a data-driven state estimate is constructed from past input-output data via a subspace-based singular value decomposition. Based on this state representation, we formulate a predictive controller that directly penalizes the state and control effort while enforcing the system constraints. Under persistent excitation and initialization conditions, we establish recursive feasibility and closed-loop stability of DeoPC in both noise-free and bounded-noise settings. In addition, we show that DeoPC can be calibrated to the physical state coordinates using a few offline state measurements, or treated as a model predictive control tuning problem when no state measurements are available. The effectiveness of DeoPC is demonstrated through simulations on an unstable batch reactor system.

0.26

Nonlinear Thermal Modeling and Predictive Control for Spacecraft Optical Temperature Regulation

eess.SY ·2026-10-05 ·Marcus C. Klupar, Daniel T. Larsson, Ewan S. Douglas
unusual similarity 0.51
Abstract

Maintaining a stable thermal environment is critical for spacecraft carrying precision optics, as temperature gradients and thermal expansion can alter the geometric alignment of optical components, compromise wavefront sensing, and degrade image quality even when active thermal systems provide real-time control. In particular, the temperature of the optical payload must be controlled to sub-Kelvin tolerances about the desired setpoint, a requirement that is often difficult to achieve with conventional reactive control methods. To this end, this paper develops a novel nonlinear thermal model for the optical system of a spacecraft, accounting for conduction, radiation, and the changing radiative environment induced by the spacecraft's orbit. Using this model, we develop a model predictive control (MPC) methodology that enables closed-loop thermal regulation of the optical compartment under realistic orbital conditions. Since only partial, noise-corrupted temperature measurements are available, an Unscented Kalman Filter is employed to estimate the full thermal state, yielding a certainty-equivalence MPC controller obtained via recursive online optimization. The thermal model is validated against a high-fidelity thermal simulator, and the proposed approach is compared against conventional PID control, the prevailing method for on-orbit thermal regulation.

0.25

Thermo-VLA: A Thermal-Aware Vision-Language-Action Model with Gated Residual Modulation for Robotic Manipulation

cs.RO cs.AI ·2026-11-09 ·Jingxuan Chen, Junshi Luo, Chencheng Dong, Xiaojian Nie, Tongge Huang +1 more
similarity 0.51
Abstract

Recent Vision-Language-Action (VLA) models have begun incorporating thermal sensing, but existing approaches typically treat thermal images as ordinary visual inputs, providing limited support for temperature-aware relational reasoning in manipulation. To address this limitation, we propose Thermo-VLA with a ThermoRes Encoder, which decomposes thermal images into cold and hot attribute representations and injects them into the RGB token through language-conditioned residual modulation, enabling temperature-driven target selection and continuous manipulation. We further construct six real-world robotic tasks on a dual-arm Unitree G1 platform, spanning basic grounding to relational reasoning. Experiments show that Thermo-VLA achieves an average success rate of 0.86 across four thermal-dependent tasks, outperforming a pi_0.5 baseline that directly incorporates RGB-thermal observations by 18 percentage points. Under unseen-object and scene variations, Thermo-VLA maintains an average success rate of 0.78, achieving the best generalisation performance among the compared methods. Beyond thermal sensing, we transfer the same residual modulation mechanism to colour attributes and observe consistent improvements in both simulation and real-robot experiments, indicating its potential to generalise beyond thermal attributes. Project website: https://j-x-chen.github.io/Thermo-VLA-web/

0.11

RoKON: Efficient and Adaptive Data-Enabled Predictive Control for Robotic Manipulation

cs.RO ·2026-10-26 ·Akshun Sharma, Zhongqi Wei, Buqing Ou, Frederike Dümbgen
similarity 0.48
Abstract · 8 pages, 3 figures

Data-enabled predictive control has recently emerged as a promising control paradigm, enabling a transparent optimal-control formulation without the need to learn an explicit dynamics model. This paper presents a number of extensions paving the path towards its use in real-time robotics tasks. Following recent work, we utilize a nonlinear predictor based on Gaussian kernels to represent the relationship between input and output data. We propose a damped Gauss-Newton method that enables real-time control by efficiently exploiting the least-squares structure of the control problem. In addition, we introduce a hybrid buffer management strategy that incorporates informative online data while retaining relevant offline data, allowing the predictor to account for changes in the dynamics. We demonstrate the tracking performance and computational suitability of the proposed method in MuJoCo using a Franka Research 3 arm pushing a block across surface, without prior knowledge of its changing friction values.

0.45

Dynamics-Aligned Representation Learning under Induced Partial Observability

cs.LG cs.AI ·2026-10-18 ·SM Mazharul Islam, Manfred Huber
similarity 0.47
Abstract

Model-based reinforcement learning (MBRL) has enabled sample-efficient learning of continuous control policies from high-dimensional observations through learned latent dynamics models. These models are typically trained with observation reconstruction objectives, which provide strong supervision but can bias representations toward visual fidelity leading to an undertrained prior and unreliable long-horizon predictions. We propose a stochastic gating mechanism that induces controlled partial observability during training by sampling a spatial binary mask from a Beta--Bernoulli random field and applying it to the raw observation. The gate probability is resampled at each time step, exposing the encoder to conditions ranging from near-total occlusion to near-full visibility. Integration of our method requires minimal architectural changes from existing dynamics models: the gated observation and the binary mask are channel-wise concatenated and passed to the encoder as a single augmented input, with no modifications to the broader training pipeline. We evaluate the proposed approach on a set of pixel-based continuous control tasks selected from the DeepMind Control Suite. Using model predictive control for evaluation, which relies solely on open-loop model rollouts, we show that stochastic gating improves planning performance and data efficiency across tasks. Further analysis demonstrates that performance is robust to the spatial scale of the mask, and a balanced observability during training outperforms configurations biased toward either sparser or denser observations.

0.19

Incremental Model Predictive Control for Reference Tracking of Nonlinear Anesthesia Dynamics

eess.SY ·2026-11-12 ·Maxim Raymond, Kaouther Moussa, Teodoro Alamo, Mirko Fiacchini, Jimmy Lauber
benchmark similarity 0.46
Abstract

Anesthesia dynamics are commonly described by Wiener models, consisting of linear dynamics followed by a static nonlinearity. This nonlinear output complicates the derivation of theoretical guarantees on closed-loop stability and convergence. Model Predictive Control (MPC) is particularly suitable for anesthesia control, as it explicitly accounts for constraints in the control design. In this paper, we propose an incremental MPC formulation for tracking a desired reference. The proposed approach exploits the structure of the nonlinear output equation to reformulate the control problem within a linear framework. An incremental model is then employed to avoid the explicit computation of steady states and inputs, which may be inaccurate in the presence of model uncertainties. The proposed controller is evaluated through simulations involving 1000 virtual patients and compared with a benchmark MPC formulation. Results show improved steady-state reference tracking while maintaining satisfactory disturbance rejection.

0.23

Model-Free Control for Residential Heating: Deployment and Simulation of Nonlinear Data-Enabled Predictive Control

eess.SY math.OC ·2026-09-18 ·Sebastian Zieglmeier, Chris Verhoek, Jaap Eising, Mathias Hudoba de Badyn
similarity 0.46
Abstract · 19 pages, 8 figures, 7 tables

Residential heating accounts for a large share of building energy use, and predictive control strategies can reduce it by anticipating rather than reacting to the room temperature alone. The usual manner of implementing predictive control, model predictive control (MPC), requires an accurate model of each individual residential unit for heating control. Obtaining this model is time-consuming to obtain manually or even impossible, and such models do not transfer across a heterogeneous building stock. Data-enabled predictive control (DeePC) removes this modeling step by designing the controller directly using measured trajectories of the system. The foundations of DeePC, however, are built on the class of deterministic linear time-invariant systems, which is an unrealistic assumption for residential heating. This work applies three recently proposed nonlinear extensions of DeePC, collectively referred to as data-driven predictive control (DPC): Select-DPC, gain-scheduling DPC, and linear parameter-varying DPC. These are compared against standard DeePC and the hysteresis controller, the industry standard in residential heating. The comparison runs over a full heating season on a calibrated digital twin of an occupied research unit, the NEST research building in Switzerland, assessed by heating energy and comfort-band violation. Moreover, gain-scheduling DPC was deployed on the real residential apartment and validated the conclusions from the simulations. Each of the DPC controllers consumes significantly less energy than the hysteresis controller, amounting to roughly $11\%$ over the season, validating the use of DPC. The nonlinear methods further outperform linear DeePC in all assessed scenarios, and we analyze the relative costs and benefits of each nonlinear method.

0.40

Offset-Free Data-Driven Predictive Control: Implicit and Explicit Disturbance Formulations

eess.SY ·2026-11-09 ·Lucca Heinze Faro, Yuanbo Nie, Paul Trodden
similarity 0.46
Abstract · 6 pages, 3 figures. Submitted to ECC 2027

Offset-free tracking is a key objective of any control algorithm. For predictive controllers with linear models, it is well understood that rejecting asymptotically-constant disturbances necessitates augmenting the prediction model with $p$ integrating states, where $p$ is the number of measured outputs. This can be achieved in model predictive control (MPC) by using a velocity form or a combination of disturbance model and observer. In data-driven predictive control (DPC), implicit incorporation of integrating states using the velocity form has been successfully adopted to obtain offset-free tracking; however, formulations based on an explicit disturbance model and observer have not yet been explored. In this paper, we first study how the integrating states are incorporated into the data-based representation used in DPC, translating the requirements of $p$ integrating states into the required modifications of the DPC formulation. We then propose a novel offset-free DPC formulation that incorporates an explicit constant output-disturbance model and an output disturbance observer. Numerical examples show that this formulation has similar disturbance-rejection capabilities to the velocity-form DPC, but using a smaller optimisation problem.

0.30