CS Paper Radar

Deep Behaviour Cloning of Model Predictive Control for Real-Time Operation of a Hydrogen-Diesel Dual-Fuel Engine

Alexander Winkler, Neeraj Naduvath Mana, David Gordon, Jakob Andert

eess.SY ·submitted 2026-09-27 17:52 UTC · v2

Abstract

Hydrogen-diesel dual-fuel (H2DF) combustion engines offer a promising pathway for decarbonising hard-to-electrify transport sectors, yet their highly nonlinear dynamics and coupled process variables demand constraint-aware control strategies. Model Predictive Control (MPC) meets these requirements but requires an online optimisation in every combustion cycle, which limits deployment on low-cost embedded hardware. This paper trains a feedforward deep neural network (DNN) by behaviour cloning (BC) to imitate an MPC expert, using 86,000 engine cycles of demonstration data collected at 1500 min-1 on a modified Cummins QSB 4.5-litre hydrogen dual-fuel engine. Two variants, one with process feedback and one without, are validated experimentally. Both track unseen fast-transient load steps (3-8 bar indicated mean effective pressure, IMEP) with normalised root mean square error (NRMSE) values of 7.80% and 9.03% against the expert's 8.01%, while keeping mean NOx and particulate matter emissions at or below those of the expert. Inference takes 2 ms or less on a Raspberry Pi 400 (ARM Cortex-A72 at 2.2 GHz), including 1 ms communication latency, compared to up to 7 ms for the MPC expert, a 3.5x speedup. Open-loop profiling on a low-cost ESP32 microcontroller at 180 MHz gives 4.3 ms per inference, 4x faster than required for the 18 ms cycle window. Beyond the training range the cloned policy saturates its controls but exceeds the pressure-rise-rate limit. To the authors' knowledge, this is the first experimental BC controller for cycle-to-cycle combustion control of an internal combustion engine (ICE), trained from demonstrations recorded on the engine itself.

Comment
Submitted to Control Engineering Practice

Closest papers

Nearest neighbours by meaning across the whole index.

Hydrogen-Diesel Dual-Fuel Engine Operation Using Real-Time GRU-Based Nonlinear Model Predictive Control

eess.SY ·2026-09-14 ·Alexander Winkler, Vasu Sharma, Julian Bedei, Edward Sperling, Charles Robert Koch +2 more
similarity 0.84
Abstract · Submitted to International Journal of Hydrogen Energy

Hydrogen-diesel dual-fuel (H2DF) combustion reduces combustion-out CO2 emissions but exhibits nonlinear cycle-to-cycle dynamics at high hydrogen energy shares (HES). This work evaluates nonlinear model predictive control (NMPC) with a gated recurrent-unit deep neural network dynamics model for transient H2DF control. Trained on 99,800 engine cycles, the model predicts indicated mean effective pressure, nitrogen oxides (NOx), particulate matter (PM), and maximum pressure-rise rate. Single-cylinder Cummins 4.5 L experiments follow an unseen 4,900-engine-cycle trajectory. Compared with production diesel-only control, NMPC improves load-tracking mean absolute error by 27.8% and reduces mean PM by 61.1%, while mean engine-out NOx increases by 105.1% without exhaust-gas recirculation. Mean and peak HES reach 39.7% and 55.1%; a high-hydrogen setting achieves 77.8% peak HES without constraint violations. Robust to feedback noise and model-plant mismatch and executing in 3 to 7 ms per engine cycle on low-cost embedded hardware, learned-dynamics NMPC enables practical, real-time, constraint-aware transient H2DF control with substantial diesel substitution.

0.45

Structured Representation Learning for Behavior Cloning: How can we learn to safely control a nuclear power plant?

cs.LG ·2026-10-05 ·Perceval Beja-Battais, Alain Grosset{ê}te, Nicolas Vayatis
published similarity 0.60
Abstract

Learned models for industrial control are usually judged by aggregate accuracy, but accuracy at the component level does not guarantee safety once it is embedded in the system it is meant to serve. We study this gap on a behavior-cloning task: imitating an expert Nonlinear Model Predictive Control (NMPC) policy for load-following of a Pressurized Water Reactor (PWR), an industrial system with tight safety constraints. We propose a structured architecture encoding variables from each timescale into separate latent spaces, reflecting the physical decomposition of the system, before training a controller to imitate the expert on the product latent space. On long-horizon rollouts, separated embeddings improve both accuracy and feasibility compared with a shared-embedding baseline. Sensitivity analysis further shows that our model yields interpretable representations aligned with the system's physics. However, standalone deployment still leaves several percent of trajectories infeasible regardless of the architecture. Using our method to warmstart the NMPC optimizer rather than acting standalone, we recover full feasibility and near-optimal cost while still cutting computation time by $\sim$15% relative to the expert controller, and even more for abrupt operating changes.

0.60

Learning Control Policies from Heterogeneous Multi-Horizon Time Series in Battery Energy Management Systems

eess.SY ·2026-09-18 ·Sheng Yin, Vivek Teja Tanjavooru, Holger Hesse, Christoph Goebel
published similarity 0.60
Abstract

This paper introduces Representation-to-Decision (R2D), an end-to-end imitation learning framework that maps heterogeneous multi-horizon time-series inputs directly to battery control decisions through modular Temporal Feature Extractors (TFEs) and a shared latent representation, without an explicit load and PV forecasting step. While accurate forecasting improves prediction quality, optimal control performance remains unguaranteed in prediction-then-optimization pipelines; standard Reinforcement Learning (RL) lacks the long-horizon temporal awareness due to short-window observations, even when forecast signals are available as additional inputs. R2D offers a different perspective: rather than forecasting first and deciding second, it learns to decide directly from raw temporal inputs, with control optimality anchored by an aging-aware Mixed-Integer Linear Programming (MILP) expert through Behavior Cloning (BC). Benchmarked against six controllers on a high-fidelity electro-thermal battery simulation across five industrial sites, R2D achieves 62--77\% of the global clairvoyant optimum, outperforms the tested Model Predictive Control (MPC) and RL benchmarks, and yields battery degradation nearly identical to its MILP teacher across all five sites. Comprehensive ablation studies over temporal backbone, model size, expert formulation, aging-cost weighting, and horizon configuration confirm that an LSTM encoder with a 15-minute single-step control horizon provides the most robust and deployment-ready configuration, and cross-site and single-factor out-of-distribution tests show that generalization to unseen profiles is profile-dependent, with policies trained on high-activity sites transferring most reliably.

0.26

Accelerating Nonlinear MPC by Behavior Cloning with Separated Timescales: Application to Nuclear Reactor Load-Following

cs.AI cs.LGmath.OC ·2026-10-28 ·Perceval Beja-Battais, Alain Grosset{ê}te, Nicolas Vayatis
benchmark similarity 0.60
Abstract

Behavior Cloning (BC) of expert controllers for multiscale dynamical systems is challenging: state variables evolving at widely separated timescales induce highly nonlinear couplings that a shared latent space may fail to adequately represent, degrading closed-loop generalization. We propose Structured Representation Learning for Behavior Cloning (SRLBC), an architecture designed to leverage the physical knowledge of multiscale systems in which slow state variables, fast (stiff) state variables, and predictable exogenous inputs evolve at different timescales. On 500 long-horizon roll-outs of a pressurized water reactor (PWR) load-following benchmark -a high-dimensional, stiff industrial system with challenging safety constraints -and across 20 training seeds, separated embeddings systematically outperform shared embedding baselines on cumulative cost, imitation accuracy and constraint satisfaction. The resulting standalone policies approach NMPC closed-loop performance at a computational cost 15 times lower on average. Since standalone policies still leave a few percent of trajectories infeasible, we embed the learned policies in a safety-augmented approximate NMPC framework, in which the optimizer is only called when the predicted input sequence is not certified as safe. This yields controllers still 6.8 times faster than the NMPC controller on average, with a feasibility (i.e., constraint satisfaction) of at least 99.8% for all architectures, SRLBC retaining the lowest closed-loop cost. Under distribution shift, standalone BC policies degrade sharply: SRLBC degrades the least, and once safety-augmented, it retains a feasibility above 98% with the lowest closed-loop cost. Beyond the quantitative results, Jacobian-based sensitivity analysis shows that the resulting controller relies on a sparse and less redundant set of latent features, each attributable to a single group of physical variables, and aligned with the physical timescale decomposition of the system.

0.06

Enhanced Imitation Learning of Model Predictive Control through Importance Weighting

eess.SY ·2026-11-04 ·Pere Izquierdo Gómez, Miguel E. López Gajardo, Nenad Mijatovic, Tomislav Dragicevic
top venuehighly cited similarity 0.59
Abstract

The approximation of model predictive control (MPC) algorithms with neural network models has received significant attention in the power electronics research community, as a valuable tool to enable the real-time implementation of computationally expensive methods. Training machine learning models to imitate MPC algorithms typically follows a traditional supervised learning flow, with a static training data set generated through either uniform sampling or simulation. Training with uniformly distributed data allows models to maintain consistent performance throughout the entire operating space, but very small models may fail to achieve satisfactory results in the regions corresponding to expected operation. Conversely, simulation data can be used in training to obtain models that can accurately track certain trajectories but fail to achieve adequate performance in underrepresented regions. The present article proposes a method to combine the advantages of both methods, by training models on sampled data with importance weights obtained through the kernel density estimation of experimental data. This allows the training process to target specific regions of the operating space, and results in measurable performance improvements. The method is demonstrated through the imitation of a moving discretized control set MPC algorithm for a dual active bridge converter, and is validated through experimental results.

0.70

A Scalable Learned Iterative Solver for Nonlinear MPC via Temporal Decomposition

cs.LG math.OCeess.SY ·2026-10-09 ·Lukas Lüken, Sergio Lucia
benchmark similarity 0.57
Abstract · 16 pages, 7 figures, 7 tables

Nonlinear model predictive control (NMPC) can be applied to large nonlinear systems with complex objectives while enforcing constraints, but the cost of solving the underlying optimization problems limits real-time application for systems with fast dynamics or many states. Neural networks can reduce this online cost by approximating the control law, but may violate constraints and typically require many precomputed optimizer solutions for training. The learning-based iterative solver for constrained optimization (LISCO) instead learns to predict primal-dual steps toward satisfaction of the Karush-Kuhn-Tucker (KKT) conditions through self-supervised training without precomputed solutions, but its dense, monolithic architecture grows with the prediction horizon. We remove this horizon dependence by exploiting the temporal structure of the problem in the solver architecture, which makes the network size independent of the horizon while leaving the training loss and the solver iteration unchanged. A closed-loop resampling strategy further aligns the training distribution with closed-loop operation at no additional sampling cost. On an economic NMPC benchmark of a CSTR cascade, the proposed solver scales to larger problems than monolithic LISCO and achieves median speedups of up to a factor of four over IPOPT. In closed loop, it achieves comparable control performance to IPOPT with no observed constraint violations.

0.32

Two-Timescale Reinforcement Learning for Real-Time Optimization and Economic NMPC: Experimental Validation

eess.SY ·2026-09-28 ·Saket Adhau, Jose Matias, Sebastien Gros, Sigurd Skogestad
similarity 0.57
Abstract · 12 pages, submitted to Journal of Process Control

We propose a reinforcement learning (RL) framework that tunes both Real-Time Optimization (RTO) and Economic Nonlinear Model Predictive Control (ENMPC) to address plant--model mismatch in process systems. Drawing on modifier-adaptation concepts, the method parameterizes the dynamic model, stage costs, constraints, and RTO modifiers, and uses Q-learning to adjust these parameters at two timescales: a fast update for the ENMPC layer and a slow update for the RTO layer. The framework is experimentally validated on a laboratory rig emulating a three-well subsea oil-production network. Using plant measurement data, the proposed RTO-RLMPC scheme achieves 8.6% higher economic profit than nominal ENMPC, preserves input feasibility of the deployed ENMPC policy and empirically satisfies the path constraints under disturbances and measurement noise, and drives the learned model parameters toward reference plant values, independently identified from experimental data, along the directions that most affect the economic objective. This work provides one of the first experimental demonstrations of RL-tuned ENMPC integrated with RTO.

0.24

A tale of perfect fit and phantom optima: how data-driven models can fail in real-time optimization

eess.SY cs.AI ·2026-08-24 ·Prithvi Dake, Rahul Bindlish, James B. Rawlings
benchmark similarity 0.55
Abstract

Real-time optimization (RTO) relies on process models to locate economically optimal operating conditions. Because developing first-principles models requires significant process knowledge, data-driven alternatives are increasingly attractive. Modern machine-learning models can fit historical plant data accurately and often pass standard validation tests. Whether such models can be trusted for economic optimization, however, remains unclear. We investigate this question using a vinyl acetate monomer benchmark process with a unique, well-conditioned economic optimum. We train a structured hybrid model that combines known mass balances and thermodynamics with a neural-network closure for unknown kinetics, and a fully data-driven neural ordinary differential equation (ODE) model. Both models reproduce plant measurements accurately and exhibit little variation in predictions across random initializations. Yet their economic optima differ substantially from that of the plant. Where the plant returns a single optimum on multistart search, the trained models return many phantom optima. We further show that the training optimizer alone can be yet another source of error. Even with noise-free data and initialization at weights that recover the plant optimum, stochastic gradient training can drift to weights that yield substantially worse RTO solutions. The identified model is thus an artifact of the training optimizer as well as the data. These results demonstrate that a good predictive fit of all available measurements does not guarantee reliable economic performance. A data-driven model for RTO should at least be required to recover the optimum on a decision-oriented benchmark like the one developed here before being considered for plant testing and application.

0.23