CS Paper Radar

Enhanced Imitation Learning of Model Predictive Control through Importance Weighting

Pere Izquierdo Gómez, Miguel E. López Gajardo, Nenad Mijatovic, Tomislav Dragicevic

eess.SY ·submitted 2026-11-04 15:08 UTC · v1
top venuehighly cited

Abstract

The approximation of model predictive control (MPC) algorithms with neural network models has received significant attention in the power electronics research community, as a valuable tool to enable the real-time implementation of computationally expensive methods. Training machine learning models to imitate MPC algorithms typically follows a traditional supervised learning flow, with a static training data set generated through either uniform sampling or simulation. Training with uniformly distributed data allows models to maintain consistent performance throughout the entire operating space, but very small models may fail to achieve satisfactory results in the regions corresponding to expected operation. Conversely, simulation data can be used in training to obtain models that can accurately track certain trajectories but fail to achieve adequate performance in underrepresented regions. The present article proposes a method to combine the advantages of both methods, by training models on sampled data with importance weights obtained through the kernel density estimation of experimental data. This allows the training process to target specific regions of the operating space, and results in measurable performance improvements. The method is demonstrated through the imitation of a moving discretized control set MPC algorithm for a dual active bridge converter, and is validated through experimental results.

Journal ref
IEEE Transactions on Industrial Electronics, vol. 72, no. 4, pp. 4073-4083, April 2025
DOI
10.1109/TIE.2024.3447734

Closest papers

Nearest neighbours by meaning across the whole index.

Learning Control Policies from Heterogeneous Multi-Horizon Time Series in Battery Energy Management Systems

eess.SY ·2026-09-18 ·Sheng Yin, Vivek Teja Tanjavooru, Holger Hesse, Christoph Goebel
published similarity 0.64
Abstract

This paper introduces Representation-to-Decision (R2D), an end-to-end imitation learning framework that maps heterogeneous multi-horizon time-series inputs directly to battery control decisions through modular Temporal Feature Extractors (TFEs) and a shared latent representation, without an explicit load and PV forecasting step. While accurate forecasting improves prediction quality, optimal control performance remains unguaranteed in prediction-then-optimization pipelines; standard Reinforcement Learning (RL) lacks the long-horizon temporal awareness due to short-window observations, even when forecast signals are available as additional inputs. R2D offers a different perspective: rather than forecasting first and deciding second, it learns to decide directly from raw temporal inputs, with control optimality anchored by an aging-aware Mixed-Integer Linear Programming (MILP) expert through Behavior Cloning (BC). Benchmarked against six controllers on a high-fidelity electro-thermal battery simulation across five industrial sites, R2D achieves 62--77\% of the global clairvoyant optimum, outperforms the tested Model Predictive Control (MPC) and RL benchmarks, and yields battery degradation nearly identical to its MILP teacher across all five sites. Comprehensive ablation studies over temporal backbone, model size, expert formulation, aging-cost weighting, and horizon configuration confirm that an LSTM encoder with a 15-minute single-step control horizon provides the most robust and deployment-ready configuration, and cross-site and single-factor out-of-distribution tests show that generalization to unseen profiles is profile-dependent, with policies trained on high-activity sites transferring most reliably.

0.26

Flatness-based Neural Network Control of DC-DC Converters

eess.SY ·2026-09-30 ·Kamakshi Tatkare, Ufuk Topcu, Brian Johnson
published similarity 0.62
Abstract · Accepted to 2026 65th IEEE Conference on Decision and Control (CDC)

In this work, we present a simple method to engineer a small neural network to control power converters. Learning-based methods have emerged as a promising approach for power converter control over wide operating point variations. However, many of these approaches do not exploit the analytical structure of converter dynamics and, therefore, search over unnecessarily broad policy classes. We address this gap with a systematic framework that combines model-based trajectory generation with policy learning. First, we use differential flatness of averaged converter models to generate feasible state and constrained duty cycle trajectories where duty acts as a control effort signal. Then for policy learning, we use these model-generated trajectories to construct labeled state-to-duty data and train a multilayer perceptron to approximate the control law with a static map. We apply this framework across buck, boost, and buck-boost converters through topology-dependent flat output selection and a common learning pipeline. Simulations show close agreement between learned and model-generated duty trajectories and stable regulation under large synchronous input and load disturbances.

0.46

Machine Learning-Enabled Wireless Power Transfer: A Task-Oriented Review of Structural Optimization, State and Parameter Estimation, and Adaptive Control

eess.SY ·2026-10-21 ·Denghao Luo, Yiheng Jiang, Jiaqi Zhao, Yuan Gao, Changsong Cai +2 more
code/data similarity 0.62
Abstract · 42 pages, 7 figures; review article

Wireless power transfer (WPT) systems must maintain efficient and safe energy delivery under variations in geometry, coupling, load, alignment, and operating conditions. Machine-learning methods are increasingly applied to accelerate structural design, estimate operating parameters and states, and support adaptive control and scheduling. This review develops a task-oriented framework organized around three interconnected domains: structural design and optimization, parameter and state estimation, and control and optimization. Supervised learning, reinforcement learning, and hybrid or physics-informed methods are compared in terms of data requirements, dependence on physical models, information sources, computational requirements, accuracy, online response, application scope, and optimization objectives. Supervised learning provides rapid surrogate modeling, regression, and classification when representative labeled data are available. Reinforcement learning addresses sequential control and scheduling but introduces challenges in reward design, safe exploration, and simulation-to-reality transfer. Hybrid methods integrate physical knowledge with data-driven models to improve data efficiency and physical consistency. The principal barriers to engineering deployment include limited and biased datasets, weak out-of-distribution generalization, insufficient physical consistency, unsafe online adaptation, embedded-resource constraints, and the absence of standardized benchmarks. Future research should prioritize uncertainty-aware and physics-informed learning, safe simulation-to-reality transfer, lightweight edge deployment, distributed coordination, reproducible evaluation, and digital-twin-assisted development.

0.41

An Integrated Architecture for Data-Efficient Real-Time Neural Imitation of Nonlinear Time-Optimal Model Predictive Control

eess.SY cs.LGcs.RO ·2026-11-12 ·Maarten De Baecke, Flavia Sofia Acerbo, Andrea Giusti, Wilm Decré
similarity 0.61
Abstract · Submitted to European Control Conference 2027 (Brussels)

Nonlinear time-optimal model predictive control (TOMPC) enables highly performant control of constrained systems, but its computational cost prohibits real-time use on fast dynamical systems. Neural network imitation of the TOMPC control law can reduce online computational costs, yet existing work mostly targets quadratic cost formulations in simulation and addresses the challenges of neural controllers in isolation. This work imitates a long-horizon nonconvex TOMPC with hard terminal constraints, whose high computational cost limits training-data generation. We present (i) \emph{self-informed sampling (SIFS)}, a data-efficient expert-sampling strategy that uses a learned time-to-go to query the expert only where the policy deviates from time-optimal behavior, (ii) a complete training and control architecture that jointly addresses dataset correlation, suboptimal expert labels, covariate shift, constraint satisfaction and model mismatch, and (iii) real-world validation on a Furuta pendulum. SIFS matches standard dataset aggregation performance in roughly one-third of the training time and with less than half the training data. The resulting controller matches the region of attraction of the expert TOMPC while raising the control frequency from 1.4~Hz to 1~kHz. On hardware, the controller swings up and stabilizes the pendulum along trajectories closely matching the expert TOMPC solution.

0.23

Structured Representation Learning for Behavior Cloning: How can we learn to safely control a nuclear power plant?

cs.LG ·2026-10-05 ·Perceval Beja-Battais, Alain Grosset{ê}te, Nicolas Vayatis
published similarity 0.60
Abstract

Learned models for industrial control are usually judged by aggregate accuracy, but accuracy at the component level does not guarantee safety once it is embedded in the system it is meant to serve. We study this gap on a behavior-cloning task: imitating an expert Nonlinear Model Predictive Control (NMPC) policy for load-following of a Pressurized Water Reactor (PWR), an industrial system with tight safety constraints. We propose a structured architecture encoding variables from each timescale into separate latent spaces, reflecting the physical decomposition of the system, before training a controller to imitate the expert on the product latent space. On long-horizon rollouts, separated embeddings improve both accuracy and feasibility compared with a shared-embedding baseline. Sensitivity analysis further shows that our model yields interpretable representations aligned with the system's physics. However, standalone deployment still leaves several percent of trajectories infeasible regardless of the architecture. Using our method to warmstart the NMPC optimizer rather than acting standalone, we recover full feasibility and near-optimal cost while still cutting computation time by $\sim$15% relative to the expert controller, and even more for abrupt operating changes.

0.60

Learning Higher Order DC-DC Converter Control from Inversion

eess.SY ·2026-09-30 ·Kamakshi Tatkare, Ufuk Topcu, Brian Johnson
similarity 0.60
Abstract · Accepted at the IEEE 27th Workshop on Control and Modeling for Power Electronics (COMPEL 2026)

Control design for high-order converters with nonlinear dynamics is generally difficult. Nonlinear controls introduce formidable model complexity whereas linear controls suffer from poor disturbance rejection. Our objective in this paper is to develop a simple neural-network-based controller that learns the control law from supervised trajectories generated by a model-based bounded inversion framework. First, we establish strong invertibility for the converter models. Next, we prescribe the desired closed-loop behavior through a trajectory model that defines the target dynamics. We then invert the converter dynamics numerically to obtain the corresponding duty-cycle and state trajectories. We use these model-based trajectories as supervision and train a neural network to approximate the resulting state-to-duty control law. The results show that the learned controllers accurately recover the inversion-based control action and achieve effective regulation under load and input-voltage disturbances. We validate the method on fourth order Cuk, SEPIC, and zeta converters.

0.53

Deep Behaviour Cloning of Model Predictive Control for Real-Time Operation of a Hydrogen-Diesel Dual-Fuel Engine

eess.SY ·2026-09-27 ·Alexander Winkler, Neeraj Naduvath Mana, David Gordon, Jakob Andert
similarity 0.59
Abstract · Submitted to Control Engineering Practice

Hydrogen-diesel dual-fuel (H2DF) combustion engines offer a promising pathway for decarbonising hard-to-electrify transport sectors, yet their highly nonlinear dynamics and coupled process variables demand constraint-aware control strategies. Model Predictive Control (MPC) meets these requirements but requires an online optimisation in every combustion cycle, which limits deployment on low-cost embedded hardware. This paper trains a feedforward deep neural network (DNN) by behaviour cloning (BC) to imitate an MPC expert, using 86,000 engine cycles of demonstration data collected at 1500 min-1 on a modified Cummins QSB 4.5-litre hydrogen dual-fuel engine. Two variants, one with process feedback and one without, are validated experimentally. Both track unseen fast-transient load steps (3-8 bar indicated mean effective pressure, IMEP) with normalised root mean square error (NRMSE) values of 7.80% and 9.03% against the expert's 8.01%, while keeping mean NOx and particulate matter emissions at or below those of the expert. Inference takes 2 ms or less on a Raspberry Pi 400 (ARM Cortex-A72 at 2.2 GHz), including 1 ms communication latency, compared to up to 7 ms for the MPC expert, a 3.5x speedup. Open-loop profiling on a low-cost ESP32 microcontroller at 180 MHz gives 4.3 ms per inference, 4x faster than required for the 18 ms cycle window. Beyond the training range the cloned policy saturates its controls but exceeds the pressure-rise-rate limit. To the authors' knowledge, this is the first experimental BC controller for cycle-to-cycle combustion control of an internal combustion engine (ICE), trained from demonstrations recorded on the engine itself.

0.07

Computationally Efficient Data Generation for Learning Nonlinear MPC Policies

eess.SY ·2026-11-07 ·Pietro Gori, Anton Pozharskiy, Franco Angelini, Manolo Garabini, Moritz Diehl +1 more
similarity 0.59
Abstract

Learning MPC requires large datasets generated by repeatedly solving MPC problems. For Nonlinear MPC (NMPC), dataset generation is computationally expensive because feasible initial states are difficult to sample efficiently. The feasible set is often non-convex or even disconnected, and many randomly sampled states are infeasible, leading to wasted optimization solves and unnecessary computational effort. In this work, we propose a data-generation framework for learning NMPC policies that combines active-set exploration with projection-based sampling. First, a bilevel formulation samples activity weights to promote solutions associated with different active sets while preserving optimality for the original NMPC problem; second, a simpler slack-based formulation uses weighted slack variables to target different active sets at the single level. These reference solutions are then used to construct local linearized feasible sets, from which candidate initial states are sampled and projected through the nonlinear NMPC problem to recover feasible and locally optimal training samples. Our approach is up to $37\times$ faster than baseline uniform sampling with $99\%$ acceptance rate, while maintaining a representative coverage of the feasible set.

0.13