CS Paper Radar

Stability-Constrained Imitation Learning for Performance-Guaranteed Neural Feedback Frequency Control in Microgrids

Sajid Kamal, Yichen Zhang, Feng Qiu, Tianqiao Zhao

eess.SY ·submitted 2026-11-17 03:11 UTC · v1

Abstract

Guaranteeing performance for frequency control is challenging within traditional control paradigms, as it demands precise disturbance estimation and real-time control signal computation within a timeframe of seconds. This paper addresses this challenge by proposing a stability-certified imitation learning framework for frequency regulation in low-inertia microgrids. Based on the frequency response model of the microgrid, an offline numerical optimal control is employed to generate near-optimal pairs of state and control dataset, which are subsequently used to train a deep neural network (DNN) feedback controller. To ensure the closed-loop stability, the DNN controller is trained with a set of Lyapunov-based stability constraints derived using absolute stability theory. Such an imitation learning paradigm can significantly improve the training efficiency, while the resulting DNN controller acts as an end-to-end function that simultaneously handles disturbance estimation and control optimization. The proposed framework is validated on a modified IEEE 33-node diesel-wind microgrid. The DNN controllers are deployed in wind turbine generators (WTGs) to provide decentralized, intelligent supplementary active power support to always maintain frequency deviations within predefined safety bounds under different disturbances while preserving closed-loop stability.

Comment
10 pages

Closest papers

Nearest neighbours by meaning across the whole index.

Converter-Grid Interaction Stability Guaranteed Safe Deep Reinforcement Learning for Energy Storage Systems in Grid Frequency Support

eess.SY ·2026-09-15 ·Fei Liu, Mengfan Zhang, Zhipeng Li, Frede Blaabjerg, Qianwen Xu
similarity 0.62
Abstract · 10 pages, 13 figures. Submitted to IEEE Transactions on Smart Grid

The growing integration of converter interfaced renewable energy resources (RESs) intensifies stability challenges. Energy storage system (ESS) can provide fast and flexible frequency support to mitigate frequency deviations. However, the interface converter of ESS may encounter converter-grid interaction stability issues. This paper proposes a converter-grid interaction stability guaranteed safe DRL (CIS-DRL) method for ESS integrated power systems to achieve frequency regulation. We first obtain a double DNN-based stability region to identify the guaranteed converter-grid interaction stability. Next, a novel converter-grid interaction stability Safe-TD3 (CIS-STD3) algorithm is designed that integrates a stability feasibility projection layer to map unsafe actions into stable action set before execution, enforcing converter-grid interaction stability as a hard constraint throughout learning process. The proposed approach enables ESS for grid frequency support with 100% converter-grid interaction stability without violations. Experimental results show that the proposed CIS-DRL method achieves improved frequency regulation performance while preventing unstable operating points, demonstrating its practical applicability for real time ESS frequency support.

0.27

A Three-Stage Unsupervised Online Physics-Informed Neural Network for Microgrid Optimal Power Flow

eess.SY ·2026-11-10 ·Abinash Giri, Yi Hu
similarity 0.58
Abstract

Optimal allocation of generators is a key challenge in power systems to achieve economical dispatch while satisfying operational constraints. Conventional optimization techniques can be computationally expensive, limiting their applicability in real-time environments, and neural networks often require offline retraining under new operating conditions. This paper proposes a three-stage unsupervised online physics-informed neural network (PINN) framework for optimal power flow (OPF). Simulation results demonstrate that the proposed framework satisfies load demand and system constraints while achieving a $43,665 lower operating cost than fmincon-based optimization under the same operating conditions. The training process analysis further demonstrate the framework's ability to adapt its parameters online to variations in load demand and renewable generation in real time.

0.37

Learning Higher Order DC-DC Converter Control from Inversion

eess.SY ·2026-09-30 ·Kamakshi Tatkare, Ufuk Topcu, Brian Johnson
similarity 0.58
Abstract · Accepted at the IEEE 27th Workshop on Control and Modeling for Power Electronics (COMPEL 2026)

Control design for high-order converters with nonlinear dynamics is generally difficult. Nonlinear controls introduce formidable model complexity whereas linear controls suffer from poor disturbance rejection. Our objective in this paper is to develop a simple neural-network-based controller that learns the control law from supervised trajectories generated by a model-based bounded inversion framework. First, we establish strong invertibility for the converter models. Next, we prescribe the desired closed-loop behavior through a trajectory model that defines the target dynamics. We then invert the converter dynamics numerically to obtain the corresponding duty-cycle and state trajectories. We use these model-based trajectories as supervision and train a neural network to approximate the resulting state-to-duty control law. The results show that the learned controllers accurately recover the inversion-based control action and achieve effective regulation under load and input-voltage disturbances. We validate the method on fourth order Cuk, SEPIC, and zeta converters.

0.54

LLMs are Few-Shot Decision-Makers: Generalized Context-Aware Microgrid Frequency Control through Prompt Decision Transformer

eess.SY cs.AI ·2026-08-22 ·Xu Yang, Chenhui Lin, Haotian Liu, Kaihang Deng, Yunhe Li +1 more
similarity 0.58
Abstract

The rapid evolution of energy structures has positioned microgrids as pivotal components of next-generation power systems, offering enhanced resilience and renewable energy integration. However, the inherent low inertia, complex dynamics, and poor model conditions of microgrids necessitate advanced data-driven frequency control strategies. Although reinforcement learning (RL) has demonstrated certain potential and advantages, existing RL methods often struggle with generalization across diverse microgrid configurations and lack adaptability to unseen environments, particularly when explicit system parameters are unavailable. To address these challenges, in this paper, we introduce a novel prompt decision transformer (Prompt-DT) architecture for microgrid frequency control. Unlike traditional approaches that rely on hard-to-obtain environmental characteristic parameters, the proposed method leverages few-shot expert historical trajectories as prompts to guide autonomous perception and adaptive decision-making. In addition, we propose a context-aware training and execution mechanism utilizing self-supervised contrastive learning to enhance environment recognition and prompt utilization efficiency. In addition, a physics-informed prompt design technique that filters prompts based on cumulative reward and frequency volatility is proposed, ensuring high-quality physical guidance during online execution. Finally, to ensure generalization in unseen environments with limited data, we develop a lightweight finetuning approach that achieves performance comparable to full-parameter finetuning with minimal adjustments.

0.15

Control of hybrid wind-wave energy systems using reinforcement learning

eess.SY ·2026-08-11 ·Zechuan Lin, Kemeng Chen, Maosen Fan, Xiaofan Li, Xi Xiao +1 more
similarity 0.57
Abstract

Integrating wave energy converters (WECs) with floating offshore wind turbines (FOWTs), to form hybrid wind-wave energy (HWWE) systems, is a promising approach to achieve further cost reduction for offshore renewable energy. In such systems, the control of the integrated WECs plays an important role, with the potential to generate additional wave energy while simultaneously suppressing floating platform motion. However, HWWE systems are characterized by complex dynamics, making accurate modelling only viable through numerical simulation, and posing significant challenges for control design. This paper proposes a reinforcement learning (RL) control framework for HWWE systems, in which the real-time control policy is learned directly through interactions with high-fidelity simulation. A numerical model is established for a HWWE system consisting of an IEA 15 MW wind turbine, a VolturnUS semi-submersible platform, and three torus-type WECs, which is then employed as the RL training environment. Control performance is evaluated in terms of both wave energy generation and platform motion reduction, two competing objectives, from a Pareto perspective. It is shown that the proposed RL controller achieves substantial Pareto improvements over conventional control strategies, e.g., over 75\% higher wave energy capture at the same platform motion level, or nearly 50\% lower motion at the same energy capture level, thereby significantly extending the attainable performance boundary of HWWE systems.

0.04

Flatness-based Neural Network Control of DC-DC Converters

eess.SY ·2026-09-30 ·Kamakshi Tatkare, Ufuk Topcu, Brian Johnson
published similarity 0.56
Abstract · Accepted to 2026 65th IEEE Conference on Decision and Control (CDC)

In this work, we present a simple method to engineer a small neural network to control power converters. Learning-based methods have emerged as a promising approach for power converter control over wide operating point variations. However, many of these approaches do not exploit the analytical structure of converter dynamics and, therefore, search over unnecessarily broad policy classes. We address this gap with a systematic framework that combines model-based trajectory generation with policy learning. First, we use differential flatness of averaged converter models to generate feasible state and constrained duty cycle trajectories where duty acts as a control effort signal. Then for policy learning, we use these model-generated trajectories to construct labeled state-to-duty data and train a multilayer perceptron to approximate the control law with a static map. We apply this framework across buck, boost, and buck-boost converters through topology-dependent flat output selection and a common learning pipeline. Simulations show close agreement between learned and model-generated duty trajectories and stable regulation under large synchronous input and load disturbances.

0.46

Safe Receding Horizon Mixed-Integer Differentiable Predictive Control for Degradation-Aware Battery Dispatch

eess.SY ·2026-09-23 ·Eshagh Safarzadeh Ravajiri, Jan Drgona, Benjamin F. Hobbs
publishedbenchmark similarity 0.56
Abstract · 6 pages, accepted to the 65th IEEE Conference on Decision and Control (CDC 2026)

We present a safe receding-horizon mixed-integer differentiable predictive control methodology for residential battery energy storage dispatch that combines neural-network speed with recursive feasibility guarantees. Unlike open-loop learning-to-optimize methods, it incorporates real-time state-of-charge feedback and sinusoidal time-of-day conditioning, enabling closed-loop re-planning at every timestep without re-solving a mixed-integer program. A differentiable rainflow cycle-counting layer enables self-supervised training of the mixed-integer policy on exact degradation physics. The controller is a hybrid closed-loop system pairing a neural mode-selection and continuous-action policy with a quadratic-programming safety filter that guarantees recursive feasibility independent of network weights or mode optimality. We establish mode-conditioned Lipschitz continuity and a conditional regret decomposition into training-quality, mode-mismatch, and forecast-error terms. On a 7-day net-metering evaluation, the method attains a 6.9% cost gap versus the closed-loop mixed-integer MPC benchmark with a 25x speedup (0.11 s vs 2.7 s per step), while average regret rises by under 4% across 0-30% forecast noise. The learned and benchmark modes agree at every step, so the bound reduces to its training-quality and forecast-error terms, both empirically validated.

0.19

Safe Deep Reinforcement Learning for Energy-Efficient HVAC Control in Multi-Zone Residential Buildings

eess.SY ·2026-08-18 ·Oussama Ziadi, Abdelilah Rochd, Samir Idrissi Kaitouni, Mohamed Oualid Mghazli, Adnane Saoud
published similarity 0.56
Abstract · 6 pages, 5 figures. Accepted to IEEE Conference on Control Technology and Applications (CCTA) 2026

HVAC systems represent a major share of building energy consumption. Traditional control strategies are limited in coordinating energy-comfort tradeoffs across multiple zones simultaneously. Reinforcement learning (RL) offers adaptive, data-driven control that optimizes performance over time. However, deploying learned neural network controllers in safety-critical building systems remains challenging due to lack of formal safety guarantees. We propose a safety-certified deep RL framework for multi-zone residential HVAC control. Proximal Policy Optimization (PPO) and Soft Actor-Critic (SAC) agents are trained in an EnergyPlus/Sinergym simulation to minimize energy consumption while maintaining thermal comfort. Post-training safety certification is performed on the PPO policy using Lipschitz-based forward invariance analysis, building on existing tools for the computation of Lipschitz constants for neural networks, to guarantee constraint satisfaction. Both agents are evaluated over an annual simulation cycle in an eight-zone variable refrigerant flow (VRF) testbed. The PPO agent achieves 67\% comfort violation reduction compared to rule-based control, while the SAC agent achieves 27.6\% energy savings. The PPO policy satisfies formal safety certification with a margin of $2.003^\circ$C. These results demonstrate the feasibility of combining reinforcement learning with post-training safety verification for multi-zone building control.

0.20