CS Paper Radar

DeepONet-LSTM Neural Operator for Output Feedback Control of Reaction Diffusion PDEs

Jing Zhang, Jie Qi, Linglong Jiang

eess.SY ·submitted 2026-08-25 15:23 UTC · v1

Abstract

This paper presents a neural operator-based approach for the output feedback boundary stabilization of reaction diffusion PDEs. The classical output feedback backstepping design requires solving control and observer kernel equations for each reaction coefficient. To avoid computing these kernel functions, the output feedback control law is reformulated as a causal boundary operator that maps the reaction coefficient and the boundary measurement to the boundary control input. A hybrid DeepONet-LSTM neural operator is proposed to approximate this causal operator, where DeepONet encodes the spatial coefficient and LSTM captures the temporal dependence of the measurement history. We analyze the Lipschitz continuity of the boundary operator and prove the closed-loop practical stability with the learned controller. A modified loss is also introduced to improve the temporal regularity of the learned boundary input. Numerical results illustrate that the proposed neural operator controller effectively stabilizes the system.

Closest papers

Nearest neighbours by meaning across the whole index.

Backstepping-Guided Reinforcement Learning for Wide-Range Saint-Venant Canal Regulation

eess.SY math.AP ·2026-08-20 ·Chenchen Wang, Jie Qi
similarity 0.56
Abstract

Backstepping control provides local stability guarantees for nonlinear Saint-Venant systems, but its regulation performance may degrade when the system operates far from the nominal equilibrium. This letter proposes a backstepping-guided soft actor-critic (SAC) controller framework that incorporates model-based control knowledge into reinforcement learning (RL). The nominal backstepping control law is first learned by deep operator network (DeepONet) and embedded into the actor and critic networks as prior informed feature representations. The learned prior is further combined with the SAC policy to generate the final control input, while a transfer-learning strategy preserves the useful backstepping knowledge during adaptation to the nonlinear dynamics. Simulation results on the Sambre River model demonstrate that the proposed method improves learning efficiency and maintains effective regulation over larger initial deviations than backstepping control.

0.34

Co-design of Output-Feedback Neural Network Control Barrier Functions and Observers for Stochastic Jump-Diffusion Systems

eess.SY ·2026-10-31 ·Vaishnavi Jagabathula, Ahan Basu, Pushpak Jagtap
theory similarity 0.56
Abstract

In this paper, we present a framework for designing controllers for partially observed continuous-time stochastic systems. We use the notion of control barrier functions (CBF) and provide an upper bound to the probability of state trajectories violating the system's safety when starting in an initial region. Our framework co-designs a neural network-based controller, an output-feedback observer, and a control barrier function for the given system. Although CBF requires full state information, we formulate CBF conditions over an augmented state space of actual and observer states. We train the neural networks simultaneously by defining appropriate loss functions, and finally demonstrate the effectiveness through two case studies: a linear DC motor and a nonlinear system.

0.29

Derivative-Informed Training of Neural Operators On-the-Fly via Sketched Tangent Consistency

cs.LG ·2026-09-26 ·Xinhan Yang, Lu Lu, Shancong Mou
top venuecode/datahighly cited similarity 0.55
Abstract · Accepted at NeurIPS 2026. 24 pages, 6 figures, 10 tables

Derivative-informed training improves neural operators by directly supervising their input-output sensitivities, which is crucial when neural operators are used as differentiable surrogates for inverse problems, PDE-constrained optimization, design, and control. However, existing methods rely on offline-generated derivative labels, making data generation slow, storage-intensive, and difficult to adapt across datasets, resolutions, or perturbation bases. We propose sketched tangent consistency loss (sTCL), an on-the-fly derivative-informed training objective that, for PDEs with a known and differentiable residual, enforces sensitivity consistency directly from the governing equation without offline tangent labels or neural-operator architecture changes. sTCL uses randomly sketched input perturbations to provide a lightweight derivative-level physics constraint during training. However, raw forward-sensitivity residual penalties can fail for stiff, ill-conditioned, indefinite, or coupled saddle-point tangent operators. To address this, we introduce lightweight operator-aware loss-conditioning mechanisms selected by a simple tangent-operator decision rule. Across Helmholtz, nonlinear diffusion-reaction, Burgers, Allen-Cahn, and Navier-Stokes, with the same neural-operator backbone for all methods, the PDE-specific sTCL losses achieve solution and Jacobian accuracy comparable to offline derivative-informed training (DIFNO) while eliminating the offline derivative-data generation and storage pipeline. These results show that on-the-fly derivative-informed training need not merely amortize offline tangent-solve cost into training; with appropriate sketching and loss design, sTCL provides an effective drop-in path to derivative-informed neural operators. Code is available at https://github.com/Mou-group-UMN/Derivative-informed-training-on-the-fly.

0.82

Residual-Corrected Physics-Informed Neural Network KKL Observers with Input-to-State Stability Guarantees

eess.SY ·2026-11-10 ·Hannah Berin-Costain, Jun Liu, Kirsten Morris
theory similarity 0.55
Abstract · 7 pages, 1 figure, ACC 2027 conference submission

Physics-informed neural network (PINN) Kazantzis--Kravaris--Luenberger (KKL) observers require an approximate solution to a KKL partial differential equation (PDE) and an approximate inverse of this solution. Either approximation can leave a nonzero estimation bias even without measurement noise. In this paper, we remove both errors from the implemented observer by construction. We build an encoder containing an explicitly invertible neural map. Its closed-form inverse provides the internal state reconstruction used to evaluate the learned KKL residual and correct the latent dynamics. This construction makes the synchronization manifold exactly invariant for every value of the network weights. Based on contraction of the residual-corrected observer dynamics, we prove an input-to-state stability (ISS) result for the implemented error dynamics with respect to measurement noise. A direct consequence is that the estimation error converges exponentially to zero in the noise-free setting. We provide two numerical examples, the Van der Pol oscillator and the chaotic Lorenz system, in which the residual-corrected observers achieve exact noise-free convergence and improved error responses compared with released PINN--KKL baselines.

0.27

Variationally correct physics-informed operator learning for nonlinear partial differential equations

cs.LG math.NA ·2026-11-16 ·Yuan Qiu, Wolfgang Dahmen, Peng Chen
theoryhot direction similarity 0.55
Abstract

Physics-informed operator learning trains neural operators on the residual of a parametric partial differential equation (PDE) instead of labeled solution data, but its reliability depends on a variationally correct residual: one that is equivalent to the error in a norm dictated by the equation, the PDE-compliant norm. For nonlinear equations written as first-order systems, we prove that the first-order system least-squares residual is equivalent to the error in this norm near a solution branch if the linearized residual is stable and the residual derivative is Lipschitz continuous, possibly in a norm stronger than the error norm. We verify these conditions for monotone reaction, solution- and gradient-dependent diffusion, and compressible Neo-Hookean hyperelasticity. The stability mechanisms vary across these classes, as do the regions where the equivalence holds, from arbitrary bounded sets to a neighborhood of the branch. In a conforming finite element space, we show that the loss excess of a state near the finite element solution is equivalent to its squared distance from that solution. We use this loss to train a reduced basis neural operator with values in this space, with solution snapshots needed only for the basis and the loss and its symbolically derived gradient assembled by the finite element library. At inference, this loss estimates the error. Numerically, the square root of the loss excess tracks the error within factors comparable to those of the linear case, and the operator achieves higher accuracy in the PDE-compliant norm than grid-based baselines evaluated in the same finite element space.

0.28

Physics-informed Reinforcement Learning for Stochastic Reach-Avoid Analysis

eess.SY ·2026-08-17 ·Hikaru Hoshino, Yorie Nakahira
similarity 0.54
Abstract

Stochastic reach-avoid analysis of controlled dynamical systems is an important tool for safety-critical control under uncertainty, in which the reach-avoid probability is characterized by a Hamilton-Jacobi partial differential equation (PDE). However, solving this PDE using conventional numerical methods becomes computationally intractable as the system dimension increases. Physics-informed neural networks (PINNs) may converge to inaccurate local minima when trained primarily through PDE-residual minimization. Reinforcement learning (RL) offers a scalable alternative, but its learned value functions may be inaccurate or inconsistent with the governing PDE. This paper proposes a physics-informed RL (PIRL) framework that combines the complementary strengths of PINNs and RL for stochastic reach-avoid analysis. We develop a scheduled PIRL algorithm in which temporal-difference actor-critic learning first guides the critic toward a meaningful approximation of the reach-avoid value function. PDE-residual and boundary-condition losses are then introduced progressively to enforce consistency with the governing PDE and its boundary conditions. The proposed method mitigates the failure modes of conventional PINN techniques while achieving accuracy comparable to that of successfully trained PINNs. The effectiveness of the proposed framework is demonstrated through two case studies.

0.40

DAMPER: Return-Prioritized Gradient Control for Smooth Policies

cs.LG cs.AI ·2026-09-30 ·Seokmin Ko, Taewon Goo, Kihyuk Hong
similarity 0.54
Abstract · 21 pages, 9 figures, including appendices

Actor-critic methods achieve strong performance in continuous control, but their policies can produce highly oscillatory actions. A common remedy is to add auxiliary smoothness losses. However, their contribution can be negligible when their gradients are small relative to the native actor gradient. Moreover, existing methods often combine multiple auxiliary losses, complicating loss balancing without necessarily improving the return-smoothness trade-off. We introduce DAMPER (Direction-Aware Magnitude-Controlled Projection with Explicit Return Priority), which combines the native actor gradient with a temporal-consistency gradient through conflict-conditioned projection and adaptive magnitude control. It removes the auxiliary component opposing the actor gradient and scales the retained temporal direction relative to the actor gradient norm, preserving positive alignment with the native actor gradient. Experiments with TD3 and SAC on six continuous-control tasks show reduced action oscillation relative to the native agents in all 12 task-backbone pairs and the best oscillation score among the compared methods in eight, with task-dependent return trade-offs.

0.36

Deep learning from a control vantage point

eess.SY cs.AIcs.LGmath.OC ·2026-10-09 ·Álvaro Rodríguez Abella, João Pedro Silvestre, Bahman Gharesifard, Paulo Tabuada
publishedsurvey similarity 0.54
Abstract

This article offers an overview of recent developments in deep learning from a control vantage point. It reviews several classes of models including feedforward and residual neural networks, transformers, large-language models, and selective state space models while explaining how control theory plays an important role in understanding their training, properties, or architecture design. The article explains how residual neural networks can be interpreted as the discretization of a continuous-time control system thereby enabling the use of control theoretic techniques for its analysis. To illustrate the power of this bridge between control and deep learning, two technical results are discussed: 1) the ability of a residual neural network to approximate arbitrary continuous functions is a non-standard controllability problem that can be solved using geometric nonlinear control and 2) transformers, the key architectural component of most large language-models, can be seen the discretization of a consensus algorithm and thus large language-models exhibit consensus. Another point of contact between control theory and deep learning is the connection between backpropagation, the algorithm used to train neural networks, and optimal control. The article addresses how the older connection between these problems, established in the 80's using discrete-time models can be reconciled with the more recent approach using continuous-time models. Several open problems and directions for future research are discussed, including selective state-space models, a recent class of models inspired by the models used in control.

0.41