CS Paper Radar

Neural Network-based Control Systems with Application to Flight Control, From Classical Neural Control to Reinforcement Learning

Seyyed Ali Emami, Paolo Castaldi, Mohammad Narimani, Mahdi Shahrajabian, Mostafa Ezabadi, Alireza Ettelaei, Hosein Saadatmanesh, Zahra Shahbazi

eess.SY ·submitted 2026-11-04 12:32 UTC · v1

Abstract

This book provides a comprehensive and systematic exploration of neural network-based intelligent control systems for aerospace applications, bridging foundational theory with practical implementation. It is structured into two primary parts: Part I covers model-based control design, detailing Feedback Error Learning (FEL), pseudocontrol strategies, and neural backstepping for strict-feedback systems, along with practical refinements such as learning rule modifications, composite learning, and discrete-time formulations, all grounded in rigorous Lyapunov stability analysis. Part II introduces model-free control, laying the groundwork for Reinforcement Learning and Approximate Dynamic Programming. Throughout, theoretical concepts are solidified through detailed case studies on quadrotor UAVs, fixed-wing aircraft (GTM), satellites, and hypersonic flight vehicles, complete with performance metrics, parameter sensitivity analyses, and discussions of actuator faults, input constraints, and wind disturbances, making the book an invaluable resource for students and practicing engineers seeking to design, simulate, and analyze intelligent flight control systems.

Closest papers

Nearest neighbours by meaning across the whole index.

Safe Learning-Based Adaptive Augmentation Control for Fixed-Wing UAV under Uncertainty

eess.SY ·2026-09-24 ·Leon Raguse, Lennart Kracke, Mayank Shekhar Jha, Johannes Autenrieb, Mark Spiller
similarity 0.68
Abstract · Submitted to American Control Conference (ACC) 2027

This paper presents a learning-based adaptive augmentation control concept inspired by the adaptation mechanisms of conventional adaptive control, while not being restricted to their specific parametric adaptation structures. In contrast to augmenting a reinforcement learning (RL) baseline controller with classical adaptive control to account for the simulation-to-reality gap, the proposed approach uses RL-based adaptive augmentation to address the limitations of conventional adaptive control. Domain randomization combined with observation stacking is employed to train the RL-based augmentation to compensate for matched uncertainties in a fixed-wing aircraft system. To ensure constraint satisfaction during operation, a safety filter is incorporated into the control architecture. Based on the concept of pseudo control hedging (PCH), we propose a modified reference model that avoids undesirable interactions between the RL-based augmentation and the safety filter. To reduce the conservatism of the safety filter, we additionally incorporate a disturbance observer. The proposed approach is evaluated on a fixed-wing aircraft model subject to uncertainties.

0.13

Autonomous fixed-wing interception using reinforcement learning

cs.RO cs.AIcs.NEeess.SY ·2026-10-27 ·Daan van Hamersveld, Ewoud Smeur, Iurii Kriachko
similarity 0.65
Abstract · MSc thesis, Faculty of Aerospace Engineering, Delft University of Technology, 2026. 24 pages, 29 figures, 4 tables

Medium altitude, long endurance unmanned aerial systems such as Shahed-type strike drones are an unanswered threat in modern conflicts. Conventional air defense systems are too expensive to provide a feasible large-scale solution. Quadcopter interceptors are a cheap, battle-proven alternative, but their extremely limited flight time restricts them to low altitude targets at short range, whereas fixed-wing platforms have the endurance to reach higher altitude targets from longer distances. However, such interceptors are still operated manually. Recent developments in learning-based controllers show potential for automation. In this work, a fixed-wing interceptor is presented that is controlled by a neural network that maps filtered monocular vision observations directly to actuator commands. The policy was trained in a custom Python environment using reinforcement learning and proximal policy optimization. The policy was then deployed on a fixed-wing platform and tested in real interception scenarios. As a baseline, two classical guidance controllers were also developed and tested in simulation. The policy is able to intercept targets both in simulation and in real flight. In simulation, the policy outperforms the classical controllers under most conditions. The interceptor was ultimately successfully validated in real flight by intercepting maneuvering fixed-wing targets. This novel system shows the potential of artificial intelligence for autonomous control of fixed-wing interceptor drones.

0.31

Towards Safe Reinforcement Learning with Reduced Conservativeness: A Case Study on Drone Flight Control

eess.SY ·2026-08-27 ·Loizos Hadjiloizou, Michael C. Welle, Hang Yin, Danica Kragic
published similarity 0.65
Abstract · 7 pages, 6 figures

Incorporating formal methods into reinforcement learning (RL) has the potential to result in the best of both worlds, combining the robustness of formal guarantees with the adaptability and learning capabilities of RL, though careful design is needed to balance safety and exploration. In this work, we propose a framework to mitigate this loss of exploration while still allowing for the safety of the system to be ensured. Specifically, we introduce a less restrictive method that can reduce the conservativeness of formal methods by refining a disturbance model using online collected data and it evaluates the safety of a learning-based controller, using computationally efficient zonotopic reachability analysis for the safety analysis to facilitate a real-time implementation. We validate the framework in a real-world drone flight through a canyon, where the drone is subjected to unknown external disturbances and the framework is tasked with learning those disturbances online and adjusting the safety guarantees accordingly. The results show that the framework enables a less restrictive online training of learning-based controllers without compromising the safety of the system.

0.23

Learning-Oriented Fault-Tolerant Control for UAVs with Time-Varying Fault Estimation

eess.SY ·2026-10-22 ·Moh Kamalul Wafi
published similarity 0.64
Abstract · This is an extended version of the paper published in the proceedings of IEEE CoDIT

The increasing deployment of unmanned aerial vehicles (UAVs) in safety-critical applications has created a growing demand for control strategies that remain reliable in the presence of actuator and sensor faults. This paper presents a fault-tolerant control framework that combines constructive mathematical modeling, proportional--integral (PI) fault estimation, and learning-oriented control. A nonlinear quadcopter model is first developed using both the Newton--Euler and Euler--Lagrange formulations, from which a discrete-time linear model is derived for observer and controller design. A PI observer is then proposed to estimate actuator and sensor faults, with exponential estimation-error convergence established for constant faults in the absence of disturbances and ultimate boundedness established for slowly time-varying faults under bounded disturbances. The estimated fault signals are incorporated into an active fault-tolerant control architecture together with a Deep Deterministic Policy Gradient (DDPG) controller, which is trained using only the yaw channel and subsequently applied to improve closed-loop tracking performance. Numerical simulations illustrate the observer's estimation performance under constant and slowly time-varying faults, including bounded disturbances, and the tracking performance of the integrated controller under multiple actuator and sensor fault scenarios. The proposed framework combines model-based fault estimation with learning-based control to improve fault accommodation and tracking performance in UAV systems.

0.49

FALCON-S: Fixed-wing ground-effect Aerodynamics Simulator and Flight Control Learning Suite

cs.RO cs.LGeess.SY ·2026-09-05 ·Matteo El Hariry, Pedro Lima, Andrej Orsula, Matthieu Geist, Miguel Olivares-Mendez
similarity 0.64
Abstract · Index Terms: Robot Learning, Flight Control, Reinforcement Learning, Autonomous Navigation, Control and Dynamics, Modeling and Simulation, W…

We present a modular, high-fidelity simulation framework for the development and benchmarking of flight control strategies in fixed-wing aerial robots operating near the ground. Unlike existing simulators that rely on simplified or hover-oriented dynamics, our framework models full 6DoF rigid-body physics, semi-empirical ground-effect aerodynamics, actuator dynamics, sensor noise, and environmental disturbances. This physical realism, combined with modular component design, enables systematic analysis of low-altitude flight behavior under realistic conditions. The simulator supports both CPU and GPU backends via Torch and NVIDIA Warp, enabling high-throughput parallel execution suitable for large-scale reinforcement learning training and optimal control rollouts. A unified interface accommodates a range of controllers (both RL and optical control algorithms) across tasks such as altitude regulation and trajectory tracking. Cross-validation with X-Plane and JSBSim is also supported to facilitate engineering integration and visual fidelity.

0.18

Dynamic System Emulation: Fixed Wing Dynamics on a Multicopter

eess.SY cs.RO ·2026-09-06 ·Abdelhakim Amer, Andriy Sarabakha
similarity 0.61
Abstract · 7 pages, 6 figures

This work presents a control framework that enables a multicopter equipped with a two-axis gimbal to emulate the flight dynamics of a fixed-wing aircraft. The goal is to provide an operationally simple platform for training and simulation that avoids the aerodynamic constraints of fixed-wing vehicles, such as minimum airspeed and nonholonomic constraints. A state-input mapping between the two platforms is derived using dynamic feedback linearization. The framework is evaluated on representative fixed-wing manoeuvres. Results show high-fidelity emulation under nominal conditions. While evaluations are conducted in simulation, the approach establishes a practical path toward hardware deployment for pilot training, autonomy research, and controller benchmarking.

0.27

AM-Bench: A Modular Simulation Suite and Benchmark for Aerial Manipulation Policy Learning

cs.RO ·2026-09-01 ·Yutong Wang, Dongjae Lee, Xiaofeng Guo, Yuanzhu Zhan, Yufei Jiang +7 more
benchmarkhighly cited similarity 0.61
Abstract · 28 pages, 7 figures, 15 tables

Standardized benchmarks have played a central role in advancing robot manipulation learning, yet most focus on ground-supported manipulation systems, which limits their applicability to dynamics-critical domains such as aerial manipulation (AM). AM presents distinct system-level challenges, including environmental disturbances, coupled dynamics between the manipulator and floating base, and constrained degrees of freedom. Consequently, task performance depends jointly on robot embodiment, low-level control, and high-level policy design. We introduce AM-Bench, a modular simulation suite and benchmark for multirotor-based AM policy learning. AM-Bench includes representative embodiments spanning underactuated, fully actuated, and overactuated systems, 12 tasks across contact, transport, and constrained interaction, configurable aerodynamic disturbances and actuator saturation, standard low-level controllers, and baseline policy-learning algorithms. Unlike prior manipulation benchmarks that primarily emphasize end-to-end policy performance, AM-Bench enables system-level evaluation of how embodiment, control, disturbances, and policy choices interact. We demonstrate its diagnostic value through three simulation studies spanning high-level policies, policy--control interfaces, and embodiments, together with real-world validation of modeled effects and a hardware test of the learning pipeline.

0.47

Safe Receding-Horizon Control of Fixed-Wing Aircraft Using Constrained Approximate Dynamic Programming

eess.SY ·2026-10-05 ·Felipe Arenas-Uribe, Ricardo Gutierrez, Jesse B. Hoagg
similarity 0.60
Abstract

We present a receding-horizon optimal control for fixed-wing aircraft subject to state constraints. These constraints include operational constraints such as altitude, geofencing, and obstacle avoidance, as well as bounds on flight-path angle, roll angle, and airspeed. The state constraints are composed into a single soft-minimum control barrier function (CBF). We use this composite CBF in a constrained-approximate dynamic program to obtain a sequence of analytic closed-form control functions that approximately minimize a quadratic finite-horizon integral cost subject to the CBF constraint. The resulting receding-horizon control is non-myopic in the sense that it approximately optimizes the integral cost while satisfying the state constraint at all times along the entire prediction horizon. We demonstrate constraint satisfaction and performance in simulations of a fixed-wing aircraft navigating an obstacle-filled airspace under wind uncertainty. We also compare this receding-horizon control with 2 other methods.

0.14