CS Paper Radar

Safe Learning-Based Adaptive Augmentation Control for Fixed-Wing UAV under Uncertainty

Leon Raguse, Lennart Kracke, Mayank Shekhar Jha, Johannes Autenrieb, Mark Spiller

eess.SY ·submitted 2026-09-24 09:57 UTC · v1

Abstract

This paper presents a learning-based adaptive augmentation control concept inspired by the adaptation mechanisms of conventional adaptive control, while not being restricted to their specific parametric adaptation structures. In contrast to augmenting a reinforcement learning (RL) baseline controller with classical adaptive control to account for the simulation-to-reality gap, the proposed approach uses RL-based adaptive augmentation to address the limitations of conventional adaptive control. Domain randomization combined with observation stacking is employed to train the RL-based augmentation to compensate for matched uncertainties in a fixed-wing aircraft system. To ensure constraint satisfaction during operation, a safety filter is incorporated into the control architecture. Based on the concept of pseudo control hedging (PCH), we propose a modified reference model that avoids undesirable interactions between the RL-based augmentation and the safety filter. To reduce the conservatism of the safety filter, we additionally incorporate a disturbance observer. The proposed approach is evaluated on a fixed-wing aircraft model subject to uncertainties.

Comment
Submitted to American Control Conference (ACC) 2027

Closest papers

Nearest neighbours by meaning across the whole index.

Control Allocation with Adaptive Augmentation for Aerodynamic Optimization of Trailing Edge Morphing Aircraft

eess.SY math.OC ·2026-10-01 ·Mark Spiller, Lennart Kracke, Johannes Autenrieb
similarity 0.70
Abstract · Submitted to American Control Conference (ACC) 2027

This paper presents a control allocation framework with adaptive augmentation for a trailing edge morphing aircraft, providing stability guarantees under uncertainty while exploiting the available morphing degrees of freedom to optimize aerodynamic efficiency. A baseline controller is designed using the nominal aircraft model to establish the desired closed-loop reference dynamics. For the aerodynamics, the wing shape is optimized dependent on the flight state to achieve a target elliptical lift distribution corresponding to minimum induced drag. The adaptive augmentation is tailored to the control allocation problem to account for the uncertain system dynamics and stabilize the aircraft around the reference dynamics. The resulting stabilization condition is formulated as hard constraint in the allocation problem while minimizing deviations from the corresponding state-dependent aerodynamically optimal wing shape. Numerical results demonstrate that the adaptive augmentation compensates for matched uncertainties while the control allocation optimizes the wing shape with respect to the reference elliptical lift distribution.

0.18

Towards Safe Reinforcement Learning with Reduced Conservativeness: A Case Study on Drone Flight Control

eess.SY ·2026-08-27 ·Loizos Hadjiloizou, Michael C. Welle, Hang Yin, Danica Kragic
published similarity 0.68
Abstract · 7 pages, 6 figures

Incorporating formal methods into reinforcement learning (RL) has the potential to result in the best of both worlds, combining the robustness of formal guarantees with the adaptability and learning capabilities of RL, though careful design is needed to balance safety and exploration. In this work, we propose a framework to mitigate this loss of exploration while still allowing for the safety of the system to be ensured. Specifically, we introduce a less restrictive method that can reduce the conservativeness of formal methods by refining a disturbance model using online collected data and it evaluates the safety of a learning-based controller, using computationally efficient zonotopic reachability analysis for the safety analysis to facilitate a real-time implementation. We validate the framework in a real-world drone flight through a canyon, where the drone is subjected to unknown external disturbances and the framework is tasked with learning those disturbances online and adjusting the safety guarantees accordingly. The results show that the framework enables a less restrictive online training of learning-based controllers without compromising the safety of the system.

0.23

Neural Network-based Control Systems with Application to Flight Control, From Classical Neural Control to Reinforcement Learning

eess.SY ·2026-11-04 ·Seyyed Ali Emami, Paolo Castaldi, Mohammad Narimani, Mahdi Shahrajabian, Mostafa Ezabadi +3 more
similarity 0.68
Abstract

This book provides a comprehensive and systematic exploration of neural network-based intelligent control systems for aerospace applications, bridging foundational theory with practical implementation. It is structured into two primary parts: Part I covers model-based control design, detailing Feedback Error Learning (FEL), pseudocontrol strategies, and neural backstepping for strict-feedback systems, along with practical refinements such as learning rule modifications, composite learning, and discrete-time formulations, all grounded in rigorous Lyapunov stability analysis. Part II introduces model-free control, laying the groundwork for Reinforcement Learning and Approximate Dynamic Programming. Throughout, theoretical concepts are solidified through detailed case studies on quadrotor UAVs, fixed-wing aircraft (GTM), satellites, and hypersonic flight vehicles, complete with performance metrics, parameter sensitivity analyses, and discussions of actuator faults, input constraints, and wind disturbances, making the book an invaluable resource for students and practicing engineers seeking to design, simulate, and analyze intelligent flight control systems.

0.23

Autonomous fixed-wing interception using reinforcement learning

cs.RO cs.AIcs.NEeess.SY ·2026-10-27 ·Daan van Hamersveld, Ewoud Smeur, Iurii Kriachko
similarity 0.66
Abstract · MSc thesis, Faculty of Aerospace Engineering, Delft University of Technology, 2026. 24 pages, 29 figures, 4 tables

Medium altitude, long endurance unmanned aerial systems such as Shahed-type strike drones are an unanswered threat in modern conflicts. Conventional air defense systems are too expensive to provide a feasible large-scale solution. Quadcopter interceptors are a cheap, battle-proven alternative, but their extremely limited flight time restricts them to low altitude targets at short range, whereas fixed-wing platforms have the endurance to reach higher altitude targets from longer distances. However, such interceptors are still operated manually. Recent developments in learning-based controllers show potential for automation. In this work, a fixed-wing interceptor is presented that is controlled by a neural network that maps filtered monocular vision observations directly to actuator commands. The policy was trained in a custom Python environment using reinforcement learning and proximal policy optimization. The policy was then deployed on a fixed-wing platform and tested in real interception scenarios. As a baseline, two classical guidance controllers were also developed and tested in simulation. The policy is able to intercept targets both in simulation and in real flight. In simulation, the policy outperforms the classical controllers under most conditions. The interceptor was ultimately successfully validated in real flight by intercepting maneuvering fixed-wing targets. This novel system shows the potential of artificial intelligence for autonomous control of fixed-wing interceptor drones.

0.31

Neural Barriers: An Online Certifiable Learning-enhanced Adaptive High Order Safety Critical Control

cs.RO ·2026-10-04 ·Lishuo Pan, Mattia Catellani, An Cao, Lorenzo Sabattini, Nora Ayanian
similarity 0.65
Abstract · 14 pages, 11 figures, 3 tables

Control barrier functions are an effective model-based tool to formally certify the safety of a system. However, transferring their theoretical guarantees to real-world robotics systems requires high model fidelity. For example, payloads or wind disturbances can cause significant model perturbations to an aerial vehicle, leading to safety compromises. In this work, we propose a certifiable online learning-enhanced robust adaptive control barrier function, which adapts to disturbances using a Neural ODE and quantifies its adaptation uncertainty with conformal prediction. Our approach guarantees safety at all time under unknown time-varying model disturbances. It adopts a conservative strategy when the adaptation uncertainty is high; and efficiently adapts to reduce controller conservativeness as it receives more data. Our approach provides a provable safety guarantee with a probability bound under suitable Lipschitz smoothness assumptions on the underlying model and trajectory. These results demonstrate the potential of our method as a practical safety controller for robotics system operating under model perturbations.

0.23

BRACE: Belief-guided Residual Adaptive Control for Safe Navigation under Unknown Disturbances

cs.RO eess.SY ·2026-11-07 ·Jaeyoun Choi, Niklas Schmid, Oswin So, Augustinos Saravanos, Chuchu Fan
similarity 0.64
Abstract

Disturbances encountered during autonomous navigation generally vary across space, often discontinuously, as obstacles redirect wind and changing terrain alters traction. Tracking controllers typically assume sufficient control authority to mitigate disturbances and maintain safety; the regime where this assumption fails remains underexplored. We present Belief-guided Residual Adaptive Control (BRACE), a hierarchical reinforcement learning (RL) framework for reach-avoid navigation under unknown, bounded, spatially varying disturbances. BRACE infers a disturbance belief from model prediction errors and uses that to condition a high-level policy that adapts the reference trajectory. The policy combines a nominal and a belief-guided residual term, trained jointly with a likelihood-ratio advantage reweighting heuristic. We evaluate BRACE in three simulated quadcopter environments with abruptly switching wind fields, and validate it on Crazyflie hardware with fan-generated disturbances. Across these settings, BRACE improves reach-avoid performance over model predictive control and RL baselines.

0.12

Reinforcement Learning for Null-Space Exploitation in Pseudo-Inverse Control Allocation

eess.SY ·2026-11-13 ·Umut Demir, Torbjørn Cunis, Aamir Ahmad, Walter Fichter
similarity 0.63
Abstract

Pseudo-inverse methods are widely used to solve control allocation problems for overactuated aircraft with redundant control effectors. These methods reliably satisfy the primary command tracking objective, while the remaining null-space degrees of freedom are in principle available for secondary objectives such as drag reduction or actuator wear balancing. However, exploiting this freedom in practice requires hand-tuned weighting matrices or a priori preferred deflections that are difficult to specify across a wide flight envelope with nonlinear, state-dependent dynamics. This paper presents a hybrid architecture in which a reinforcement learning agent operates exclusively within the null space of the control effectiveness matrix, learning secondary objective strategies directly from interaction with the flight dynamics. The null-space projector guarantees by construction that primary command tracking remains invariant regardless of the agent output, providing a principled separation between certified primary control and adaptive secondary optimization. The approach is demonstrated on a nonlinear six-degree-of-freedom distributed electric propulsion aircraft model with aero-propulsive effects across diverse mission scenarios, achieving measurable drag reduction compared to the baseline allocation while preserving tracking integrity and respecting actuator constraints. The proposed architecture forms a foundation for future extensions toward multi-objective, mission-conditioned policies.

0.21

Safe Receding-Horizon Control of Fixed-Wing Aircraft Using Constrained Approximate Dynamic Programming

eess.SY ·2026-10-05 ·Felipe Arenas-Uribe, Ricardo Gutierrez, Jesse B. Hoagg
similarity 0.63
Abstract

We present a receding-horizon optimal control for fixed-wing aircraft subject to state constraints. These constraints include operational constraints such as altitude, geofencing, and obstacle avoidance, as well as bounds on flight-path angle, roll angle, and airspeed. The state constraints are composed into a single soft-minimum control barrier function (CBF). We use this composite CBF in a constrained-approximate dynamic program to obtain a sequence of analytic closed-form control functions that approximately minimize a quadratic finite-horizon integral cost subject to the CBF constraint. The resulting receding-horizon control is non-myopic in the sense that it approximately optimizes the integral cost while satisfying the state constraint at all times along the entire prediction horizon. We demonstrate constraint satisfaction and performance in simulations of a fixed-wing aircraft navigating an obstacle-filled airspace under wind uncertainty. We also compare this receding-horizon control with 2 other methods.

0.14