CS Paper Radar

Residual Learning-Based Control of Vehicle Platoons with $\ell_2$ Stability Guarantees via Recurrent Equilibrium Networks

Brian Delgado, Anh-Tu Nguyen, Hamid Taghavifar

cs.RO eess.SY ·submitted 2026-09-27 20:16 UTC · v1

Abstract

This paper proposes a residual learning-based control framework for heterogeneous vehicle platoons subject to parametric uncertainty and external disturbances. A nominal controller designed via Linear Matrix Inequalities (LMIs), along with disturbance-observer compensation, is enhanced by a Recurrent Equilibrium Network (REN) trained offline using stored trajectories and nominal-model prediction errors. The REN is constrained to satisfy a prescribed $\ell_2$-gain bound, enabling sufficient small-gain conditions for local closed-loop stability and disturbance string stability. Experiments demonstrate reduced spacing and velocity errors relative to the nominal controller.

Comment
Submitted to the 2027 American Control Conference (ACC)

Closest papers

Nearest neighbours by meaning across the whole index.

Safe Platooning under Input Constraints with Link-Wise Velocity String Stability

eess.SY ·2026-10-29 ·Panagiotis S. Trakas, Charalampos P. Bechlioulis, Thomas Berger
theory similarity 0.65
Abstract

We propose a decentralized controller for vehicle platoons with different braking and propulsion limits. The method uses only local distance and velocity measurements and requires neither online optimization nor exact vehicle parameters. The design combines a braking-distance safety margin with an adaptive funnel that relaxes the spacing requirement during propulsion saturation. A standstill mechanism prevents backward motion and supports stop-and-go operation. Under explicit uniform conditions on the vehicle parameters, controller settings, and initial states, we prove that closed-loop solutions exist for all time, collisions are avoided, and input limits are satisfied. Moreover, each follower tracks its predecessor's velocity range with gain one, up to an explicit additive offset determined by the funnel width and the braking-distance term. This bound establishes link-wise velocity string stability. Both the offset and the bounds on speeds and spacing errors are independent of vehicle index and platoon length. Simulations with 2 to 100 followers illustrate safety and bounded velocity deviations under disturbances and actuator limits.

0.18

SSP-DMGTimeNet: Physics-Constrained Learning for Spatiotemporal Trajectory Prediction of Vehicle Platoons

cs.AI ·2026-09-07 ·Yuhang Wang, Kailang Ma, Zirui Li, Mingfeng Fan, Kitae Jang +2 more
similarity 0.64
Abstract

Existing car-following prediction methods mainly optimize trajectory accuracy, while rarely considering whether predicted disturbances propagate realistically along a vehicle platoon. This limitation may lead to accurate but string-unstable predictions. We propose SSP-DMGTimeNet, a physics-constrained learning framework for spatiotemporal trajectory prediction of vehicle platoons. The model combines multi-scale temporal representations with cross-vehicle interaction features to capture complex and time-varying platoon dynamics. A propagation-delay-aware causal attention mechanism explicitly models upstream-to-downstream disturbance propagation by learning response delays between adjacent vehicles and accumulating them along the platoon. In addition, time- and frequency-domain string-stability losses relieve disturbance amplification across both adjacent vehicles and arbitrary sub-platoons during training. Experiments on HighD show that SSP-DMGTimeNet achieves an unstable-window rate of 0.65\% for five-vehicle platoons and a maximum head-to-tail amplification of 0.898 on the ground-truth excitation subset, while maintaining competitive trajectory prediction performance. In zero-shot evaluation on NGSIM US-101 and I-80, the model achieves velocity MAEs of 1.316~m/s and 1.252~m/s, with unstable-window rates of 3.90\% and 4.10\%, respectively. These results demonstrate that incorporating platoon-level physical constraints can effectively balance trajectory prediction accuracy and disturbance propagation stability.

0.17

Reinforcement Learning-Based Control of CAV Platoon Joining Maneuvers in Mixed Traffic

cs.LG cs.AImath.OC ·2026-08-27 ·Biao Yin, Abderrahmane Kasmi, Nadir Farhi
similarity 0.62
Abstract

Connected and automated vehicle (CAV) platooning offers a promising approach to improving road safety and traffic capacity. However, platoon control in real-world traffic is challenging due to uncertainty and heterogeneous driving behaviors. Reinforcement learning (RL) has strong potential for addressing such control problems, but its practical deployment raises challenges related to safety and learning efficiency. This paper proposes a generic modeling and simulation framework for investigating CAV platoon joining maneuvers and comparing deep reinforcement learning (DRL)-based control algorithms. The problem is particularly challenging in mixed-traffic environments, where CAVs coexist with human-driven vehicles exhibiting heterogeneous longitudinal and lateral behaviors. The objective is to achieve safe and efficient joining maneuvers by either incorporating penalties for risky behaviors into the learning process or using an external safety controller to constrain the learned policy. An agent-based modeling framework coupled with the Simulation of Urban MObility (SUMO) simulator is used to evaluate Deep Q-Network (DQN), Double Deep Q-Network (DDQN), and Proximal Policy Optimization (PPO). Results show that PPO outperforms DQN and DDQN, achieving a joining success rate of approximately 98 % and a collision rate below 1 %, largely due to risk-related penalties incorporated into the reward function. However, this improved performance requires more decision steps to complete the maneuver, revealing a trade-off between safety, joining effectiveness, and decision efficiency. An external safety controller effectively prevents collisions, although its interventions may reduce joining efficiency. The results highlight the importance of jointly considering safety and efficiency when designing RL-based controllers for CAV platoon joining in mixed traffic.

0.06

Stability-Aware Imitation Learning from Model Predictive Control for Autonomous Vehicle Lateral Control: Exact Q-Loss and a Novel Training Procedure

eess.SY ·2026-09-20 ·Tien Dat Vu, Minh Quan Nguyen, Anh Tuan Vu, Thanh Tung Nguyen, Minh Doan
similarity 0.58
Abstract

This paper develops a certified imitation-learning framework for approximating model predictive control (MPC) policies with feedforward neural controllers and validates it on autonomous-vehicle lateral control. An exact finite-horizon Q-loss is constructed by fixing the learner's first steering action in the expert MPC problem and re-optimizing the remaining horizon, thereby measuring its downstream optimal-control consequence rather than only pointwise action mismatch. The neural policy is represented as a linear fractional transformation (LFT) interconnection with activation nonlinearities described by sector integral quadratic constraints (IQCs). Combined with a quadratic Lyapunov condition, this representation yields a differentiable certification margin based on the largest eigenvalue of the Lyapunov-IQC matrix. The margin is enforced during training through a logarithmic barrier, while certified Dataset Aggregation (DAgger) and safe projection keep data-aggregation rollouts within the certified policy set. Experiments on a CAD-referenced autonomous-vehicle platform with AprilTag localization and real-time steering demonstrate the resulting closed-loop performance.

0.27

Predefined-Time Resilient Integral Reinforcement Learning for Input-Constrained Unknown Nonlinear Systems Under FDI Attacks and Disturbances: A Fully Data-Driven Approach

eess.SY ·2026-09-10 ·Tien Dat Vu, Minh Doan
hot direction similarity 0.55
Abstract

This paper investigates optimal control for nonlinear systems with unknown dynamics, input constraints, disturbances, and adversarial signals. The objective is to develop a learning-based control method that allows the designer to prescribe the desired convergence time in advance. An integral reinforcement-learning framework is proposed to avoid requiring exact knowledge of the system dynamics while ensuring that the control input always satisfies the actuator constraints. Current and recorded data are combined to train the critic without requiring persistent excitation. The learning gain is selected directly from the prescribed convergence deadline. Lyapunov analysis is then used to establish practical predefined-time convergence of the coupled state-critic system in the presence of disturbances and adversarial channels. The effectiveness of the proposed method is validated through the stabilization control of a two-link robot manipulator.

0.46

Online Constraint Optimization-Based Indirect-Adaptive Robust Control for Autonomous Vehicles with Unknown Friction

eess.SY cs.RO ·2026-10-15 ·Yupeng Zhou, I-Chia Chang, Ziran Wang, Bin Yao
code/data similarity 0.55
Abstract

Friction uncertainty is a significant challenge for autonomous vehicle control, undermining feasibility and performance. This paper proposes a novel two-layer control framework to achieve vehicle motion control under large friction uncertainty by combining optimization-based planning with indirect adaptive robust control (IARC). The upper layer solves a constrained optimal control problem to generate a feasible trajectory that satisfies all the constraints in a time-optimal manner along the desired path. The lower layer, IARC, adapts the unknown parameters related to friction uncertainty and combines model compensation with robust feedback to ensure transient and steady-state tracking performance. An estimation monitor is designed to prevent poor learning when data indicate a model mismatch, while a smooth parameter reset reduces the estimated tire capacity and limits abrupt tightening of constraints. The updated parameters are fed back into the model and constraints in the planner, enabling trajectory replanning as friction conditions change. Simulation results indicate that the proposed method achieves accurate tracking of the desired trajectory and online friction adaptation under large friction uncertainty while ensuring time-optimal vehicle motion. The simulation results demos are available at https://github.com/TedZhou0603/CO-IARC.

0.27

Sharing the Control Authority Between Deep Reinforcement Learning and Model Predictive Control: Application to Multi-Class Transportation Networks

eess.SY cs.LG ·2026-08-21 ·Giray Onur, Azita Dabiri, Bart De Schutter
similarity 0.55
Abstract

Transportation networks, in particular multi-class transportation networks (i.e., networks with mixed vehicle types), are complex systems that are challenging to control. Recently, Deep Reinforcement Learning (DRL), which learns control policies from interactions with the environment, and Model Predictive Control (MPC), which uses a system model to optimize control inputs, have been increasingly utilized for transportation network control. However, nonlinear system dynamics and high-dimensional state spaces in large-scale networks limit DRL's learning capacity under time-constrained training and increase MPC's computation time, hindering real-time implementation with limited computational resources. Moreover, MPC depends on an accurate network model, which is often unavailable for complex systems such as multi-class transportation networks. This paper proposes a novel DRL-MPC framework for multi-class transportation networks that divides control authority between DRL and MPC, combining DRL's fast online computation and model independence with MPC's built-in optimization and constraint-handling capabilities. In the hierarchical framework, MPC operates at the higher level and determines low-frequency control inputs whose slower update rate accommodates its high computation time, while DRL operates at the lower level and determines high-frequency control inputs using its fast online deployment. The framework is evaluated on a multi-class freeway network against a hierarchical MPC controller and a hybrid state-feedback-MPC controller, including scenarios with model mismatch and noisy traffic demands. Results show that the proposed framework outperforms the hybrid state-feedback-MPC controller, substantially reduces online computation time compared with the hierarchical MPC controller, and provides more effective constraint enforcement under model mismatch.

0.41

Closed-Loop Refinement and Execution for Learned Driving Planners

eess.SY cs.RO ·2026-10-01 ·Huaijin Hu, Shanting Wang, Zhongyu Mo, Andreas A. Malikopoulos
similarity 0.55
Abstract · 8 pages, 6 figures, 3 tables. Submitted to the 2027 American Control Conference (ACC 2027)

Learning-based driving planners are usually trained and evaluated in open loop against logged trajectories. In closed loop, a trajectory with small displacement error can still stall the vehicle, steer it into a conflict with surrounding agents, or be executed with abrupt braking. We introduce Closed-Loop Refinement and Execution (CLRE), a hierarchical receding-horizon control framework designed to mitigate these failure modes while leaving the upstream planner frozen and adding no new learned model. The upper layer treats the nominal trajectory as a reference and solves a finite-horizon optimal control problem that trades route progress against interaction with predicted agents. Solving it from several initializations gives a candidate set, and a prediction-conditioned oriented-bounding-box (OBB) feasibility test retains only candidates whose minimum predicted OBB clearance over the horizon meets a threshold. The lower layer executes the lowest-cost survivor, or a route-centerline backup when none remains, through the tracking controller supplied with the planner, augmented by a range-based speed bound and a saturated proportional braking law. In closed-loop simulation on the 220-route Bench2Drive validation set with VAD as the upstream planner, CLRE raises the driving score from 42.26 to 55.89 and route completion from 55.69 to 71.51, and reduces collision events from 117 to 97.

0.23