CS Paper Radar

A Neural Network Based Teleoperation for Remote Controlled Vehicles

Ning Ding, Azim Eskandarian

cs.RO cs.HC ·submitted 2026-08-11 01:51 UTC · v1
top venue

Abstract

Direct teleoperation of vehicles faces critical technical bottlenecks: communication latency and the operator's inability to physically perceive unmodeled environmental disturbances (e.g., aerodynamic drag, bank angles) coupled with highly nonlinear tire-road dynamics. To address these challenges, we propose a tailored unilateral teleoperation framework. The system integrates the Wave Variable (WV) approach to passively guarantee stability under stochastic delays, and an adaptive Radial Basis Function Network (RBFN) to actively compensate for vehicle-specific uncertainties. Unlike existing WV-neural network architectures designed for bilateral robotic arms, our framework features decoupled adaptive laws specifically designed for vehicle longitudinal and lateral dynamics. Furthermore, compared to model-heavy predictive controllers, the model-free RBFN offers rapid online adaptation without heavy computational overhead. Building upon our preliminary theoretical formulation, this brief paper presents comprehensive comparative analyses and real-world hardware validations. Simulation benchmarks against PID, LQR, MPC, and NMPC demonstrate that the RBFN achieves superior robustness against unmodeled disturbances while requiring orders of magnitude less execution time than MPC and NMPC, making it ideal for resource-constrained vehicle edge computing. Finally, hardware-in-the-loop experiments using a 1/10th scale vehicle over a 4G network validate the system's practical feasibility, safety, and robust trajectory tracking under physical road uncertainties.

Closest papers

Nearest neighbours by meaning across the whole index.

Adaptive RBFNN Control of Uncertain Bilateral Teleoperation Systems with Delay-Dependent LMI Stability Conditions

eess.SY ·2026-08-20 ·Mohammadali Ghaemifar, Arshia Goshtasbi, Arian Hajizadeh, Armin Attarzadeh, Erfan Riazati
similarity 0.70
Abstract · 20 Pages, 7 Figures

Bilateral teleoperation requires stability despite uncertain master and slave dynamics and delayed communication channels. Existing radial basis function neural network (RBFNN) controllers mainly differ in uncertainty decomposition, while online adaptive parameters often increase with network size. This paper proposes a compact two-sided adaptive controller for a nonlinear bilateral teleoperator with constant forward and backward delays. Operator and environment impedances are incorporated into the manipulator dynamics, and each side uses only two scalar adaptive estimates: one for the ideal RBF weight norm and another for the combined effects of friction, approximation error, and disturbances. Both estimates are updated through sigma-modification, resulting in only two adaptive parameters regardless of the number of RBF nodes. A Lyapunov-Krasovskii functional integrating sliding-variable energy, estimation errors, and delay-dependent integral terms is developed. Free-weighting matrices based on sliding-surface identities provide delay-dependent matrix conditions that guarantee uniform ultimate boundedness of synchronization errors, sliding variables, and adaptive estimates. Simulations on two 2-degree-of-freedom (2-DOF) revolute manipulators with friction, external disturbance, and stepwise operator inputs demonstrate synchronization within approximately 2 s and reveal the trade-off between accuracy and control chattering.

0.38

Planning to Learn: Real-Time Robust Adaptive Control on the GPU with Guaranteed Future Learning

cs.RO cs.LGeess.SYmath.OC ·2026-10-14 ·Anutam Srinivasan, Siddhant Panse, Glen Chou
similarity 0.65
Abstract

Robust adaptive control is vital for keeping robots safe while actively reducing uncertainty in unfamiliar settings. However, traditional methods are often conservative since they fail to account for guaranteed future parameter learning during planning and struggle to scale to high-dimensional systems. In this work, we present A-SLS, a learning-aware robust adaptive model predictive control (RAMPC) framework based on system-level synthesis. A-SLS forecasts future parameter uncertainty and preserves correlations between process disturbances, parameter error, and estimate updates to construct tight, guaranteed reachable sets that account for future information gain. We also develop a GPU-accelerated A-SLS solver to enable real-time performance. Across nonlinear robotic systems, A-SLS reduces reachable-tube conservativeness, maintains real-time performance, and scales to whole-body control for a quadruped with 61 states, 8 uncertain parameters, and 12 control inputs. We further demonstrate the approach on hardware, where a physical Crazyflie drone learns an uncertain dynamics parameter online to stabilize on the fly.

0.26

Neural Barriers: An Online Certifiable Learning-enhanced Adaptive High Order Safety Critical Control

cs.RO ·2026-10-04 ·Lishuo Pan, Mattia Catellani, An Cao, Lorenzo Sabattini, Nora Ayanian
similarity 0.61
Abstract · 14 pages, 11 figures, 3 tables

Control barrier functions are an effective model-based tool to formally certify the safety of a system. However, transferring their theoretical guarantees to real-world robotics systems requires high model fidelity. For example, payloads or wind disturbances can cause significant model perturbations to an aerial vehicle, leading to safety compromises. In this work, we propose a certifiable online learning-enhanced robust adaptive control barrier function, which adapts to disturbances using a Neural ODE and quantifies its adaptation uncertainty with conformal prediction. Our approach guarantees safety at all time under unknown time-varying model disturbances. It adopts a conservative strategy when the adaptation uncertainty is high; and efficiently adapts to reduce controller conservativeness as it receives more data. Our approach provides a provable safety guarantee with a probability bound under suitable Lipschitz smoothness assumptions on the underlying model and trajectory. These results demonstrate the potential of our method as a practical safety controller for robotics system operating under model perturbations.

0.23

LETS: Low-Overhead External-Torque Sensing for Force-Feedback Bilateral Teleoperation

cs.RO ·2026-10-10 ·Zonghao Guo, Dongchen Guan, Yubo Wang, Peng Yang
similarity 0.61
Abstract · 8 pages, 7 figures

Bilateral teleoperation with force feedback is becoming increasingly important, and the quality of external-torque estimation is critical to this process. However, manufacturer-provided disturbance-torque estimates on commercial robotic arms are often inaccurate, while the use of end-effector force/torque sensors adds cost and payload. We propose LETS, a physics-guided learning approach that assigns rigid-body dynamics to recursive Newton-Euler inverse dynamics and reserves learning for only the robot-specific residual. LETS uses only the robot's URDF model and joint feedback, deliberately excluding control commands and thereby decoupling external-torque estimation from control-command inputs. It trains on 12 minutes of free-motion data in under one minute, without requiring a dedicated end-effector six-axis force/torque sensor. In bilateral teleoperation, LETS achieves real-time external-torque estimation that enables stable force feedback. Its free-space error is 69% lower than the manufacturer-provided estimate, substantially reducing coupled oscillations between leader and follower; its contact error is 28% lower, yielding more accurate haptic feedback.

0.19

Robust Adaptive Lyapunov-Based MPC for Nonlinear Systems with Experimental Validation on Quadcopter Attitude Control

eess.SY ·2026-11-05 ·Teo Protoulis, Alex Alexandridis
similarity 0.60
Abstract

In this paper, a computationally efficient robust adaptive Lyapunov-based model predictive control (RALMPC) framework is proposed for a class of constrained nonlinear systems subject to uncertainties and external disturbances. A radial basis function neural network (RBFNN), introduced to approximate non-parametric uncertainties, is incorporated into a control Lyapunov function analysis, together with integral barrier Lyapunov functionals for state constraint enforcement. This analysis yields control and adaptation laws for parametric uncertainties, external disturbances, RBFNN weights, and worst-case approximation error, rendering the closed-loop system uniformly bounded while ensuring convergence of tracking errors to compact sets around the origin. The resulting guarantees are then embedded into the RALMPC optimal control problem through a contractive constraint, thus combining formal closed-loop stability with real-time performance optimization; at the same time, the adaptation laws allow the RALMPC prediction model to be updated online. Comparative hardware-in-the-loop simulations against state-of-the-art MPC schemes validate the efficacy and computational efficiency of the proposed framework. Ultimately, RALMPC is experimentally validated on a custom-built quadcopter platform for time-varying attitude tracking, demonstrating its practical feasibility; comparisons against alternative strategies confirm its superiority in achieving improved closed-loop performance.

0.34

Adaptive Finite-Time Position-Force Control of Teleoperation Systems With Time-Varying Delays Using a Liquid State Machine Uncertainty Estimator

eess.SY eess.SP ·2026-08-30 ·Shayan Akbari Haghighat, Mohammadali Ghaemifar, Armin Attarzadeh, Mohammadreza Piri Sangdeh
similarity 0.60
Abstract · 37 Pages, 24 Figures, 9 Tables

Teleoperation systems are increasingly used in medical, rehabilitation, and remote manipulation applications, where accurate position/force tracking and stable interaction are essential. In such applications, the remote environment may exhibit viscoelasticity, frictional memory, contact transitions, and other dynamic interaction effects, causing the system response to depend not only on the current state but also on its previous evolution. This history dependence, together with communication delays and uncertain nonlinear dynamics, makes accurate uncertainty compensation particularly challenging. Conventional feedforward neural approximators do not inherently retain temporal information, while fully recurrent architectures may introduce additional computational and online training complexity. To address this limitation, this article introduces the first application of a liquid state machine (LSM) to bilateral teleoperation control. A finite-time adaptive controller is developed using a hybrid position/force auxiliary error system with velocity and force filters, while the LSM is employed to estimate uncertain dynamics by exploiting its intrinsic temporal processing and fading-memory capabilities with a simple adaptation mechanism. Closed-loop stability and finite-time convergence are established through a Lyapunov--Krasovskii framework. Simulations in spring--damper and generalized Maxwell viscoelastic environments demonstrate improved position and force tracking and lower mean execution time compared with an RBFNN-based controller.

0.16

Predictive Relative-Velocity Steering for Safe Robotic Manipulator Teleoperation in Dynamic Environments

cs.RO ·2026-08-13 ·Changhao Hu, Zeyi Liu, Songqiao Hu, Shuang Liu, Zihan Meng +1 more
similarity 0.59
Abstract · 8 pages, 8 figures

Recent advances in teleoperation have enabled robotic manipulators to perform dexterous, human-arm-like motions. However, human operators may fail to avoid suddenly appearing obstacles promptly and effectively, particularly under network latency or limited attention, thereby creating safety risks. To address this issue, we propose a lightweight and modular framework for proactive collision avoidance, operating directly at the end-effector velocity-command level. After preprocessing the point cloud, the framework first predicts potential collisions based on time-to-collision (TTC) with integrated overshoot protection, and subsequently rotates the relative-velocity vector using Rodrigues' rotation formula. The deflection changes only the direction of the relative velocity while preserving its magnitude, thereby mitigating the deadlock problem commonly encountered by conventional artificial potential field (APF) methods. The prediction module compensates for point-cloud processing latency introduced by complex teleoperation pipelines, while the lightweight design enables the high-frequency control required for teleoperation. Simulations across diverse scenarios show that the proposed method achieves a higher end-effector collision avoidance rate than the baseline methods. Experiments on a physical robotic system further validate its collision-avoidance effectiveness.

0.10

Wheel-loader V-Cycle Automation with Deep Koopman MPC

cs.RO eess.SY ·2026-09-22 ·Armin Abdolmohammadi, Navid Mojahed, Dinesh Kumar, Bahram Ravani, Shima Nazari
similarity 0.59
Abstract · 8 pages, 4 figure

The repeated forward-reverse maneuvers performed by wheel loaders during earthmoving operations make them well suited for automation. However, the nonlinear dynamics of articulated vehicles and complex vehicle-terrain interactions limit the effectiveness of conventional model-based approaches. This paper presents a hierarchical framework that combines long-horizon geometric planning with data-driven predictive control for autonomous wheel-loader operation. A reduced-order articulated kinematic model is used to generate the maneuver geometry, where the forward and reverse trajectories are jointly optimized through a shared intermediate state. To capture the vehicle dynamics, two data-driven deep bilinear Koopman models are learned for the forward and reverse motions using data generated from high-fidelity simulations in Algoryx Dynamics. The learned Koopman representations are subsequently incorporated into a computationally efficient model predictive control (MPC) formulation for trajectory tracking. The resulting controller operates in real time within a 50-ms execution loop. High-fidelity simulation results demonstrate that the proposed end-to-end framework enables accurate and computationally efficient execution of wheel-loader V-cycle maneuvers, providing a promising approach toward autonomous operation of articulated heavy-duty machinery.

0.26