CS Paper Radar

Uncertainty-Aware Vision-Based Autonomous Aerial Refueling

Minhyuk Jang, Thinh Nguyen, Vivek Khatana, Sandeep Banik, Naira Hovakimyan, Petros G. Voulgaris

eess.SY ·submitted 2026-10-05 23:07 UTC · v1

Abstract

Probe-and-drogue refueling (PDR) requires accurate terminal alignment of a receiver probe with an uninstrumented, dynamically moving drogue despite uncertainty in both relative-state estimation and closed-loop motion. Existing vision-based docking approaches provide relative-state estimates, but generally do not quantify estimation and operational uncertainty in a way that informs the control authority required for robust docking performance. We present an uncertainty-aware vision-based PDR docking architecture that fuses keypoint-based drogue measurements, differential GPS, and avionics in an extended Kalman filter. Split conformal calibration characterizes near-contact error in the fused probe-to-drogue displacement estimate, while a covariance-based operational uncertainty quantification designs position-dispersion limits along with corrective-command variance budgets under modeled handoff variability and disturbances. The resulting uncertainty statistics define geometric and command margins for a range-conditioned deterministic predictive controller. In high-fidelity FlightGear/JSBSim simulations with four controller variants and 50 runs per variant, the combined-margin controller achieved 45/50 centered basket-plane crossings versus 34/50 for nominal MPC. Median planar crossing error decreased from 0.231 to 0.175~$\mathrm{m}$ and the empirical 90th percentile from 0.403 to 0.286~$\mathrm{m}$, while the roll-command RMS increased from 0.22$^\circ$ to 0.48$^\circ$.

Closest papers

Nearest neighbours by meaning across the whole index.

Nonlinear Model Predictive Control via Sequential Convex Programming for Drone-to-Drone Docking

cs.RO ·2026-08-11 ·Neeraj Balachandar, Shriram Hari, Vishnu R. Unni
published similarity 0.60
Abstract · Accepted at IEEE/ASME International Conference on Advanced Intelligent Mechatronics (AIM) 2026

Autonomous mid-air docking of multi-rotor vehicles under disturbance-driven target motion poses a constrained non-linear trajectory optimization challenge. This work formulates the docking task as a finite-horizon optimal control problem based on a reduced-order nonlinear model augmented with disturbance states. The resulting problem is solved using sequential convex programming within a receding-horizon framework to generate dynamically feasible docking trajectories. State estimation with noisy measurements is incorporated to enable robust relative motion prediction, while trajectory execution is validated in a high-fidelity rigid-body MuJoCo simulation environment. The proposed framework is evaluated for stationary and constant-velocity target motions, demonstrating reliable convergence to the docking interface while satisfying geometric capture constraints. Quantitatively, the method maintains negligible docking-cone violations and terminal state errors within prescribed tolerances, and achieves consistent, safe docking performance for cone half-angles as low as 10 degrees. Robust operation is observed for wind disturbance levels up to a standard deviation of 0.5, while preserving bounded approach velocities and stable control effort. These results demonstrate the effectiveness of the SCP-based trajectory optimization framework for disturbance-robust aerial docking under estimation uncertainty.

0.22

Estimation-Aware Control on Quadrotor State Manifolds via Anisotropic Covariance Filtering

eess.SY ·2026-11-11 ·Daniel Engelsman, Itzik Klein
similarity 0.60
Abstract · 11 Pages, 14 Figures, 2 Tables

Conventional nonlinear flight controllers operate under the implicit assumption of reliable, high-confidence state feedback. During transient sensing degradation or partial unobservability, state estimation uncertainty is frequently misinterpreted as physical tracking error, triggering aggressive and parasitic corrective inputs. To mitigate this vulnerability, we propose a generalized Estimation-Aware (EA) control framework that directly incorporates real-time estimator confidence into control execution. By mapping the posterior error covariance $\mathbf{P}_{k\mid k}$ into an uncertainty-dependent modulation operator, the EA mechanism dynamically scales feedback authority, performing anisotropic attenuation along weakly observed state directions to prevent false error corrections. Validated across six distinct control paradigms, the proposed approach demonstrates substantial performance gains across all baselines. In particular, when integrated into an Incremental Nonlinear Dynamic Inversion (INDI) architecture, the EA mechanism reduces tracking and estimation errors by 24.34% and 33.24%, respectively, at a high flight speed of 10 m/s.

0.26

PATH: Continuous Target Sensing among Autonomous Cooperative Drones

cs.RO ·2026-09-11 ·Heegyeong Kim, Alice James, Avishkar Seth, Endrowednes Kuantama, Jane Williamson +2 more
similarity 0.59
Abstract

Continuous target sensing by uncrewed aerial vehicles (UAVs) is constrained by limited flight endurance, motivating the transfer of tracking responsibility between cooperating UAVs. Such a handoff requires the receiver to identify the same physical target currently tracked by the sender despite differences in viewpoint, scale, and target appearance. Existing approaches based on global target localization or appearance-based cross-view association are limited by positioning uncertainty or ambiguous visual features. This paper presents Perspective Alignment \& Tracking Handoff (\textbf{PATH}), a platform-agnostic, geometry-assisted sensing and verification framework for target handoff between two moving UAVs. The sender reconstructs the tracked target as a metric 3D point using RGB-D sensing, while the receiver estimates its relative pose from a fiducial observation and projects the transmitted target point into its own image as a spatial prior for target acquisition. The receiver-generated candidate is then returned to the sender and verified through a cross-view Mutual Agreement Handshake before tracking responsibility is transferred. Real-world UAV experiments show mean relative-position and target-position errors of 0.047~m and 0.030~m, respectively. Under visually ambiguous conditions, PATH achieves 96.0\% frame-level receiver-side target acquisition accuracy, with 2.0\% false-positive and 2.0\% false-negative rates. A sensor-error sensitivity analysis shows that relative-pose uncertainty is the dominant contributor to receiver-view projection error. The implementation operates at video rate with compact inter-UAV communication below 16~kB/s at 60~Hz, demonstrating the feasibility of lightweight geometry-assisted target handoff on resource-constrained UAV platforms.

0.38

CAPTURER: A Dexterous Aerial Manipulator for Dynamic and Precise Grasping across Diverse Environments

cs.RO ·2026-10-29 ·Meng Wang, Jindou Jia, Sicheng Zhou, Zeshuai Chen, Kexin Guo +2 more
similarity 0.58
Abstract

As a representative form of embodied robotic interaction, aerial grasping requires close coordination between the aerial platform and manipulator. Most existing systems perform aerial grasping with static or slowly moving targets under fixed scenarios. Dynamic and precise grasping across different conditions introduces additional challenges, including target motion, localization drift, dynamic coupling, and external disturbances. In this work, we present CAPTURER, a dexterous aerial manipulator for centimeter-level grasping across diverse environments. To achieve the challenging goal, we first develop an onboard perception system for state estimation and target detection. Drift correction and global pose transformation are introduced to improve target localization during flight. A cooperative motion planner is proposed to coordinate the mobility of the aerial platform with the dexterity of the manipulator according to the relative target state. To maintain grasping accuracy under disturbances, we design a disturbance-rejection controller to compensate for dynamic coupling, model uncertainty, and external disturbances. The capability of CAPTURER is validated through indoor and outdoor experiments with both static and moving targets. The results demonstrate that CAPTURER achieves centimeter-level grasping accuracy for a marker pen measuring only 1.5 cm in diameter at flight speeds exceeding 1.5 m/s.

0.24

Observation Quality in DSM-Assisted Aerial Localization: A Benchmark and Base-Anchored Uncertainty Calibration

cs.CV ·2026-10-13 ·Pengyu Yin, Jie Pan, Junxiang Tan, Mengqi Fu, Kun Cheng +1 more
benchmark similarity 0.58
Abstract · 15 pages, 7 figures, 7 tables. Submitted to IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing

Aerial map matching provides position observations for navigation, but a position error alone does not determine how an observation should be weighted. We define five benchmark tasks: position availability and agreement, grouped error structure, predictive uncertainty, controlled updates, and temporal accumulation. We use digital-surface-model-assisted localization to test whether base-anchored uncertainty calibration improves the weighting of unchanged position estimates. The method combines propagated image and map sensitivities with the second moment of a compact configuration subset relative to the reported position. Scale is fitted using separate position references without local surface-height ground truth. Thirteen covariance models are evaluated on two held-out query sets from locations represented in the calibration data. Using reference residuals, we compare the method with a constant full-matrix baseline. With all localization failures included, the method reduces the normalized position-update risk, averaged equally across locations, by 7.70% on 728 conditions and 5.46% on a separate 142 conditions under an independent prior. On the primary set, the equal-location average negative log likelihood on reference residuals improves by 2.571 nat. At these seen locations, exploratory base-only quality calibration and conditional-addition controls leave the incremental update benefit of configuration disagreement unresolved. Navigation benefit and real temporal accumulation remain untested.

0.23

Onboard Vision and MPC Navigation for Underwater Robots: An Open BlueROV2 Platform for Multi-Robot Experiments & Docking

cs.RO eess.SY ·2026-09-29 ·Victor Nan Fernandez-Ayala, Wiktor Kowalczyk, Cezary Banaszek, Dimos V. Dimarogonas
code/data similarity 0.57
Abstract · This work has been submitted to the IEEE for possible publication

Autonomous underwater robots require robust perception, estimation and control to operate in confined environments. This paper presents an open-source BlueROV2 platform combining onboard vision with nonlinear Model Predictive Control (NMPC) for autonomous navigation and docking. The platform integrates an NVIDIA Jetson Orin NX and an Intel RealSense D435i stereo camera in a modular pressure housing. Underwater-calibrated stereo depth and realtime object detection provide relative position measurements of nearby BlueROV2 vehicles in the camera and body frames. A quaternion-based estimator fuses external pose and inertial measurements, while an NMPC controller based on a nonlinear six-degree-of-freedom model tracks planned navigation and docking trajectories. To support reproducible development, we also provide open-source physics-based PX4 SITL and Gazebo environments, multi-robot simulation tools and a lowcost physical docking station. Experiments evaluate underwater perception, onboard computational performance, state estimation, trajectory tracking and autonomous docking.

0.22

Borrowed Eyes: Markerless Nano-UAV Flight with an Active Quadruped Observer

cs.RO ·2026-10-07 ·Alejandro Lorite Mora, Dimitrios Arapis, Andrés Faíña
similarity 0.57
Abstract · 8 pages, 7 figures, 2 tables. Submitted to ICRA 2027

Nano unmanned aerial vehicles (nano-UAVs) can navigate confined spaces that larger robots cannot, but their payload capacity severely limits the sensors and compute available for self-localization in global navigation satellite system (GNSS)-denied environments. We present a vision-based system that localizes a nano-UAV from a quadruped robot with an arm-mounted camera. The quadruped tracks the drone, estimates its position in its own coordinate system using segmentation masks and depth, and transmits that position over a real-time radio link. To ensure continuous tracking, we developed a perception-aware nonlinear Model Predictive Controller (NMPC) that dynamically adjusts the quadruped's body and arm to maximize the drone's visibility, treating observation reliability as a primary control objective. Relying solely on this external estimate, the nano-UAV executed predefined trajectories from takeoff to landing with a median 3D localization error of 59 mm. The system demonstrates robustness against short visual occlusions by smoothly transitioning to onboard inertial flight when line-of-sight is temporarily lost. Ultimately, this framework allows a quadruped to offload the localization burden of a nano-UAV, enabling inspection of complex spaces that neither robot could navigate alone.

0.20

UCON: Uncertainty-aware Navigation with Historical Re-association in Dynamic Environments

cs.RO ·2026-09-24 ·Bing Sun, Yue Lin, Yongsheng Yuan, Yang Liu, Dong Wang +1 more
published similarity 0.56
Abstract · Accepted to the 2026 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2026)

Autonomous navigation in dynamic environments is hindered by two fundamental challenges: perception instability and uncertainty-optimization mismatch. The former leads to identity switches and unreliable motion estimation, while the latter prevents principled incorporation of motion uncertainty into trajectory optimization. To address these challenges, we propose UCON, an uncertainty-aware navigation algorithm in dynamic environments. For perception instability, we present a point-level historical re-association mechanism that leverages historical point cloud fragments to recover lost targets while maintaining identity continuity. Subsequently, a Kalman filter is employed to provide anisotropic motion state estimation and covariance propagation. To resolve the uncertainty-optimization mismatch, we transform predicted states and their covariances into uncertainty sectors, which are embedded as differentiable cost terms within a trajectory optimization framework. This achieves consistent uncertainty-aware dynamic obstacle avoidance while maintaining smoothness and feasibility. Extensive simulations and real-world experiments demonstrate that, while maintaining high computational efficiency, UCON achieves superior perception stability and robust navigation performance in dynamic environments compared to state-of-the-art methods. The code will be open-sourced to facilitate further research.

0.40