CS Paper Radar

A Geometric Observer for Visual-Inertial Odometry using Optical-Flow Constraints

Tarek Bouazza, Soulaimane Berkane, Tarek Hamel

eess.SY cs.RO ·submitted 2026-11-15 16:18 UTC · v1

Abstract

This paper presents a geometric observer for monocular visual-inertial odometry driven by individual optical-flow constraints. For each tracked point, the bearing and its rotationally compensated derivative give a depth-free homogeneous constraint on the body-frame velocity. These constraints enter the innovation of an observer on the gravity-augmented group $\mathbb{SE}_3(3)$ through a Riccati gain, without estimating depths or reconstructing the direction of motion. The auxiliary gravity state makes the six-dimensional body-frame velocity-gravity error dynamics independent of the attitude correction, and their uniform observability is shown to be equivalent to persistent excitation of a matrix formed from the inertial bearings and their derivatives. Under this condition, the body-frame velocity and gravity errors converge globally and uniformly exponentially, and a gravity-based attitude correction renders the combined velocity, gravity, and reduced-attitude error almost globally asymptotically stable and locally uniformly exponentially stable. Simulations illustrate the excitation condition, recovery from initial errors, and sensitivity to perturbed measurements.

Comment
12 pages, 6 figures. Submitted to ECC 2027

Closest papers

Nearest neighbours by meaning across the whole index.

Reduced Order Observers for Monocular Visual Inertial Odometry

eess.SY ·2026-09-22 ·Amel Abi, Mouaad Boughellaba, Miaomiao Wang, Abdelhamid Tayebi
similarity 0.81
Abstract

This work develops a reduced order observer framework of monocular visual-inertial odometry (VIO). The key idea consists in considering the gravity vector in the body-frame as an additional state and constructing an appropriate output that relates the monocular bearing measurements and their time derivatives to the body-frame velocity. This eliminates the need for the estimation of the landmark positions, leading to a six-dimensional linear time-varying (LTV) observer for the body-frame velocity and gravity, endowed with uniform global exponential stability guarantees. These estimates are subsequently used to recover the orientation almost globally, up to an unknown constant yaw offset, and the position up to an unknown constant translation. The mixed-bearing framework is further extended to account for the inertial measurement unit (IMU) biases, yielding a twelve-dimensional LTV observer endowed with local exponential stability guarantees. Numerical simulations are provided to illustrate the effectiveness of the proposed observers.

0.15

NIF-VIO: Visual--Inertial Odometry Across Inertial and Non-Inertial Reference Frames

cs.RO ·2026-11-10 ·Zichao Shu, Lijun Li, Zhuochen Li, Zetao Chen, Jianyu Wang
similarity 0.64
Abstract

Conventional visual--inertial odometry (VIO) assumes that observations from cameras and an inertial measurement unit (IMU) are jointly consistent in an inertial reference frame. However, this assumption breaks down under non-inertial conditions. Inside accelerating or rotating carriers, visual observations of the interior reflect carrier-relative motion, while IMU measurements contain additional carrier-induced components, which can compromise conventional fusion. We therefore present NIF-VIO for localization relative to the local environment across inertial and non-inertial reference frames. It adapts visual--inertial fusion based on measurement consistency. As inertial conditions change, early constraint isolation is combined with local reoptimization to limit error propagation before inconsistency confirmation and repair the affected local geometry. Under non-inertial conditions, a compact model with temporally shared parameters is introduced to account for carrier motion while preserving inertial information that complements visual constraints. Experiments on public benchmarks and a self-collected dataset demonstrate that NIF-VIO achieves competitive performance under inertial conditions and improved localization accuracy and availability under non-inertial conditions.

0.24

Robust Structureless Monocular Visual Inertial Initialization Exploiting Line Features and Vanishing Points

cs.RO cs.CV ·2026-09-18 ·Junwan Choi, Woongrae Jo, Dong-Uk Seo, Jinwoo Jeon, Hyun Myung
publishedbenchmarkcode/data similarity 0.62
Abstract · 8 pages, 5 figures, Accepted to IROS 2026

Accurate initialization is essential for reliable visual-inertial odometry (VIO), but it is often ill-conditioned under degenerate motions. Existing methods typically require restrictive excitation motions to ensure sufficient observability or rely on computationally expensive 3D structure reconstruction, limiting efficient and practical deployment. To address these limitations, we propose SLIM-init, a structureless monocular VIO initializer that directly exploits geometric constraints from tracked 2D line features without explicit 3D landmark reconstruction. Specifically, SLIM-init leverages line-derived vanishing points (VPs) as translation-invariant orientation cues to provide robust rotation-only constraints under degenerate scenarios such as low-parallax or translation-dominant motions. It further incorporates a line epipolar residual to constrain translation and a line-normal projection residual to improve the conditioning of linear alignment, enhancing the accuracy and robustness of initial state estimation. Extensive experiments on a public benchmark and challenging custom degenerate-motion sequences demonstrate improved accuracy and robustness over state-of-the-art initialization methods. The source code is available at: https://github.com/cjunwan/SLIM-init.

0.44

Visual-Inertial RGB-D SLAM with Encoders for a Differential Wheeled Robot

cs.RO ·2026-10-30 ·Zhanghao Zhu, Yutaka Kaizu, Kenichi Furuhashi, Kenji Imou
publishedcode/datahighly cited similarity 0.60
Abstract · 11 pages. Author-accepted manuscript of the article published in IEEE Sensors Journal, 2022

Recent years have seen multiple impressive results in visual-inertial odometry (VIO) techniques, by which accurate state estimation can be achieved via the extended Kalman filter (EKF) or nonlinear optimization. However, these approaches are rarely open source, and they tend to fail in real experiments due to the temporary lack of feature points and fast motion. Therefore, in this study, we used encoders to overcome the temporary failure of purely vision-based simultaneous localization and mapping (SLAM). Here, we propose a generative measurement model for encoders and derive an expression for the maximum a posteriori (MAP) estimate and necessary Jacobians for optimization. We use our theory to present a novel tightly coupled visual-inertial encoder RGB-Depth (RGB-D) SLAM system. Tests on our system on an in-house dataset confirmed that our modeling effort led to accurate (with a root mean squared error (RMSE) of approximately 2-7 cm) and robust state estimation in real time. The source code and our dataset containing the encoder information have been published for verification.

0.74

Visual-Inertial Odometry for Ground Robots with Dynamic Camera-IMU Extrinsic Calibration

cs.RO ·2026-10-18 ·Bo Dong
similarity 0.60
Abstract

Visual-inertial odometry systems are often constrained by the assumption that sensors are rigidly mounted, which limits their adaptability in practical scenarios involving structural motion. To address this limitation, this paper investigates time-varying camera-IMU extrinsic calibration. First, a dynamic camera-IMU extrinsic calibration method based on the Denavit-Hartenberg convention is proposed by incorporating the robot kinematic model. Second, a two-step initialization strategy is developed to efficiently estimate the initial joint angles, providing a reliable starting point for subsequent extrinsic parameter optimization and enabling online estimation of timevarying camera-IMU extrinsic parameters. Simulation experiments demonstrate that the proposed framework can effectively accommodate variations in camera-IMU extrinsic parameters while maintaining competitive localization accuracy.

0.14

IMU-Free Body-Frame State Estimation with Sparse Scene Flow for Quadcopters

cs.RO cs.CV ·2026-08-21 ·Daniel Grønhaug, Sofie Markeset, Mathias Kolberg
similarity 0.60
Abstract · 56 pages, 5 figures, 2 tables. Evaluated on the VID dataset (arXiv:2103.11152)

We present a vision-only state estimation system for X-configuration quadcopters equipped with a canonical stereo camera pair and no inertial sensors. The system operates entirely in the body frame, requiring only synchronised stereo images and motor thrust commands. A continuous-discrete extended Kalman filter on a composite manifold state $\langle SE(3), \mathbb{R}^3, \ldots \rangle$ maintains estimates of body-frame pose, velocity, angular velocity, gravity, and disturbances, using stationary scene points as implicit inertial references. Feature points are detected (FAST, Shi-Tomasi), tracked temporally (SSD, Lucas-Kanade) and matched across cameras (NCC), with search regions predicted from filter-derived pose and point uncertainty. Chi-squared gating on the normalised innovation admits only stationary points to the filter. The system also produces a sparse 3D point cloud carrying per-point position, velocity and joint covariance. These come from a 4-view (two stereo pairs at two timestamps) full bundle adjustment that jointly estimates position and velocity from stereo disparity and temporal parallax, with the filter-derived relative pose as a prior. Feature points in the EKF do not enter the solver; their information is reflected through the pose prior. Point cloud density is spatially adaptive: an external focus point directs allocation, producing dense coverage in the region of attention and sparse coverage elsewhere. The output is a body-frame state estimate, a calibrated pose change, and a sparse scene flow. It is intended as a measurement source for a downstream world model anchored in the current body frame, without dependence on GPS, IMU, or any world-frame infrastructure, though the architecture accommodates their future integration.

0.28

Beyond Control Points: Arcsecond Relative-Motion Estimation of Vision Measurement Platforms With Incomplete or Absent Control Fields

cs.CV ·2026-08-14 ·Meng Lian, Jian Wang, Shuixin Pan, Haibo Liu, Yueqiang Zhang +1 more
similarity 0.59
Abstract · 13 pages, 14 figures. Submitted to IEEE Transactions on Image Processing

Long-range vision-based deformation monitoring is highly sensitive to motion of the camera platform. Absolute-pose differencing typically relies on dedicated control data and propagates two independent pose errors into the relative-motion estimate. We develop a control-adaptive differential framework that estimates inter-frame platform motion directly from image displacements and known 3D points. With no dedicated control point, the framework recovers platform rotation from measurement-point observations. One surveyed control point enables prior-constrained translation recovery, while two nonparallel control rays recover full 3D translation. The framework requires neither nonlinear optimization nor an initial pose estimate. Excluding control data from the rotation stage makes the rotation estimate exactly immune to contamination confined to the control field. The inherited differential formulation also cancels translational extrinsic errors exactly. We derive the rotation observability condition, a leakage bound for unmodeled translation and nonrigid point motion, and the single-point axial-prior bias law. Under 0.5-pixel image noise, attitude changes of up to 30~arcmin, and 3D point perturbations of up to 2~mm, the multi-camera estimator achieves a rotation RMSE of 2.97~arcsec and an average runtime of 0.46~ms. With one surveyed control point, its prior-constrained translation RMSE is 1.19~mm. In a bridge experiment without a stable control field, the median coordinate-wise displacement RMSE relative to total-station measurements is 0.85~mm. The estimator also maintains zero divergence under the tested 3D coordinate perturbations on public RGB-D and stereo sequences. These results establish state-of-the-art accuracy, calibration robustness, and computational efficiency among the evaluated methods.

0.42

HeadIO: Body-Frame Heading Decomposition for Neural Inertial Odometry on Head-Mounted Devices

cs.CV cs.RO ·2026-11-11 ·Taeyoung Yeon, Yiquan Li, Chenfeng Gao, Vasco Xu, Karan Ahuja
benchmark similarity 0.59
Abstract · Submitted to ICRA 2027

Inertial odometry (IO) using only Inertial Measurement Units (IMUs) enables camera-free head tracking in head-mounted devices such as VR headsets, AR glasses, and earbuds. Prior IO methods operate in a gravity-aligned world frame, which is not yaw-equivariant. Yaw augmentation improves robustness but does not guarantee equivariance; learned equivariant layers achieve it, but EqNIO's full pipeline costs nearly 3$\times$ the FLOPs of ours. While raw body-frame IMU inputs are inherently yaw-invariant, head tilt redistributes both gravity and motion signals across device axes, making the representation tilt-variant. We propose HeadIO, which combines a body-frame heading decomposition with a bidirectional Mamba backbone for head-mounted inertial odometry. Our decomposition achieves tilt invariance by separating gravity-aligned and horizontal components using only the tilt component of device orientation. We evaluate on four head-mounted datasets and find that HeadIO improves RTE-5s by 8.1% (0.260 m $\to$ 0.239 m) over world-frame methods with learned equivariant layers on Nymeria, the largest benchmark dataset, at nearly 3$\times$ lower FLOPs and 8$\times$ fewer parameters. HeadIO achieves state-of-the-art performance on our primary metric, RTE-5s, on all Aria-glasses datasets, which natively provide body-frame semantics for our decomposition method. We further evaluate the IMU-only deployment scenario on Nymeria, where HeadIO remains state-of-the-art. We show that our method relies mainly on tilt accuracy, which can be obtained from the gravity signal; for yaw, a single-coefficient gyroscope correction removes 11.6% of the yaw error and improves RTE-5s by 2.5%, and sparse external yaw corrections (for example, one every 30 s) can improve RTE-5s by 12.0%. Our decomposition is lightweight, composes with any backbone, and is suitable for real-time deployment on head-mounted devices.

0.18