CS Paper Radar

Same Measurements, Different Velocity Risk: Complementary Rolling-Shutter Readouts under Clock Uncertainty

Lunshuo Tian, Dongheng Liu, Mingwei Ma

cs.CV ·submitted 2026-11-07 15:00 UTC · v1
theoryunusual

Abstract

Camera rigs with identical measurement budgets can have different velocity estimation rates when exposure timing is uncertain. We establish this distinction for rolling-shutter reconstruction with two calibrated moving anchors, unknown scene points, and independently unknown auxiliary poses and clocks. On the same fixed local physical class near a separated lateral rig, repeated readouts have worst-case squared velocity risk at least of order $σρ_{\mathrm{eff}}$, whereas complementary readouts have minimax risk of order $σ^2$, for a fixed admissible clock displacement $ρ_{\mathrm{eff}}>0$ as the noise standard deviation $σ$ tends to zero. A finite physical compensation path gives the lower bound; a nonlinear velocity inverse proves complementary stability. All motion, structure, pose, and clock nuisances remain unknown. We identify mounting configurations in which both designs become regular and quantify the risk floor induced by metric uncertainty. We quantify full-parameter domains with independent 6-ms clocks and test in-domain reconstruction under paired noise and a depth-offset intervention. Raster studies examine image formation and calibration sensitivity.

Comment
36 pages, including appendices. Lunshuo Tian and Dongheng Liu contributed equally

Closest papers

Nearest neighbours by meaning across the whole index.

Beyond Control Points: Arcsecond Relative-Motion Estimation of Vision Measurement Platforms With Incomplete or Absent Control Fields

cs.CV ·2026-08-14 ·Meng Lian, Jian Wang, Shuixin Pan, Haibo Liu, Yueqiang Zhang +1 more
similarity 0.59
Abstract · 13 pages, 14 figures. Submitted to IEEE Transactions on Image Processing

Long-range vision-based deformation monitoring is highly sensitive to motion of the camera platform. Absolute-pose differencing typically relies on dedicated control data and propagates two independent pose errors into the relative-motion estimate. We develop a control-adaptive differential framework that estimates inter-frame platform motion directly from image displacements and known 3D points. With no dedicated control point, the framework recovers platform rotation from measurement-point observations. One surveyed control point enables prior-constrained translation recovery, while two nonparallel control rays recover full 3D translation. The framework requires neither nonlinear optimization nor an initial pose estimate. Excluding control data from the rotation stage makes the rotation estimate exactly immune to contamination confined to the control field. The inherited differential formulation also cancels translational extrinsic errors exactly. We derive the rotation observability condition, a leakage bound for unmodeled translation and nonrigid point motion, and the single-point axial-prior bias law. Under 0.5-pixel image noise, attitude changes of up to 30~arcmin, and 3D point perturbations of up to 2~mm, the multi-camera estimator achieves a rotation RMSE of 2.97~arcsec and an average runtime of 0.46~ms. With one surveyed control point, its prior-constrained translation RMSE is 1.19~mm. In a bridge experiment without a stable control field, the median coordinate-wise displacement RMSE relative to total-station measurements is 0.85~mm. The estimator also maintains zero divergence under the tested 3D coordinate perturbations on public RGB-D and stereo sequences. These results establish state-of-the-art accuracy, calibration robustness, and computational efficiency among the evaluated methods.

0.42

OffBeat: Multicoset Sampling for 4D Capture Beyond the Camera Frame Rate

cs.CV eess.IV ·2026-11-19 ·Chi-Wei Lee, An-Kai Chen, Cheng-Han Chiang, Yi-Chun Chang, Po-Chih Kuo
code/data similarity 0.59
Abstract · Project page: https://arthur031221.github.io/offbeat/

For 4D reconstruction, a synchronized multi-camera rig records all views at the same timestamps and misses the motion between them. Staggered triggers spread the same frames over more timestamps. However, when the cameras along each row fire one after another, as in 4DSloMo's schedule on the N3DV rig, the row acts as one moving camera that confounds depth with motion. We introduce OffBeat, which models a staggered rig as a spatially distributed multicoset sampler: shifted copies of one sampling grid. From the calibration alone, OffBeat derives camera groups that fire together and their firing order. Since one group records each timestamp, a short-lived primitive can fit an error its cameras share, such as a color offset, and flicker in novel views. We show that a primitive's opacity over time weights all groups equally, for every number of groups, only if it lasts at least one camera frame interval. On Spacetime Gaussians, a minimum lifetime approximates this bound, and a closed-form smoothed box of that length satisfies it exactly, with less flicker than a Gaussian in its place at nearly equal PSNR. In simulated staggered capture on N3DV, OffBeat outperforms the full 4DSloMo pipeline with video diffusion on every test frame, by 3.04 dB in mean dynamic-region PSNR. Between the first and last synchronized frame, it outperforms the best synchronized method of each scene, with or without frame interpolation, by 1.98 dB in mean dynamic-region PSNR, while synchronized capture is better at its own frames. On PanopticSports, in this frame range, OffBeat is comparable in PSNR to synchronized capture with interpolation. On every N3DV scene, replacing 4DSloMo's schedule with ours raises the dynamic-region PSNR of Spacetime Gaussians, 4DSloMo without diffusion, and our reconstruction. Multi-camera rigs could follow faster motion at the same frame count by changing only when each camera fires.

0.40

Seeing Through the Displaced Frame: Privileged Noise Distillation for Vision-Force Precision Assembly

cs.RO ·2026-10-06 ·Ching-Hsiang Chang, Tzu-Yu Chuang, Yi-Hsiu Lee, Yi-Ting Chen, Yuan-Fu Yang +1 more
benchmarkcode/data similarity 0.57
Abstract · 8 pages

Pose error in precision assembly can corrupt not only what a robot observes but also the coordinate frame in which it acts. On the FORGE benchmark, the official state-based policy succeeds in 97% to 99% of episodes with the true pose but only 32% to 60% at the benchmark's $σ=5$ mm pose-noise setting. The same estimated pose enters the observation and anchors the action frame, making the offset unidentifiable from proprioceptive state alone before contact. We supply this missing information during training in two ways. A privileged teacher observes the offset in simulation, while clean demonstrations can instead be relabelled into the displaced frame in closed form. The deployed student is trained with behaviour cloning followed by one DAgger round and receives only noisy state, a raw wrench window, and two RGB cameras at test time. On the unmodified FORGE tasks, the teacher-route student maintains 92% to 99% success across $σ=0$ to 5 mm, while six non-privileged baselines fall to 2% to 80%. A matched behaviour-cloning experiment isolates the source of this robustness. With the same student architecture, data budget, and training procedure, demonstrations generated without offset access yield only 31.5% success at $σ=5$ mm, whereas privileged and relabelled demonstrations reach 88.7% and 95.8%. Deployed zero-shot on a Franka, the student reaches 83.3% pooled success at $σ=5$ mm against 34.4% for the strongest state-based policy. Deployable sensing alone is insufficient. Robustness requires supervision that encodes compensation for the latent frame offset.Project page: https://drychang.github.io/displaced-frame/

0.36

SyncHeC: Markerless Spatio-Temporal Hand-Eye Calibration via Differentiable Rendering and Continuous-Time Joint Optimization

cs.RO ·2026-11-02 ·Zhengdong Hong
similarity 0.55
Abstract

Markerless hand-eye calibration under continuous motion requires jointly resolving camera geometry and the time offset between images and joint states. We present SyncHeC (Synchronized Hand-Eye Calibration), a dense differentiable-rendering framework that estimates both from a single robot trajectory. Continuous-time forward kinematics makes latency differentiable, metric depth complements mask contours, and an offline planner combines spatial sensitivity with temporal excitation. Alternating updates support Eye-to-Hand, Eye-in-Hand, and multi-camera calibration. On a 7-DoF arm, one $6.5$\,s motion yields $0.21$\,cm translation error against a marker-board reference, $0.34$\,cm touch-test error, and $2.7$\,ms latency error relative to an $87$\,ms reference with $95\%$ uncertainty of $\pm1.5$\,ms. Against CM-Calib on matched recordings, translation and nominal latency errors improve by $3.7\times$ and $2.3\times$. Experiments span seven arms and four depth sensors. Compensating the recovered offset during policy training and deployment increases success by $8.1$ percentage points across six families and six tasks ($1{,}800$ matched pairs; paired $95\%$ confidence interval $[6.3,9.9]$ points).

0.15

Decoding Motion-Blurred QR Codes: Motion-Parameter Error Tolerance and Model-Based Recovery

eess.IV ·2026-10-26 ·Zhi Zeng, Qiaochen Su, Si Xiong, Yaoqi Wang, Yufei Cai +2 more
benchmark similarity 0.55
Abstract · 13 pages, 5 figures, and 13-page supplementary material

Quick Response (QR) code deblurring must ultimately recover the encoded payload, yet how accurately the underlying camera motion must be estimated remains an open question. To address this question, we formulate motion-blurred QR recovery within a unified mathematical framework of identifiability and systematically measure the decoding tolerance to perturbations in motion length, direction, rotation or scaling centre, and speed profile. These controlled experiments reveal three structural laws: 1) parameter tolerances shrink rapidly as blur amplitude grows and are tightest under uniform speed, whereas accelerating motion is substantially more forgiving; 2) length tolerance can differ markedly between underestimation and overestimation; 3) errors that are individually benign interact strongly and prevent decoding when combined. Guided by these findings, we propose a grey-box recovery pipeline in which two compact networks predict an initial corner trajectory, followed by tolerance-guided candidate search, alternating image-and-path fitting, and regularised linear inversion. On a new benchmark of 955 handheld motion-blurred photographs captured across four phone models and four motion categories, our method recovers the exact payload on 93.1% of the images, outperforming the strongest fine-tuned deblurring network at 83.6% and reducing the decoding error rate by 58.0%.

0.28

Stabilizing Camera-Controlled Novel View Synthesis at Inference Time

cs.CV ·2026-09-03 ·Prajwal Singh, Arjun Badola, Seema Kumari, Hajime Nagahara, Shanmuganathan Raman
similarity 0.55
Abstract

Training-free, camera-controlled novel view synthesis from a single image using pre-trained video diffusion models often becomes unstable under large camera motion and long generation horizons. Existing approaches commonly combine several inference-time components, making it unclear which design choices are most important for stability. This work identifies the amount of camera motion handled by each diffusion pass as the main factor. CamTrol++ splits the camera path into passes that each cover at most a fixed rotation and generates them one after another, so that every pass stays within the range of motion the backbone handles well. A matched study, in which every setting is scored on the same poses of the same $60^\circ$ orbit, shows that geometric error grows steadily with the arc per pass, while a single SVD pass both loses geometry and tends to freeze the camera. Under one shared camera path, CamTrol++ achieves the lowest epipolar error and the best held-out 3D Gaussian Splatting reconstruction among CamTrol, NVS-Solver and WAVE, and reaches the quality of CamTrol with the same pass structure at least $3.2\times$ faster. On real RealEstate10K motion it matches CamTrol at half the run time (NVS-Solver is more faithful but $8\times$ slower). The same procedure also improves 3D reconstruction with a second video backbone, LTX-Video. Geometry-constrained spatial attention, color anchoring at pass boundaries and a registration-free warping pipeline that makes warping $6.1\times$ faster complete the framework. The method remains effective for 56-frame generation and under controlled depth corruption. These results show that careful control of camera motion at inference time can substantially improve the stability of camera-controlled novel view synthesis.

0.20

MonoEgo: Monocular Metric Egocentric Demonstration Capture with Passive Wrist Constellations and Sparse Workstation Anchors

cs.RO ·2026-09-28 ·Jie Xu, Kangjin Yu, Ziyi Jin, Beichen Wang, Zhongpu Xia
similarity 0.54
Abstract

Image-aligned metric demonstrations often require dedicated tracking hardware and synchronization across devices. We present MonoEgo, a capture system that replaces active wrist instrumentation with offline monocular reconstruction. One 90-FPS global-shutter camera observes calibrated passive wrist constellations, sparse workstation anchors, and the scene on a shared image clock. MonoTag SLAM combines marker corners with ORB geometry and uses visual evidence to reject ambiguous planar-marker poses. Its metric Atlas supports interval scale re-anchoring, verified map merging, and retrospective localization of earlier frames supported by the final map. Camera and wrist-constellation outputs retain validity and map provenance, and unsupported motion is left missing. Experiments show metric tracking beyond continuous anchor visibility, reconnection of supported map components, and recovery of some missing camera poses. Comparisons against a multisensor camera reference and separate stationary-constellation tests characterize trajectory agreement and precision while revealing incomplete coverage and residual geometric uncertainty. The results indicate that passive fixtures and offline reconstruction can reduce capture-side requirements. Dynamic accuracy, deployment, and downstream policy benefits require further study.

0.26

Phase-DGS: Phase-guided Dynamic Gaussian Splatting from Unsynchronized Multi-view Video

cs.CV cs.GR ·2026-11-03 ·Hosung Jeon, Jun Young Jeong, Sangwoon Kwak, Joonsoo Kim, Sangmin Kim +3 more
top venuecode/data similarity 0.54
Abstract · Accepted to NeurIPS 2026. Project page: https://oc-dev74.github.io/Phase-DGS/

Spatiotemporal scene reconstruction with Dynamic Gaussian Splatting (DGS) fundamentally depends on perfect temporal synchronization across all cameras, an assumption rarely achievable in practice. Industry-standard synchronization requires expensive specialized hardware and complex setup, while data-driven alternatives including audio-based alignment, geometry matching, and pose tracking remain limited by restrictive environmental or scene-specific assumptions. To overcome these limitations, we propose Phase-DGS, a framework that replaces conventional timestamps with a semantic phase representing each frame's inherent state within the underlying motion cycle. Frames capturing the same motion state share the same phase regardless of which camera records them or when, naturally establishing spatiotemporal correspondence across unsynchronized cameras. We validate Phase-DGS under temporal offsets, frame drops, and camera freezes, achieving up to +8.5 dB PSNR improvement over baselines while enabling seamless integration with existing DGS backbones including RealTime-4DGS and FreeTimeGS.

0.51