CS Paper Radar

BronchoTop: Bronchoscopy Navigation via RGB-Only Topological Localization

Clara Tomasini, Ana Cristina Murillo, Luis Riazuelo

cs.CV ·submitted 2026-09-23 16:07 UTC · v1
unusual

Abstract

Accurate localization of the bronchoscope within the bronchial tree is essential for clinicians to be able to reach target lesions, perform biopsies and avoid misidentification of airway segments during diagnostic and therapeutic procedures. However, existing navigation systems typically rely on patient-specific CT scans or additional external sensors, increasing cost, setup time and patient radiation exposure. This work presents BronchoTop, a real-time, RGB-only framework for topological bronchoscopy localization that eliminates the need for patient-specific data. BronchoTop estimates scope location relative to a generic airway model through four modules: lumen detection and tracking, lumen-branch label association, probabilistic scope location estimation, and switch verification. By using only standard bronchoscopy video input, BronchoTop provides practical, real-time navigational assistance to physicians. Evaluation on phantom, simulated and real data demonstrates state-of-the-art accuracy, improving existing approaches performance by over 20% on real bronchoscopy sequences. BronchoTop is the first published framework including both the localization algorithms as well as all the real data used, together with code to generate additional simulations, encouraging and facilitating further developments and benchmarking. The results highlight BronchoTop's potential to enhance procedural safety, efficiency and accessibility in clinical and robotic bronchoscopy.

Closest papers

Nearest neighbours by meaning across the whole index.

Dense Endoluminal Mapping and Localisation from Monocular Bronchoscopy

cs.CV ·2026-10-12 ·Salvatore Esposito, Matias Mattamala, Daniel Rebain, Liang Zhao, Kev Dhaliwal +2 more
similarity 0.72
Abstract

Bronchoscopy inserts a camera through the airways to diagnose endoluminal disease. Locating the camera along the airway usually requires additional equipment, such as an electromagnetic tracker and a preoperative CT scan. In this paper, we investigate the use of the monocular camera stream to localise the bronchoscope without requiring additional sensing. We introduce a monocular SLAM system that localises the tip of a bronchoscope and reconstructs the airway surface around it from RGB video alone. A Depth Anything 3 backbone, fine-tuned on over a million photorealistic airway renderings, returns metric per-pixel depth and is the system's only source of scale. DINOv3 features routed through a custom cross-attention matcher supply sub-pixel correspondences on mucosa where classical descriptors fail. Both enter a factor graph alongside a dense constraint from projective iterative closest point (ICP) registration against the system's own running reconstruction, so surface evidence stabilises the directions the visual factors leave weakly observable. On six airways rendered from patient CT scans, the system reaches 26.1 mm mean absolute trajectory error and 77.5% mean surface F-score. Its mean surface accuracy exceeds that of five recent monocular SLAM and feed-forward baselines. MASt3R-SLAM, which fits a free scale to the ground truth, has a lower mean trajectory error (22.0 mm). ORB-SLAM3 completes only two of the six airways, whereas our system completes all six and also reconstructs two ex vivo specimens.

0.16

DUNEDepth: Bronchoscopic Depth and Pose Estimation via Hybrid Adaptation of a 3D-Vision Foundation Model

eess.IV cs.CV ·2026-11-02 ·Qi Chang, Austin Kao, Ange Lou, William E. Higgins
published similarity 0.64
Abstract · 10 pages, 4 figures, 3 tables. Accepted to MICAD 2026 (International Conference on Medical Imaging and Computer-Aided Diagnosis), Edinburgh,…

State-of-the-art bronchoscopy guidance systems and computer-aided diagnosis methods have emerged as important tools for early lung cancer detection. Effective use of these tools depends on being able to accurately link a patient's bronchoscopic airway exam video to their pre-operative 3D chest CT scan. Unfortunately, the derivation of such links, which include bronchoscope depth and camera motion, from the exam video remains an open problem. Building on recently proposed 3D-vision foundation models, we propose DUNEDepth, a hybrid architecture that combines a shared DUNE ViT encoder, a twin MASt3R cross-attention decoder structure, and a prediction head that includes elements of the MASt3R and Reloc3r models. To fine-tune the architecture to our application, we utilize an integrated hybrid synthetic-supervised/self-supervised training strategy that draws on both bronchoscopic video and CT-derived virtual bronchoscopic views. Experiments drawing on bronchoscopic video sequences demonstrate that DUNEDepth more accurately derives depth information and camera motion trajectories than previously proposed self-supervised methods.

0.31

Anatomy-Aware Prediction of Bronchoscopic Accessibility from 3D CT

cs.CV ·2026-09-29 ·Linkai Peng, Cuiling Sun, Bin Wang, Jamie Rowell, Catherine Gao +8 more
top venuebenchmark similarity 0.62
Abstract · Accepted in MICCAI 2026

Pre-operative planning for bronchoscopy is critical for the diagnosis of lung lesions. Current accessibility assessment relies on subjective manual inspection of CT scans, which is time-consuming and prone to inter-observer variability. In this paper, we formalize bronchoscopy accessibility prediction as a novel supervised learning task and present the first end-to-end framework to address it. We propose an Anatomy-Aware Mixture-of-Experts (MoE) model that integrates specialized modules: a CT Expert for local morphological features, a Lobe Expert for anatomical priors, and a Path Geometry Expert that encodes the sequential constraints of the bronchial tree. To support this task, we curated the first clinical dataset of 438 cases with pre-operative CT scans and documented procedural outcomes. Experimental results demonstrate that our method achieves an AUROC of 0.8052, significantly outperforming both state-of-the-art baselines and experienced human experts. This work establishes a new benchmark for computer-aided interventional planning in pulmonary medicine. Our data and code will be publicly available at https://nubagcilab.github.io/BronchoAccess/.

0.37

Airway cross-sectional area measurement using quantitative endoscopy with AI-enabled depth estimation: A proof-of-concept study

eess.IV ·2026-09-25 ·Amirsajjad Taleban, Jake Luo, Christopher E. Larkee, B. Tucker Woodson, Ryan Puccia +2 more
similarity 0.58
Abstract · 37 pages, 12 figures

Endoscopy is widely used in medicine to visualize anatomical structures for diagnosis and treatment evaluation. However, it does not currently allow rapid, quantitative measurement of airway cross-sectional area (CSA), a key metric for diagnosing and managing respiratory pathologies. There is growing interest in AI-enabled quantitative endoscopy using depth estimation, but a fundamental challenge is the need for ground-truth depth data to train algorithms capable of quantifying depth in physical units (e.g., meters). In this study, 60,000 paired virtual endoscopy images and depth maps were created in Blender from 3D airway models built from computed tomography. A U-Net convolutional neural network was trained to predict the depth maps from the endoscopy images. Point clouds were reconstructed from the AI-generated depth maps using the Equisolid fisheye lens model, and airway perimeters were identified by intersecting a plane with the point cloud to estimate CSA. Nasopharyngeal CSA, a key metric in obstructive sleep apnea, was quantified using this AI-enabled approach with a median error of 5.3 \% relative to the 3D model ground-truth. This pilot study using synthetic data provides strong evidence for the feasibility of developing AI-enabled quantitative endoscopy for airway CSA measurement.

0.35

Anchored Fusion for Automated Airway Segmentation in Pediatric and Adult CT

eess.IV cs.CV ·2026-10-28 ·Huseyin Umut Isik, Ege Mert Balcik, Duygu Atasoy, Asutosh Sahu, Seyda Ertekin +1 more
code/dataunusual similarity 0.55
Abstract · 9 pages, 3 figures, 2 tables. Code, weights and web application: https://github.com/quin-med-harvard-edu/airway-seg

Airway segmentation from chest CT enables branch-level measurement of airway size and growth, but peripheral bronchi remain hard to segment, particularly in children, whose airways are smaller and for whom few annotated scans exist. Different models recover complementary branches of the airway tree. Their union improves overall tree coverage but also introduces disconnected non-airway objects. We propose anchored fusion (A-Fuse), which takes the voxel-wise union of TfeNet, a retrained MEDPSeg and a reimplemented AirMorph and retains the connected component with greatest overlap with the AirMorph mask. On 30 held-out adult CTs from the ATM'26 training set, A-Fuse reaches a Dice score of 93.24% and the highest branch detection rate among compared methods (92.05%). On nine pediatric scans, it reaches 94.15% Dice and 68.79% branch detection. A-Fuse retains the airway tree in all 39 test scans, whereas keeping the largest component selects a non-airway object in four. A-Fuse is deployed as an automated web application and we release all code, trained weights and an open-source ITK-SNAP extension for 3D tubular segmentation editing.

0.41

Investigating the trackability of landmarks in NBI and WLI

eess.IV cs.CV ·2026-10-23 ·Jonas Below, Piermarco Gerli, Anna Jötten, Dennis Eggert, Axelle Felicio-Briegel +3 more
similarity 0.55
Abstract · Accecpted at CURAC conference 2026

Reliable visual tracking of anatomical landmarks in endoscopic video is a key prerequisite for computer-assisted interventions in laryngeal surgery. While Narrow Band Imaging (NBI) is clinically established for enhancing vascular contrast, its effect on automated tracking relative to conventional White Light Imaging (WLI) remains unexplored. We present a quantitative comparison of landmark trackability in NBI and WLI using a forward-backward error framework applied to 61 endoscopic videos from 39 patients. Two regions of interest are evaluated: the vocal folds (VF) and mucosa with a prominent vascular pattern (MPVP). We compare a classical feature-based tracker (CSRT) against learning-based point trackers (CoTracker3-Online and TrackOnR) across both modalities. NBI consistently reduced the forward-backward error in both regions, reaching statistical significance for the vocal folds, while failure rates stayed low. These findings indicate that NBI can improve tracking robustness in laryngeal endoscopy, with implications for motion analysis, navigation, and robotic assistance.

0.24

CT-RespGeomLib: Deterministic reconstruction of CT airway masks into editable,port-matched lumen geometry

eess.SY ·2026-11-12 ·Nichula Wasalathilaka, Kevin Dawson, Chinthaka Jacob, Mervyn Parakrama Ekanayake, Roshan Godaliyadda
similarity 0.54
Abstract

Patient-specific airway modelling requires geometrically consistent lumen surfaces with identifiable boundaries and support for controlled anatomical modifications. We present CT-RespGeomLib, a deterministic framework that converts CT airway masks into two complementary representations: an editable assembly of semantically labelled pipe and junction blocks connected through canonical shared ports, and a fused lumen surface reconstructed from tapered implicit primitives with validated port-to-boundary loop correspondence. The parametric representation further enables localised modelling of airway stenosis and dilation without re-segmentation. Evaluated on 42 reference airway masks from ATM22 (15 cases) and AeroPath (27 cases), the framework produced 37 topologically accepted reconstructions, with a median port-to-loop distance of 0.123 mm across 2174 matched ports. Reconstructed and reference equivalent radii showed strong agreement ($R^2 = 0.976$), with a mean bias of -0.414 mm arising primarily from the circular, inscribed-radius representation. Controlled pathology modelling generated 40 variants across five patient-specific geometries, including 25-75% stenosis and 50% dilation at tracheal and main-bronchus locations. Prescribed radius changes were reproduced with a mean absolute ratio error of 0.0056, while the median 95th-percentile deviation outside the modified region was 0.111 mm. Downstream applicability was demonstrated through volume meshing and an OpenFOAM simulation with individually prescribed model-based resistance conditions at 62 outlets. Although additional surface preparation may be required for numerical meshing, CT-RespGeomLib provides a reproducible framework for CT-derived airway reconstruction, quantitative boundary validation and controlled geometric pathology modelling.

0.23

An Interactive Mobile Augmented Reality System for Efficient Virtual Model-to-Patient Registration in Thoracic Surgery

cs.HC ·2026-10-27 ·Emmanuel Ajaero, Pascal Spiegler, George Rakovich, Marta Kersten-Oertal, Yiming Xiao
similarity 0.54
Abstract

Video-Assisted Thoracoscopic Surgery (VATS) is a minimally invasive procedure, where precise surgical port placement is vital, yet it relies heavily on surgeon experience and mental mapping of pre-operative imaging in the operating room. To address this challenge, we present an accessible, interactive mobile augmented reality (AR) framework, HILMARTS, to enable accurate and efficient pre-operative virtual model-to-patient registration for AR-guided surgical navigation. Our system runs on a commercially available LiDAR-equipped iPad and supports a user-in-the-loop workflow through a two-stage coarse-to-fine registration process. First, the user performs a manual alignment using the AR view on the iPad. This initial maneuver is then refined through automatic point-cloud registration leveraging the LiDAR sensor. We further introduce a novel occupancy-grid-based Surface Coverage Score to provide real-time, actionable feedback to the operator on the geometric completeness of LiDAR data capture for reliable point-cloud-based alignment. In a phantom study with 16 participants, the system achieved a 3.31+/-1.26mm registration accuracy in ~4 min with a mean System Usability Scale (SUS) of 84.1. These findings highlight the system's accuracy, efficiency, robustness, and potential clinical usability, and could support its applicability to other AR-based surgical navigation tasks.

0.11