CS Paper Radar

Airway cross-sectional area measurement using quantitative endoscopy with AI-enabled depth estimation: A proof-of-concept study

Amirsajjad Taleban, Jake Luo, Christopher E. Larkee, B. Tucker Woodson, Ryan Puccia, John S. Rhee, Guilherme J. M. Garcia

eess.IV ·submitted 2026-09-25 20:23 UTC · v1

Abstract

Endoscopy is widely used in medicine to visualize anatomical structures for diagnosis and treatment evaluation. However, it does not currently allow rapid, quantitative measurement of airway cross-sectional area (CSA), a key metric for diagnosing and managing respiratory pathologies. There is growing interest in AI-enabled quantitative endoscopy using depth estimation, but a fundamental challenge is the need for ground-truth depth data to train algorithms capable of quantifying depth in physical units (e.g., meters). In this study, 60,000 paired virtual endoscopy images and depth maps were created in Blender from 3D airway models built from computed tomography. A U-Net convolutional neural network was trained to predict the depth maps from the endoscopy images. Point clouds were reconstructed from the AI-generated depth maps using the Equisolid fisheye lens model, and airway perimeters were identified by intersecting a plane with the point cloud to estimate CSA. Nasopharyngeal CSA, a key metric in obstructive sleep apnea, was quantified using this AI-enabled approach with a median error of 5.3 \% relative to the 3D model ground-truth. This pilot study using synthetic data provides strong evidence for the feasibility of developing AI-enabled quantitative endoscopy for airway CSA measurement.

Comment
37 pages, 12 figures

Closest papers

Nearest neighbours by meaning across the whole index.

Dense Endoluminal Mapping and Localisation from Monocular Bronchoscopy

cs.CV ·2026-10-12 ·Salvatore Esposito, Matias Mattamala, Daniel Rebain, Liang Zhao, Kev Dhaliwal +2 more
similarity 0.64
Abstract

Bronchoscopy inserts a camera through the airways to diagnose endoluminal disease. Locating the camera along the airway usually requires additional equipment, such as an electromagnetic tracker and a preoperative CT scan. In this paper, we investigate the use of the monocular camera stream to localise the bronchoscope without requiring additional sensing. We introduce a monocular SLAM system that localises the tip of a bronchoscope and reconstructs the airway surface around it from RGB video alone. A Depth Anything 3 backbone, fine-tuned on over a million photorealistic airway renderings, returns metric per-pixel depth and is the system's only source of scale. DINOv3 features routed through a custom cross-attention matcher supply sub-pixel correspondences on mucosa where classical descriptors fail. Both enter a factor graph alongside a dense constraint from projective iterative closest point (ICP) registration against the system's own running reconstruction, so surface evidence stabilises the directions the visual factors leave weakly observable. On six airways rendered from patient CT scans, the system reaches 26.1 mm mean absolute trajectory error and 77.5% mean surface F-score. Its mean surface accuracy exceeds that of five recent monocular SLAM and feed-forward baselines. MASt3R-SLAM, which fits a free scale to the ground truth, has a lower mean trajectory error (22.0 mm). ORB-SLAM3 completes only two of the six airways, whereas our system completes all six and also reconstructs two ex vivo specimens.

0.16

DUNEDepth: Bronchoscopic Depth and Pose Estimation via Hybrid Adaptation of a 3D-Vision Foundation Model

eess.IV cs.CV ·2026-11-02 ·Qi Chang, Austin Kao, Ange Lou, William E. Higgins
published similarity 0.64
Abstract · 10 pages, 4 figures, 3 tables. Accepted to MICAD 2026 (International Conference on Medical Imaging and Computer-Aided Diagnosis), Edinburgh,…

State-of-the-art bronchoscopy guidance systems and computer-aided diagnosis methods have emerged as important tools for early lung cancer detection. Effective use of these tools depends on being able to accurately link a patient's bronchoscopic airway exam video to their pre-operative 3D chest CT scan. Unfortunately, the derivation of such links, which include bronchoscope depth and camera motion, from the exam video remains an open problem. Building on recently proposed 3D-vision foundation models, we propose DUNEDepth, a hybrid architecture that combines a shared DUNE ViT encoder, a twin MASt3R cross-attention decoder structure, and a prediction head that includes elements of the MASt3R and Reloc3r models. To fine-tune the architecture to our application, we utilize an integrated hybrid synthetic-supervised/self-supervised training strategy that draws on both bronchoscopic video and CT-derived virtual bronchoscopic views. Experiments drawing on bronchoscopic video sequences demonstrate that DUNEDepth more accurately derives depth information and camera motion trajectories than previously proposed self-supervised methods.

0.31

Anatomy-Aware Prediction of Bronchoscopic Accessibility from 3D CT

cs.CV ·2026-09-29 ·Linkai Peng, Cuiling Sun, Bin Wang, Jamie Rowell, Catherine Gao +8 more
top venuebenchmark similarity 0.60
Abstract · Accepted in MICCAI 2026

Pre-operative planning for bronchoscopy is critical for the diagnosis of lung lesions. Current accessibility assessment relies on subjective manual inspection of CT scans, which is time-consuming and prone to inter-observer variability. In this paper, we formalize bronchoscopy accessibility prediction as a novel supervised learning task and present the first end-to-end framework to address it. We propose an Anatomy-Aware Mixture-of-Experts (MoE) model that integrates specialized modules: a CT Expert for local morphological features, a Lobe Expert for anatomical priors, and a Path Geometry Expert that encodes the sequential constraints of the bronchial tree. To support this task, we curated the first clinical dataset of 438 cases with pre-operative CT scans and documented procedural outcomes. Experimental results demonstrate that our method achieves an AUROC of 0.8052, significantly outperforming both state-of-the-art baselines and experienced human experts. This work establishes a new benchmark for computer-aided interventional planning in pulmonary medicine. Our data and code will be publicly available at https://nubagcilab.github.io/BronchoAccess/.

0.37

BronchoTop: Bronchoscopy Navigation via RGB-Only Topological Localization

cs.CV ·2026-09-23 ·Clara Tomasini, Ana Cristina Murillo, Luis Riazuelo
unusual similarity 0.58
Abstract

Accurate localization of the bronchoscope within the bronchial tree is essential for clinicians to be able to reach target lesions, perform biopsies and avoid misidentification of airway segments during diagnostic and therapeutic procedures. However, existing navigation systems typically rely on patient-specific CT scans or additional external sensors, increasing cost, setup time and patient radiation exposure. This work presents BronchoTop, a real-time, RGB-only framework for topological bronchoscopy localization that eliminates the need for patient-specific data. BronchoTop estimates scope location relative to a generic airway model through four modules: lumen detection and tracking, lumen-branch label association, probabilistic scope location estimation, and switch verification. By using only standard bronchoscopy video input, BronchoTop provides practical, real-time navigational assistance to physicians. Evaluation on phantom, simulated and real data demonstrates state-of-the-art accuracy, improving existing approaches performance by over 20% on real bronchoscopy sequences. BronchoTop is the first published framework including both the localization algorithms as well as all the real data used, together with code to generate additional simulations, encouraging and facilitating further developments and benchmarking. The results highlight BronchoTop's potential to enhance procedural safety, efficiency and accessibility in clinical and robotic bronchoscopy.

0.32

Anchored Fusion for Automated Airway Segmentation in Pediatric and Adult CT

eess.IV cs.CV ·2026-10-28 ·Huseyin Umut Isik, Ege Mert Balcik, Duygu Atasoy, Asutosh Sahu, Seyda Ertekin +1 more
code/dataunusual similarity 0.57
Abstract · 9 pages, 3 figures, 2 tables. Code, weights and web application: https://github.com/quin-med-harvard-edu/airway-seg

Airway segmentation from chest CT enables branch-level measurement of airway size and growth, but peripheral bronchi remain hard to segment, particularly in children, whose airways are smaller and for whom few annotated scans exist. Different models recover complementary branches of the airway tree. Their union improves overall tree coverage but also introduces disconnected non-airway objects. We propose anchored fusion (A-Fuse), which takes the voxel-wise union of TfeNet, a retrained MEDPSeg and a reimplemented AirMorph and retains the connected component with greatest overlap with the AirMorph mask. On 30 held-out adult CTs from the ATM'26 training set, A-Fuse reaches a Dice score of 93.24% and the highest branch detection rate among compared methods (92.05%). On nine pediatric scans, it reaches 94.15% Dice and 68.79% branch detection. A-Fuse retains the airway tree in all 39 test scans, whereas keeping the largest component selects a non-airway object in four. A-Fuse is deployed as an automated web application and we release all code, trained weights and an open-source ITK-SNAP extension for 3D tubular segmentation editing.

0.41

Augmenting Real-time Visualization in Minimally Invasive Surgery with Particle Filtering and Depth-Aware Occlusion Handling

eess.IV cs.RO ·2026-10-13 ·Anuska Sarkar, Partha Acharya, Vishnu Nandury, Kaustav Basu, Subhamoy Mandal
top venue similarity 0.57
Abstract · Accept

We present a real-time, hybrid framework for occlusion handling and depth-aware tracking in minimally invasive surgeries (MIS). Occlusions caused by surgical instruments often obscure the region of interest (ROI), affecting surgical precision. To address this, our approach integrates enhanced You Only Look Once (YOLO) based detection, Particle Filtering (PF), and monocular depth estimation using Multiple Depth Estimation Accuracy with Single Network (MiDaS). Occlusion is detected using a distance-based threshold between instruments and ROI. Experimental results demonstrate robust instrument detection with a confidence score of 0.85, effective occlusion event handling, and accurate depth prediction with an MAE of 0.34 cm and RMSE of 0.53 cm. Independent phantom-based validation against stereo depth measurements yielded an MAE of 0.65 cm and RMSE of 0.66 cm. The framework further achieved an occlusion detection accuracy of 81.95\% while maintaining real-time performance at 38.7 FPS. Preliminary surgeon feedback indicates that the proposed visualization framework is clinically relevant and holds promise for future intraoperative image-guided navigation and decision support in MIS.

0.31

iMED: A Multi-Endoscope Dataset for Surgical 3D Perception

cs.CV cs.RO ·2026-11-03 ·Sierra Bonilla, Fengyi Jiang, Chinedu Nwoye, Jingpei Lu, Kailey Reardon +5 more
top venuebenchmarkcode/data similarity 0.56
Abstract · Published at ECCV 2026. 25 pages, including supplementary material. Code and dataset: https://github.com/surgical-vision/imed

We introduce iMED, the first synchronized multi-endoscope dataset for robot-assisted minimally invasive surgery (RAMIS), designed to address a fundamental limitation in surgical vision benchmarking: the absence of independent held-out viewpoints. Existing surgical datasets capture single-trajectory sequences from a single endoscope, making it impossible to distinguish geometric generalization from photometric interpolation along a narrow forward-facing path. iMED provides 340 sequences ~170K synchronized timepoints with 4 views per timepoint) recorded simultaneously from two independent stereo endoscopes across ex vivo, postmortem, and live surgical settings, spanning 14 specimens with diverse anatomical regions and motion regimes. The dataset includes calibrated camera intrinsics, ArUco-based frame-wise pose estimates with uncertainty quantification, instrument segmentation masks, and rich clinical metadata. Using a train-on-one-endoscope, test-on-another evaluation protocol, we benchmark 23 state-of-the-art methods across rigid and deformable novel view synthesis, pose estimation, feature matching, and monocular depth estimation. Our experiments show that methods relying primarily on photometric supervision degrade substantially under this held-out-endoscope setting, while methods with explicit geometric regularization are more robust across views in our benchmark. Notably, large-scale foundation models transfer surprisingly well to surgical imagery, often outperforming domain-specific models, suggesting pitfalls in current fine-tuning protocols. iMED establishes a new evaluation protocol for geometric generalization in surgical vision.

0.70

CT-RespGeomLib: Deterministic reconstruction of CT airway masks into editable,port-matched lumen geometry

eess.SY ·2026-11-12 ·Nichula Wasalathilaka, Kevin Dawson, Chinthaka Jacob, Mervyn Parakrama Ekanayake, Roshan Godaliyadda
similarity 0.56
Abstract

Patient-specific airway modelling requires geometrically consistent lumen surfaces with identifiable boundaries and support for controlled anatomical modifications. We present CT-RespGeomLib, a deterministic framework that converts CT airway masks into two complementary representations: an editable assembly of semantically labelled pipe and junction blocks connected through canonical shared ports, and a fused lumen surface reconstructed from tapered implicit primitives with validated port-to-boundary loop correspondence. The parametric representation further enables localised modelling of airway stenosis and dilation without re-segmentation. Evaluated on 42 reference airway masks from ATM22 (15 cases) and AeroPath (27 cases), the framework produced 37 topologically accepted reconstructions, with a median port-to-loop distance of 0.123 mm across 2174 matched ports. Reconstructed and reference equivalent radii showed strong agreement ($R^2 = 0.976$), with a mean bias of -0.414 mm arising primarily from the circular, inscribed-radius representation. Controlled pathology modelling generated 40 variants across five patient-specific geometries, including 25-75% stenosis and 50% dilation at tracheal and main-bronchus locations. Prescribed radius changes were reproduced with a mean absolute ratio error of 0.0056, while the median 95th-percentile deviation outside the modified region was 0.111 mm. Downstream applicability was demonstrated through volume meshing and an OpenFOAM simulation with individually prescribed model-based resistance conditions at 62 outlets. Although additional surface preparation may be required for numerical meshing, CT-RespGeomLib provides a reproducible framework for CT-derived airway reconstruction, quantitative boundary validation and controlled geometric pathology modelling.

0.30