CS Paper Radar

DROA-CLIPSeg: Prompt-Guided Thin Crack Segmentation in Low-Light Conditions

Vinita Shukla, Partibha Jangra, Vinayak Pathak, Praful Hambarde, Amit Shukla

cs.CV cs.AI ·submitted 2026-10-24 12:29 UTC · v1
publishedcode/data

Abstract

Pavement crack segmentation under low light is degraded by reduced contrast, shadows, headlight glare, joints, stains, and wet seams. Existing crack segmentation methods mostly assume good illumination. Low-light enhancement methods improve visual quality, but they do not explicitly preserve crack topology. To address these limitations, we formulate low-light crack segmentation as a degradation-aware, prompt-grounded structural defect segmentation problem and propose DROA-CLIPSeg, a parameter-efficient framework that adapts a frozen CLIPSeg vision language backbone using two lightweight modules. QKV Low-Rank Adaptation is injected into the Q/K/V projections of the vision and text encoders to improve crack-specific image text alignment without backbone fine-tuning. The proposed Domain Residual Orthogonal Adapter (DROA) decomposes intermediate features into a dominant crack-domain branch, which captures recurring low-light crack patterns, and an orthogonal residual branch, which preserves faint, thin, and fragmented evidence usually suppressed by noise, shadow, or over-smoothing. We also introduce CrackLingo-9K and CrackLingo-12K, text augmented versions of Crack9k and Crack12k with crack-aware prompts. Training only approximately 1.93 M parameters, corresponding to 1.3% of the full model, DROA-CLIPSeg outperforms 9 zero-shot and 4 fine-tuned vision language baselines on both splits, generalises zero-shot to MVTec AD across textures and defect morphologies, and is supported by extensive ablations. Our source code is publicly available at https://github.com/VShuklacode/DROA-CLIPSeg

Comment
Accepted at the 37th British Machine Vision Conference (BMVC 2026)

Closest papers

Nearest neighbours by meaning across the whole index.

Inspect Any Crack: An Automated End-to-End Crack Segmentation and Severity Assessment Framework

cs.CE ·2026-10-09 ·Ghodsiyeh Rostami, Po-Han Chen, Mahdi S. Hosseini
similarity 0.61
Abstract

Image-based crack analysis is essential for automated infrastructure inspection to reduce the cost, subjectivity, and safety risks of manual surveys. Despite advances in visual crack detection, methods that translate predictions into physically meaningful and engineering-interpretable crack condition information remain limited. To bridge this gap, this study proposes Inspect Any Crack (IAC), an innovative end-to-end crack recognition and condition assessment framework that automatically derives physical geometric measurements and continuous severity scores from concrete-crack imagery. At its core, IAC introduces SACv2-Tiny, an efficient crack segmentation model adapted from a vision foundation model. Trained on the challenging OmniCrack30K dataset, SACv2-Tiny achieved a $62.49\%$ F1-score and $45.45\%$ IoU on the test set and a mean zero-shot F1-score of $69.89\%$ across three unseen datasets, demonstrating robust segmentation that enables downstream analysis with limited post-processing. IAC further processes the predicted masks to quantify physical crack width and affected area using ground-sampling-distance calibration. Validation at 41 caliper-referenced locations yielded a mean relative width error of $7.33\%$. Beyond geometric quantification, IAC introduces a novel continuous crack-condition metric, the Crack Severity Index (CSI), bounded on $[0,100]$, which combines maximum crack width and affected-area ratio into a unified, standards-informed severity measure. Through these developments, IAC advances crack inspection beyond pixel-level recognition toward interpretable and automated infrastructure condition assessment.

0.13

HyperCLIP++: Fine-tuning CLIP forOpen-vocabulary Semantic Segmentation in Hyperbolic Space

cs.CV ·2026-09-21 ·Zelin Peng, Zhengqin Xu, Changsong Wen, Yu Huang, Yaoming Wang +2 more
top venue similarity 0.60
Abstract · Accept by TPAMI 2026

CLIP, a foundational vision-language model, has emerged as a powerful tool for open-vocabulary semantic segmentation. While freezing CLIP's text encoder is known to preserve its generalization capability, recent studies show that fine-tuning both CLIP's text and image encoders jointly significantly enhances segmentation performance, especially for classes from open sets. In this work, we explain this phenomenon from the perspective of hierarchy alignment, since during fine-tuning, the hierarchical level of image embeddings shifts from image-level to pixel-level. We achieve this by leveraging hyperbolic space, which naturally encodes hierarchical structures. Our key observation is that, during fine-tuning, the hyperbolic radius of CLIP's text embeddings decreases, facilitating better alignment with the pixel-level granularity of visual data. Building on this, we propose HyperCLIP++, a novel and parameter-efficient adaptation strategy. HyperCLIP++ directly adjusts the hyperbolic radius of CLIP's embeddings via scaling transformations to achieve a hierarchy alignment to the target task, i.e., segmentation. To ensure this hierarchy alignment is effected consistently across both modalities and preserves their cross-modal alignment during training, HyperCLIP++ integrates a Dual Cross-Relation Communication (DCRC) module that synchronizes these adjustments between the vision and text pathways. Our experiments show that HyperCLIP++ achieves state-of-the-art performance across three benchmarks while fine-tuning only approximately 5% of CLIP's total parameters. More importantly, we observe that after adjustment, CLIP's text embeddings exhibit a relatively fixed hyperbolic radius across datasets, suggesting that the hierarchical level required for this segmentation task might be quantified using the hyperbolic radius.

0.30

CoRe-SAM3: Conditional Semantic--Visual Reconciliation for SAM3 Crack Segmentation

cs.CV ·2026-09-05 ·Shipeng Liu, Liang Zhao, Dengfeng Chen
code/data similarity 0.58
Abstract · Code will be available at: https://github.com/xauat-liushipeng/CoRe-SAM3

Crack segmentation requires a model to recognize target semantics while accurately recovering thin, low-contrast, and topologically continuous local structures. Although SAM3 provides strong open-concept segmentation, its direct application to the crack domain still misses weak cracks, activates crack-like background regions, and produces local boundary errors. We first diagnose the functional differences between the internal prompt-conditioned semantic representation and native visual representation of SAM3 on five crack datasets. The results show that the semantic representation already carries most task information for crack prediction, whereas the utility of the visual representation depends on the current semantic state. Directly combining the two representations does not yield consistent gains. Based on this finding, we propose Conditional Semantic--Visual Reconciliation, termed CoRe. CoRe retains semantic prediction as the primary decision path, applies lightweight semantic calibration to adjust the target-domain decision mapping, and uses spatially aligned native visual evidence to generate a zero-initialized, bounded, and regularized conditional residual that selectively corrects existing predictions. Across five domains, CoRe-SAM3 improves the average Crack IoU from 62.34% to 70.47% and clDice from 81.98% to 89.24%, while introducing only 18.914 K trainable parameters. Prediction-transition analysis further shows that CoRe corrects an average of 34.38% of native errors, with a damage rate of only 0.23% on pixels correctly classified by native SAM3. These results demonstrate that constrained prediction correction based on the functional differences between internal representations provides an effective and parameter-efficient target-domain adaptation strategy for vision foundation models with strong task-specific semantic priors.

0.30

Automated Borehole Core Analysis with Report-Derived Weak Labels and Supervised Crack Segmentation

cs.CV ·2026-08-12 ·Usama Imdad, Ali Khan, Luke Lu, Zubair Khalid, Arif Mahmood
similarity 0.58
Abstract · 18 pages, 12 figures

Borehole archives commonly contain core tray photographs and corresponding digital log reports, but no native pixel-level crack annotations. We investigate two complementary approaches for extracting defect-spacing information from these archives. First, structured spacing categories recovered from the report text layer provide weak interval-level labels for classification. A DINO encoder trained on unlabeled core crops supplies domain-specific representations, and a manually verified subset is used to identify label inconsistencies. Second, we manually annotate 5,087 extracted core-row images and evaluate fully supervised crack-segmentation models. Our gated U-Net combines PiDiNet edge maps with Mask R-CNN masks through a learned spatial gating mechanism. This configuration achieves an F1 score of 0.860 and a crack-class IoU of 0.754, the highest result among the evaluated segmentation configurations. Deterministic post-processing converts predicted crack locations into defect-spacing categories. Separate rule-based branches estimate core-relative bedding angles and lithological color descriptors; their predictions agree with log-report references on 75.4% and 84.7% of 1,200 evaluated images, respectively. Because these references are extracted from existing reports, the reported values measure agreement with recorded geological observations rather than independent physical accuracy. The resulting framework combines report-derived weak supervision for spacing classification with fully supervised segmentation for image-based crack localization.

0.10

FDAM: A Frequency-Direction-Aware Multi-Task Framework for Pavement Crack Grid Localization

cs.CV ·2026-11-14 ·Haiyang Xu, Bin Pan, Mengze Wang, Qiaoying Qu, Zhenwei Shi
code/data similarity 0.57
Abstract

Pavement crack grid localization remains challenging for thin and tiny cracks due to weak visual cues and background interference. Box detection often misses these cracks, while supervised semantic segmentation faces limited pixel-wise annotations and high labeling costs. In this paper, we propose a Frequency-Direction-Aware Multi-Task framework (FDAM) with box detection and grid classification branches. The core grid classification branch comprises Frequency-Domain Enhancement (FDE) and Directional Feature Refinement (DFR). FDE adaptively weights spectral bands and fuses reconstructed features with spatial features. DFR captures thin crack patterns through multi-scale strip convolutions, direction-sensitive modulation, and feature recalibration. Sparse positive cells and ambiguous local predictions motivate adaptive grid supervision. Adaptive Importance Reweighting emphasizes uncertain predictions and local label transitions, with focal supervision for all cells. Our contribution is to couple the box detection and grid classification branches through shared feature learning for pavement crack grid localization. We validate FDAM on our RoadDistress2026 dataset of thin and tiny cracks and further evaluate it on public datasets Crack500 and DeepCrack. The code is available at https://github.com/Lab-PANbin/FDAM

0.27

TED:Text-Axis Evidence Decomposition for Prompted Anomaly Localization

cs.CV cs.AI ·2026-09-30 ·JinYoung Kim, Geonho Kim, GiJeong Park, Geonu Lee, YoungJoon Yoo
published similarity 0.57
Abstract · 40th Conference on Neural Information Processing Systems (NeurIPS 2026)

CLIP is a powerful vision-language model, but it was not designed for fine-grained defect localization; CLIP-based anomaly detectors therefore adapt it with prompts or lightweight modules to increase defect sensitivity. We show that stronger sensitivity does not necessarily make local evidence reliable: under domain shift, adapted CLIP-AD models often assign high anomaly scores to both true defects and visually complex normal regions. The issue is not simply missing defect information, but a local scoring rule that decodes defect and hard-normal evidence, having the same anomaly evidence. We propose TED (Text-Axis Evidence Decomposition), a post-hoc scoring method that asks whether each ambiguous response is better supported by source defect patches or by source normal patches mistaken as anomalous. TED compares these supports under the host's normal-versus-anomaly text response, leaves the backbone and prompts unchanged, and requires no target-domain training. It works as a train-free score for raw VLM backbones or as a source-calibrated residual correction for adapted CLIP-AD hosts. Across frozen VLM backbones, TED substantially improves pixel-level localization over raw prompt similarity; across adapted hosts, it improves most pixel-level settings over P-AUROC, P-PRO, and P-AP. Gains are largest under stronger hard-FP competition, with mean localization gain increasing from +5.0 in low-competition regimes to about +10.9 in mid/high-competition regimes. These results suggest that recoverable defect evidence can already exist in pretrained multimodal representations, but reliable localization requires decoding it against hard-normal competitors. Code will be released at TED GitHub repository.

0.33

An End-to-End Automated Pipeline for Controllable Crack Data Synthesis

cs.CV ·2026-09-11 ·Conghui Li, Muxin Pu, Chern Hong Lim, Weiyao Lin, Xin Wang
similarity 0.57
Abstract

Vision-based crack inspection depends on segmentation networks whose reliability depends on the quantity, diversity and label quality of their training data. Pixel-level annotations are costly, and crack images of specific structures are scarce. Generative augmentation can supply additional data, but existing methods address isolated steps. They reuse annotated masks, offer limited control over crack geometry, and adopt the conditioning mask as the label without checking it. This paper presents an end-to-end pipeline that produces labelled crack data without manual annotation and assesses the reliability of these data and of the detectors trained on them. Procedurally sampled Bézier skeletons with guaranteed geometric properties are converted into crack masks by a generative adversarial network (GAN). A dual-ControlNet Stable Diffusion model renders the masks as crack images, either on text-described surfaces or on user-provided backgrounds. An ensemble of segmentation networks trained on real images combines its agreement with the inherited label and its internal disagreement into a pixel-wise label confidence. This confidence weights the training loss instead of removing samples with a threshold. The trained detectors are evaluated with image-space probability of detection (POD) and calibration analyses. On CRACK500 and CrackTree200, the pipeline improves five segmentation networks over conventional, diffusion-based and flow-matching-based augmentation, and on CRACK500 confidence weighting yields a higher accuracy than threshold filtering at every tested threshold. On CRACK500, the crack width that U-Net detects with 90\% probability at 95\% confidence decreases from 8.0 to 4.3 pixels, and the expected calibration error decreases from 14.2\% to 9.6\%.

0.11

Morphology-Decoupled Segmentation for Multiple Tunnel Defects Under Complex Environments

cs.CV cs.AI ·2026-11-15 ·Mohan Ren, Hang Li, Yifei Liu, Shaowei Wang, James O'Kane +5 more
similarity 0.56
Abstract · 16 pages, 7 figures

Automated tunnel-lining inspection must segment different defect geometries: cracks are thin, elongated, and connectivity-sensitive, whereas leakage, lining falling off, and segment damage are spatially extensive and context-dependent. Existing approaches generally apply a common decoder across defect classes or introduce boundary, topology, and directional mechanisms as isolated enhancements. This paper introduces Morphology-Decoupled Segmentation (MDS), in which defect morphology becomes the organising principle for feature routing, decoding, and interaction. A supervised routing module partitions multiscale encoder features into complementary linear and areal streams. The linear stream employs Deformable Strip Attention with image-conditioned direction hypotheses to preserve crack continuity without assuming fixed horizontal or vertical orientations, while the areal stream combines Pyramid Pooling with feature-pyramid fusion to capture diffuse boundaries and regional context. The representations are coupled through gated cross-morphology attention, allowing complementary information exchange while retaining morphology-specific features. A resolution-adaptive tiling and probability-blending pipeline preserves fine defects across variable-resolution imagery. MDS achieves 81.17% mIoU on the internal validation set and improves foreground image-level recognition over a backbone-matched SegDINO model, primarily for areal defects. Controlled ablations demonstrate the complementary contributions of routing supervision and cross-stream interaction while revealing a trade-off between areal-class performance and crack specialisation. The submitted model achieved 67.55% mIoU on an organiser-controlled hidden test, and the team placed second. Selective dynamic INT8 quantisation reduced model storage by 2.83 times with negligible accuracy loss.

0.34