CS Paper Radar

Progressively Refining SAM for Accurate Phytoplankton Segmentation

Jialin Li, Jinkun Jiang, Yuezun Li, Junyu Dong

cs.CV ·submitted 2026-10-27 06:39 UTC · v2
datasetcode/data

Abstract

Accurate phytoplankton segmentation is essential for ecological monitoring, yet it remains largely underexplored due to the subtle visual characteristics of phytoplankton and the scarcity of pixel-level annotations. To address these challenges, we propose PhySeg, a SAM-based segmentation framework equipped with a lightweight refinement module that progressively restores fine-grained details through multi-scale feature fusion. In addition, we construct a phytoplankton segmentation dataset by manually annotating instance-level masks for an existing dataset, providing a valuable resource for future research. Experimental results demonstrate that PhySeg improves segmentation accuracy, validating the effectiveness of the proposed module. Code is available at https://github.com/lijialin404/PhySeg.

Comment
5 pages, 3 figures

Closest papers

Nearest neighbours by meaning across the whole index.

Leveraging existing sparse point annotations for benthic imagery dense segmentation

cs.CV cs.LG ·2026-08-18 ·Cesar Borja, Breck A. McCollum, Jarret E. Byrnes, Kenneth Sebens, Ana C. Murillo
benchmark similarity 0.66
Abstract

The health of marine ecosystems is a critical indicator of global environmental change, yet the physical constraints of underwater observation and the intrinsic challenges of processing marine imagery severely limit the scalability of systematic monitoring. While recent visual foundation models such as the Segment Anything Model (SAM) series show great promise, they still struggle with the fine-grained recognition required in these complex scenarios and still require expert supervision. Our work addresses this gap by bridging state-of-the-art foundation models with existing sparse supervision. Because historical benthic surveys are typically annotated with only a few sparse expert points per image, we utilize these legacy point-labels as visual prompts for SAM2. Our primary contribution is a novel mechanism to automatically identify which of these points are suitable, and which are actively harmful, when used for propagation. By filtering out unreliable points, we extract high-quality pseudo-ground-truth masks capable of training more accurate, fine-grained semantic segmentation models. We demonstrate the effectiveness of our approach on public benthic data and introduce a new, challenging benchmark featuring real-world sparse expert annotations, paving the way for scalable ecological analysis.

0.20

Toward AI-Driven Phytoplankton Event Detection from Image Classification: Temporal Aggregation Under Domain Shift

cs.CV ·2026-10-07 ·Ali Rohan, Hassan Shayan, Han-Gue Jo, Colin Moffat
unusual similarity 0.64
Abstract · 22 pages, 7 figures

Imaging FlowCytobot (IFCB) systems generate large volumes of phytoplankton imagery that exceed the capacity of manual expert analysis. Although machine-learning approaches achieve high image-level classification performance, it remains unclear whether their predictions can provide ecologically meaningful temporal information for monitoring. This study investigates whether AI-derived phytoplankton classifications can reproduce temporal occurrence patterns and elevated-occurrence signals under realistic sampling and independent-domain transfer. A monitoring-oriented framework was developed using MedPlanktonSet and evaluated on an independent IFCB dataset from the Swedish Meteorological and Hydrological Institute (SMHI). Eight biologically comparable taxa were selected as targets, while all remaining observations were retained as background to preserve the full image-stream denominator. Session-aware partitioning prevented temporal leakage, and alternative preprocessing strategies and convolutional neural network architectures were evaluated. Cross-domain experiments showed that preprocessing strongly affected generalisation. EfficientNet-B0 provided the strongest target-versus-background discrimination and was selected for temporal analysis. Despite residual image-level errors, AI-derived target-occurrence rates closely reproduced expert-derived signals after aggregation (mean absolute error = 0.0432, Pearson $r$ = 0.9696, Spearman $ρ$ = 0.9568). Agreement remained strong across multi-session windows, and elevated, strong, and persistent occurrence proxies were recovered in held-out testing. These results show that AI-based phytoplankton classification can support monitoring-relevant temporal indicators beyond image-level identification and support future operational early-warning development.

0.29

CoralscapesV2: Panoptic and Fine-Grained Visual Scene Understanding in Coral Reefs

cs.CV ·2026-09-11 ·Jonathan Sauder, Thomas Ruckli, Gabrielė Strodomskytė, Ibrahim Souleiman Abdallah, Rahma Hassan Abdi +15 more
publishedbenchmark similarity 0.61
Abstract

In order to design conservation and restoration strategies to counter the global decline of coral reefs, ecological monitoring of reefs needs to be scaled up dramatically. Computer vision methods are increasingly used to tackle the vast amount of data: as the paradigm of data collection in reefs shifts from highly standardized and constrained survey images to unconstrained imagery on scalable platforms, it is necessary to design machine learning methods that help to get a fine-grained understanding of reefs from general-purpose reef imagery. This paper provides CoralscapesV2, an extension of the Coralscapes dataset for general-purpose visual scene understanding in reefs. CoralscapesV2 increases the dataset size, scope, label completeness and quality for semantic segmentation, and extends the number of classes from 39 to 95 fine-grained visual categories. Furthermore, CoralscapesV2 provides 65k exhaustive fish instance mask annotations, meticulously annotated to completeness by using the video, revealing that annotation of fish based on only static images is insufficient. CoralscapesV2 is the first dataset for panoptic segmentation in coral reefs, capturing a wide range of scenarios in the wild, posing a challenging benchmark for contemporary semantic segmentation and instance segmentation models. CoralscapesV2 is an important step towards general-purpose panoptic segmentation in coral reefs, which has substantial implications for scaling up coral reef monitoring, as it can be employed in a wide range of applications from benthic cover mapping from robot or handheld videos to designing methods for automated quantification and understanding of fish behavior and fish-reef interactions.

0.23

MariSat: A Maritime Dataset for Instance Segmentation of Objects in Satellite and Aerial Images

cs.CV ·2026-08-30 ·Amir Abbes, Ines Harrabi, Lucas Justin Yirepoa Kinda, Rim Trabelsi, Adnane Cabani +1 more
benchmarkdatasetcode/data similarity 0.61
Abstract

Automated maritime surveillance from satellite and aerial imagery requires large, precisely annotated datasets, which remain scarce for the instance-segmentation task, particularly for small vessels in cluttered port environments. We present MariSat, a new benchmark dataset of 1260 aerial and satellite images covering diverse port and coastal scenes, annotated at the pixel level for eight maritime object classes (sailboat, yacht, jet-ski, fishing boat, cruise ship, military vessel, tugboat and cargo ship). The dataset was produced through a semi-automatic annotation pipeline combining the textpromptable segmentation model SAM 3 with a cascade of geometric and colorimetric post-processing filters, followed by a manual correction and quality-control pass performed with the CVAT annotation platform. We describe the image-collection methodology, the annotation and correction process, and the resulting data organization. We also report class-wise statistics for the training, validation, and test splits. MariSat has already been used to fine-tune and benchmark segmentation and detection models (SAM 3 and YOLO11) for real-time maritime monitoring. We report detailed quantitative and per-class results for both tasks. The MariSat dataset is publicly available on GitHub : https://github.com/amirabbes/P2M-Maritime-Segmentation

0.35

GuidedSAM-Plume: An Expert-Guided Segmentation Framework for Volcanic Plumes

cs.CV ·2026-10-21 ·Taddeo D'Adamo, Simon Thivet, Catherine Pothier, Riccardo Simionato, Allan Fries +4 more
publishedcode/data similarity 0.60
Abstract

Quantitative analysis of environmental phenomena increasingly relies on image-based measurements. In volcanology, the geometric characterization of volcanic plumes and clouds from RGB images remains hindered by the scarcity of dedicated segmentation solutions and partially handcrafted annotations remain widely prevalent. We present GuidedSAM-Plume, an open-source expert-guided framework tailored for the interactive segmentation of volcanic plumes and clouds. It leverages the zero-shot, spatial prompt-based capabilities of SAM2. The framework was thoroughly validated on a challenging dataset through dedicated segmentation metrics and field-relevant volcanological descriptors. From minimal user inputs, it is able to significantly increase performance compared to fully automatic dedicated solutions while preserving the reliability of derived volcanological parameters. The absence of retraining requirements lowers adoption barriers within the volcanological community, and the framework's demonstrated suitability for complex, diffuse plume-shaped phenomena extends its applicability to broader environmental science domains. The re-annotated dataset, produced under the guidance of expert volcanologists within the proposed framework, ultimately yields a more standardized release. The framework and accompanying dataset are made available at https://github.com/tad-damo/GuidedSAM-Plume.

0.55

GeoCueFormer: Geometry-Guided Wavelet Representation and Prediction-Cued Dual-Stage Decoder for Underwater Semantic Segmentation

cs.CV ·2026-09-16 ·Xian Wu, Xinjin Li, Yiliu Xu, Yining Liu, Yong Jiang
benchmark similarity 0.59
Abstract · 14 pages, 5 figures, conference paper

Underwater semantic segmentation is essential for marine ecosystem monitoring, yet remains challenging due to severe visual degradation. Light absorption and scattering often lead to color shifts, low contrast, and blurred boundaries, making shallow detail features unreliable. Existing underwater segmentation methods improve RGB feature aggregation or boundary prediction, but still lack an explicit mechanism to distinguish structure-related details from degradation-induced responses. To address this limitation, we propose GeoCueFormer, a lightweight framework that combines geometry-constrained frequency enhancement with prediction-cued refinement. GeoCueFormer performs stage-specific wavelet enhancement on hierarchical encoder features to complement shallow boundary details while preserving deep structural semantics. A depth-derived spatial gate constrains shallow frequency enhancement toward geometry-consistent regions, and a prediction-cued dual-stage decoder further refines ambiguous high-resolution features. GeoCueFormer obtains 82.23% and 73.04% mIoU on SUIM and DUT, respectively. Under comparable model complexity and standard benchmark settings on SUIM and DUT, it achieves SOTA performance while maintaining a favorable accuracy-complexity trade-off. These results show that distinguishing structural details from degradation-induced interference is more effective for underwater segmentation.

0.35

Comparative Assessment of Deep Learning Architectures for Underwater Subsurface Kelp Forest Segmentation with The Kelp-o-Tron

cs.CV ·2026-08-25 ·Sundarabalan Balasubramanian, César Borja, Ana C. Murillo, Lexi N. Wilkes, Meredith L. McPherson +3 more
similarity 0.59
Abstract

Submerged kelp forests are vital coastal ecosystems that support marine biodiversity and ecosystem dynamics, yet accurate underwater kelp segmentation remains challenging due to optical degradation, illumination variability, turbidity, overlapping vegetation, and complex benthic backgrounds. We systematically evaluated three deep learning semantic segmentation frameworks, ResNet34-U-Net, ResNet50-DeepLabV3, and a hybrid ResNet50-ASPP-Transformer architecture, for kelp detection using high-resolution underwater RGB imagery collected from northeastern U.S. coastal waters. A dataset of 3,395 SSeg assisted annotated image-mask pairs was developed for model training and validation, while geographically independent sites were used for quantitative and qualitative evaluation. All models used consistent preprocessing, augmentation, and evaluation protocols. On independent test data, ResNet50-DeepLabV3 achieved the highest Dice (0.7120) and Intersection over Union (IoU; 0.6267), followed by ResNet34 U Net (Dice 0.6868; IoU 0.5978). The hybrid ASPP Transformer achieved the highest pixel accuracy (0.8528) but lower Dice (0.6437) and IoU (0.5746). External qualitative evaluation further showed that DeepLabV3 produced more consistent segmentation across varying environmental conditions, image qualities, and benthic habitats. Overall, ResNet50-DeepLabV3, termed Kelp-O-Tron, provided the best balance of segmentation accuracy, robustness, and generalization. The dataset, annotation workflow, and comparative evaluation provide resources for advancing automated underwater habitat mapping and ecological monitoring.

0.21

RipBench: A Unified Benchmark for Multi-Level Rip Current Detection, Classification and Segmentation

cs.CV ·2026-11-11 ·Andrei Dumitriu, Aakash Ralhan, Florin Miron, Florin Tatui, Radu Tudor Ionescu +1 more
top venuebenchmarkhot direction similarity 0.59
Abstract · Accepted to NeurIPS 2026, Evaluations & Datasets Track. 47 pages, 11 figures. See https://ripbench.ai for dataset and project updates

Rip currents are a serious and often under-addressed threat to beach safety and the leading cause of coastal drownings worldwide. They are difficult to detect due to their amorphous structure, similarity to the background, and large variability in viewpoints and environments. Despite their dangers and growing interest in automated detection, existing research remains fragmented across datasets, metrics, models, and approaches, leading to an incomplete understanding of model performance. We introduce RipBench, a unified benchmark that enables controlled evaluation of rip current detection spanning multiple tasks, including classification, axis-aligned and oriented object detection, and instance, semantic, and panoptic segmentation, on the same data with standardized splits. This allows direct comparison of model performance on all levels of visual abstraction. Across $304$ videos ($303{,}491$ frames, $51{,}011$ of them annotated for all six tasks) collected from diverse coastlines, our results expose a clear performance gap between coarse recognition and precise spatial understanding: frame-level classification reaches $F_2 = 0.93$, while the best detector and the best instance segmenter reach $0.72$ and $0.66$, with model rankings that change from task to task. Video-level confidence intervals, a blind inter-annotator study of the spatial labels, stratified analyses by viewpoint and visual signature, and video views with temporal baselines (single-seed, short-schedule reference runs) accompany the benchmark. All tasks are supported with carefully curated annotations and evaluated using standard metrics, with a focus on the $F_2$ score to emphasize recall in this safety-critical setting. RipBench, along with multiple baselines per task, is publicly available at https://RipBench.ai to support progress in real-world, multi-task vision for beach safety.

0.49