paper-with-me

Papers

Marine Saliency Segmenter: Object-Focused Conditional Diffusion with Region-Level Semantic Knowledge Distillation

2025-04-03 · Laibin Chang, Yunke Wang, Jiaxing Huang, Longxiang Deng, Bo Du, Chang Xu

Marine Saliency Segmentation (MSS) plays a pivotal role in various vision-based marine exploration tasks. However, existing marine segmentation techniques face the dilemma of object mislocalization and imprecise boundaries due to the complex underwater environment. Meanwhile, despite the impressive performance of diffusion models in visual segmentation, there remains potential to further leverage contextual semantics to enhance feature learning of region-level salient objects, thereby improving segmentation outcomes. Building on this insight, we propose DiffMSS, a novel marine saliency segmenter based on the diffusion model, which utilizes semantic knowledge distillation to guide the segmentation of marine salient objects. Specifically, we design a region-word similarity matching mechanism to identify salient terms at the word level from the text descriptions. These high-level semantic features guide the conditional feature learning network in generating salient and accurate diffusion conditions with semantic knowledge distillation. To further refine the segmentation of fine-grained structures in unique marine organisms, we develop the dedicated consensus deterministic sampling to suppress overconfident missegmentations. Comprehensive experiments demonstrate the superior performance of DiffMSS over state-of-the-art methods in both quantitative and qualitative evaluations.

📄 PDF Abstract BibTeX arXiv:2504.02391

Code (0)

등록된 구현이 없습니다.

Tasks

Knowledge DistillationSegmentationWord Similarity

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…
Knowledge Distillation A very simple way to improve the performance of almost any machine learning algorithm is to train many different models on the same data and then to average their predictions.…

Similar Papers 제목 키워드 기반

Saliency detection with moving camera via background model completion

2021-10-30 · Yupei Zhang, Kwok-Leung Chan

To detect saliency in video is a fundamental step in many computer vision systems. Saliency is the significant target(s) in the video. The object of interest is further analyzed for high-level applications. The segregati…

Foreground SegmentationSaliency Detection

Saliency-R1: Incentivizing Unified Saliency Reasoning Capability in MLLM with Confidence-Guided Reinforcement Learning

2025-11-01 · Long Li, Shuichen Ji, Ziyang Luo, Zhihui Li 외 arxiv

Although multimodal large language models (MLLMs) excel in high-level vision-language reasoning, they lack inherent awareness of visual saliency, making it difficult to identify key visual elements. To bridge this gap, w…

Co-Salient Object DetectionReinforcement LearningInstance Segmentation

MSC: A Marine Wildlife Video Dataset with Grounded Segmentation and Clip-Level Captioning

2025-08-06 · Quang-Trung Truong, Yuk-Kwan Wong, Vo Hoang Kim Tuyen Dang, Rinaldi Gotama 외 arxiv

Marine videos present significant challenges for video understanding due to the dynamics of marine objects and the surrounding environment, camera motion, and the complexity of underwater scenes. Existing video captionin…

Video CaptioningVisual GroundingVideo Generation

Leveraging Activations for Superpixel Explanations

2024-06-07 · Ahcène Boubekki, Samuel G. Fadel, Sebastian Mair

Saliency methods have become standard in the explanation toolkit of deep neural networks. Recent developments specific to image classifiers have investigated region-based explanations with either new methods or by adapti…

Object LocalizationSuperpixelsWeakly-Supervised Object Localization

Khmer Word Segmentation Using Conditional Random Fields

2015-10-15 · Vichet Chea, Ye Kyaw Thu, Chenchen Ding, Masao Utiyama 외

Word Segmentation is a critical task that is the foundation of much natural language processing research. This paper is a study of Khmer word segmentation using an approach based on conditional random fields (CRFs). A…

SegmentationText SegmentationTranslation