Unsupervised segmentation via semantic-apparent feature fusion
Foreground segmentation is an essential task in the field of image understanding. Under unsupervised conditions, different images and instances always have variable expressions, which make it difficult to achieve stable segmentation performance based on fixed rules or single type of feature. In order to solve this problem, the research proposes an unsupervised foreground segmentation method based on semantic-apparent feature fusion (SAFF). Here, we found that key regions of foreground object can be accurately responded via semantic features, while apparent features (represented by saliency and edge) provide richer detailed expression. To combine the advantages of the two type of features, an encoding method for unary region features and binary context features is established, which realizes a comprehensive description of the two types of expressions. Then, a method for adaptive parameter learning is put forward to calculate the most suitable feature weights and generate foreground confidence score map. Furthermore, segmentation network is used to learn foreground common features from different instances. By fusing semantic and apparent features, as well as cascading the modules of intra-image adaptive feature weight learning and inter-image common feature learning, the research achieves performance that significantly exceeds baselines on the PASCAL VOC 2012 dataset.
Code (0)
등록된 구현이 없습니다.
Tasks
Foreground SegmentationSegmentationSimilar Papers 제목 키워드 기반
FlowFeat: Pixel-Dense Embedding of Motion Profiles
Dense and versatile image representations underpin the success of virtually all computer vision applications. However, state-of-the-art networks, such as transformers, produce low-resolution feature grids, which are subo…
Monocular Depth EstimationVideo Object SegmentationSemantic SegmentationDiffCut: Catalyzing Zero-Shot Semantic Segmentation with Diffusion Features and Recursive Normalized Cut
Foundation models have emerged as powerful tools across various domains including language, vision, and multimodal tasks. While prior works have addressed unsupervised image segmentation, they significantly lag behind su…
Image SegmentationSegmentationSemantic SegmentationUnsupervised Image Segmentation+3Energy-based Domain-Adaptive Segmentation with Depth Guidance
Recent endeavors have been made to leverage self-supervised depth estimation as guidance in unsupervised domain adaptation (UDA) for semantic segmentation. Prior arts, however, overlook the discrepancy between semantic a…
Depth EstimationDomain AdaptationSegmentationSemantic Segmentation+1Unsupervised Surgical Instrument Segmentation via Anchor Generation and Semantic Diffusion
Surgical instrument segmentation is a key component in developing context-aware operating rooms. Existing works on this task heavily rely on the supervision of a large amount of labeled data, which involve laborious and …
Feature CorrelationSegmentationUnsupervised Discovery of 3D Hierarchical Structure with Generative Diffusion Features
Inspired by recent findings that generative diffusion models learn semantically meaningful representations, we use them to discover the intrinsic hierarchical structure in biomedical 3D images using unsupervised segmenta…
Segmentation