Interactive Object Segmentation with Dynamic Click Transform
In the interactive segmentation, users initially click on the target object to segment the main body and then provide corrections on mislabeled regions to iteratively refine the segmentation masks. Most existing methods transform these user-provided clicks into interaction maps and concatenate them with image as the input tensor. Typically, the interaction maps are determined by measuring the distance of each pixel to the clicked points, ignoring the relation between clicks and mislabeled regions. We propose a Dynamic Click Transform Network~(DCT-Net), consisting of Spatial-DCT and Feature-DCT, to better represent user interactions. Spatial-DCT transforms each user-provided click with individual diffusion distance according to the target scale, and Feature-DCT normalizes the extracted feature map to a specific distribution predicted from the clicked points. We demonstrate the effectiveness of our proposed method and achieve favorable performance compared to the state-of-the-art on three standard benchmark datasets.
Code (0)
등록된 구현이 없습니다.
Tasks
Interactive SegmentationObjectSegmentationSemantic SegmentationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Localized Interactive Instance Segmentation
In current interactive instance segmentation works, the user is granted a free hand when providing clicks to segment an object; clicks are allowed on background pixels and other object instances far from the target objec…
Instance SegmentationInteractive SegmentationObjectSegmentation+1ClickSeg3D: Few-Click Interactive Segmentation via Semantic Embeddings
Interactive segmentation allows efficient label generation by leveraging user-provided clicks to progressively refine predictions, which is critical when fully supervised labels are costly or generalization to unseen cla…
Interactive 3D Instance SegmentationInteractive SegmentationSimpleClick: Interactive Image Segmentation with Simple Vision Transformers
Click-based interactive image segmentation aims at extracting objects with a limited user clicking. A hierarchical backbone is the de-facto architecture for current methods. Recently, the plain, non-hierarchical Vision T…
Image SegmentationInteractive SegmentationSegmentationSemantic SegmentationScale-aware multi-level guidance for interactive instance segmentation
In interactive instance segmentation, users give feedback to iteratively refine segmentation masks. The user-provided clicks are transformed into guidance maps which provide the network with necessary cues on the whereab…
Instance SegmentationInteractive SegmentationSegmentationSemantic SegmentationContent-Aware Multi-Level Guidance for Interactive Instance Segmentation
In interactive instance segmentation, users give feedback to iteratively refine segmentation masks. The user-provided clicks are transformed into guidance maps which provide the network with necessary cues on the whereab…
Instance SegmentationInteractive SegmentationSegmentationSemantic Segmentation