paper-with-me

홈 › Papers

Order-aware Interactive Segmentation

2024-10-16 · Bin Wang, Anwesa Choudhuri, Meng Zheng, Zhongpai Gao, Benjamin Planche, Andong Deng, Qin Liu, Terrence Chen, Ulas Bagci, Ziyan Wu

Interactive segmentation aims to accurately segment target objects with minimal user interactions. However, current methods often fail to accurately separate target objects from the background, due to a limited understanding of order, the relative depth between objects in a scene. To address this issue, we propose OIS: order-aware interactive segmentation, where we explicitly encode the relative depth between objects into order maps. We introduce a novel order-aware attention, where the order maps seamlessly guide the user interactions (in the form of clicks) to attend to the image features. We further present an object-aware attention module to incorporate a strong object-level understanding to better differentiate objects with similar order. Our approach allows both dense and sparse integration of user clicks, enhancing both accuracy and efficiency as compared to prior works. Experimental results demonstrate that OIS achieves state-of-the-art performance, improving mIoU after one click by 7.61 on the HQSeg44K dataset and 1.32 on the DAVIS dataset as compared to the previous state-of-the-art SegNext, while also doubling inference speed compared to current leading methods. The project page is https://ukaukaaaa.github.io/projects/OIS/index.html

📄 PDF Abstract BibTeX arXiv:2410.12214

Code (0)

등록된 구현이 없습니다.

Tasks

Interactive SegmentationSegmentation

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Attention 설명 없음
SPEED The monocular depth estimation (MDE) is the task of estimating depth from a single frame. This information is an essential knowledge in many computer vision tasks such as scene…

Similar Papers 제목 키워드 기반

High Fidelity Interactive Video Segmentation Using Tensor Decomposition Boundary Loss Convolutional Tessellations and Context Aware Skip Connections

2020-11-23 · Anthony D. Rhodes, Manan Goel

We provide a high fidelity deep learning algorithm (HyperSeg) for interactive video segmentation tasks using a convolutional network with context-aware skip connections, and compressed, hypercolumn image features combine…

Interactive SegmentationSegmentationTensor DecompositionVideo Segmentation+1

Dynamic Prompt Generation for Interactive 3D Medical Image Segmentation Training

2025-10-03 · Tidiane Camaret Ndir, Alexander Pfefferle, Robin Tibor Schirrmeister arxiv

Interactive 3D biomedical image segmentation requires efficient models that can iteratively refine predictions based on user prompts. Current foundation models either lack volumetric awareness or suffer from limited inte…

Medical Image Segmentation

Quality-Aware Memory Network for Interactive Volumetric Image Segmentation

2021-06-20 · Tianfei Zhou, Liulei Li, Gustav Bredell, Jianwu Li 외

Despite recent progress of automatic medical image segmentation techniques, fully automatic results usually fail to meet the clinical use and typically require further refinement. In this work, we propose a quality-aware…

Active LearningImage SegmentationInteractive SegmentationMedical Image Segmentation+2

Scale-aware multi-level guidance for interactive instance segmentation

2018-12-07 · Soumajit Majumder, Angela Yao

In interactive instance segmentation, users give feedback to iteratively refine segmentation masks. The user-provided clicks are transformed into guidance maps which provide the network with necessary cues on the whereab…

Instance SegmentationInteractive SegmentationSegmentationSemantic Segmentation

Content-Aware Multi-Level Guidance for Interactive Instance Segmentation

2019-06-01 · CVPR 2019 6 · Soumajit Majumder, Angela Yao

In interactive instance segmentation, users give feedback to iteratively refine segmentation masks. The user-provided clicks are transformed into guidance maps which provide the network with necessary cues on the whereab…

Instance SegmentationInteractive SegmentationSegmentationSemantic Segmentation