paper-with-me

홈 › Papers

Query Refinement Transformer for 3D Instance Segmentation

2023-01-01 · ICCV 2023 1 · Jiahao Lu, Jiacheng Deng, Chuxin Wang, Jianfeng He, Tianzhu Zhang

3D instance segmentation aims to predict a set of object instances in a scene and represent them as binary foreground masks with corresponding semantic labels. However, object instances are diverse in shape and category,and point clouds are usually sparse, unordered, and irregular, which leads to a query sampling dilemma. Besides,noise background queries interfere with proper scene perception and accurate instance segmentation. To address the above issues, we propose a Query Refinement Transformer termed QueryFormer. The key to our approach is to exploit a query initialization module to optimize the initialization process for the query distribution with a high coverage and low repetition rate. Additionally, we design an affiliated transformer decoder that suppresses the interference of noise background queries and helps the foreground queries focus on instance discriminative parts to predict final segmentation results. Extensive experiments on ScanNetV2 and S3DIS datasets show that our QueryFormer can surpass state-of-the-art 3D instance segmentation methods.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

3D Instance Segmentation3D Object DetectionDecoderInstance SegmentationSegmentationSemantic Segmentation

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…

Similar Papers 제목 키워드 기반

MIQ-SAM3D: From Single-Point Prompt to Multi-Instance Segmentation via Competitive Query Refinement

2025-11-03 · Jierui Qu, Jianchun Zhao arxiv

Accurate segmentation of medical images is fundamental to tumor diagnosis and treatment planning. SAM-based interactive segmentation has gained attention for its strong generalization, but most methods follow a single-po…

Interactive SegmentationInstance SegmentationLesion Segmentation

DynaMITe: Dynamic Query Bootstrapping for Multi-object Interactive Segmentation Transformer

2023-04-13 · ICCV 2023 1 · Amit Kumar Rana, Sabarinath Mahadevan, Alexander Hermans, Bastian Leibe

Most state-of-the-art instance segmentation methods rely on large amounts of pixel-precise ground-truth annotations for training, which are expensive to create. Interactive segmentation networks help generate such annota…

DecoderInstance SegmentationInteractive SegmentationSegmentation+1

3D Instance Segmentation via Enhanced Spatial and Semantic Supervision

2023-01-01 · ICCV 2023 1 · Salwa Al Khatib, Mohamed El Amine Boudjoghra, Jean Lahoud, Fahad Shahbaz Khan

3D instance segmentation has recently garnered increased attention. Typical deep learning methods adopt point grouping schemes followed by hand-designed geometric clustering. Inspired by the success of transformers f…

3D Instance SegmentationDecoderInstance SegmentationSegmentation+1

A Unified Query-based Paradigm for Camouflaged Instance Segmentation

2023-08-14 · Bo Dong, Jialun Pei, Rongrong Gao, Tian-Zhu Xiang 외

Due to the high similarity between camouflaged instances and the background, the recently proposed camouflaged instance segmentation (CIS) faces challenges in accurate localization and instance segmentation. To this end,…

Boundary DetectionDecoderInstance SegmentationMulti-Task Learning+2

The Instance-centric Transformer for the RVOS Track of LSVOS Challenge: 3rd Place Solution

2024-08-20 · Bin Cao, Yisi Zhang, Hanyi Wang, Xingjian He 외

Referring Video Object Segmentation is an emerging multi-modal task that aims to segment objects in the video given a natural language expression. In this work, we build two instance-centric models and fuse predicted res…

Referring Video Object SegmentationRetrievalSemantic SegmentationVideo Object Segmentation+1