paper-with-me

홈 › Papers

SOLQ: Segmenting Objects by Learning Queries

2021-06-04 · NeurIPS 2021 12 · Bin Dong, Fangao Zeng, Tiancai Wang, Xiangyu Zhang, Yichen Wei

In this paper, we propose an end-to-end framework for instance segmentation. Based on the recently introduced DETR [1], our method, termed SOLQ, segments objects by learning unified queries. In SOLQ, each query represents one object and has multiple representations: class, location and mask. The object queries learned perform classification, box regression and mask encoding simultaneously in an unified vector form. During training phase, the mask vectors encoded are supervised by the compression coding of raw spatial masks. In inference time, mask vectors produced can be directly transformed to spatial masks by the inverse process of compression coding. Experimental results show that SOLQ can achieve state-of-the-art performance, surpassing most of existing approaches. Moreover, the joint learning of unified query representation can greatly improve the detection performance of DETR. We hope our SOLQ can serve as a strong baseline for the Transformer-based instance segmentation. Code is available at https://github.com/megvii-research/SOLQ.

📄 PDF Abstract BibTeX arXiv:2106.02351

Code (1)

megvii-research/SOLQ 공식 구현 pytorch

Tasks

Instance SegmentationObject DetectionSegmentationSemantic Segmentation

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Feedforward Network A Feedforward Network, or a Multilayer Perceptron (MLP), is a neural network with solely densely connected layers. This is the classic neural network architecture of the…
Detr 설명 없음

Similar Papers 제목 키워드 기반

Temporal Collection and Distribution for Referring Video Object Segmentation

2023-09-07 · ICCV 2023 1 · Jiajin Tang, Ge Zheng, Sibei Yang

Referring video object segmentation aims to segment a referent throughout a video sequence according to a natural language expression. It requires aligning the natural language expression with the objects' motions and th…

ObjectReferring Video Object SegmentationSemantic SegmentationVideo Object Segmentation+1

PARIS3D: Reasoning-based 3D Part Segmentation Using Large Multimodal Model

2024-04-04 · Amrin Kareem, Jean Lahoud, Hisham Cholakkal

Recent advancements in 3D perception systems have significantly improved their ability to perform visual recognition tasks such as segmentation. However, these systems still heavily rely on explicit human instruction to …

3D Part SegmentationBenchmarkingSegmentationSemantic Segmentation+1

CAT: Coordinating Anatomical-Textual Prompts for Multi-Organ and Tumor Segmentation

2024-06-11 · Zhongzhen Huang, Yankai Jiang, Rongzhao Zhang, Shaoting Zhang 외

Existing promptable segmentation methods in the medical imaging field primarily consider either textual or visual prompts to segment relevant objects, yet they often fall short when addressing anomalies in medical images…

SegmentationTumor Segmentation

Saliency Detection via Graph-Based Manifold Ranking

2013-06-01 · CVPR 2013 6 · Chuan Yang, Lihe Zhang, Huchuan Lu, Xiang Ruan 외

Most existing bottom-up methods measure the foreground saliency of a pixel or region based on its contrast within a local context or the entire image, whereas a few methods focus on segmenting out background regions and …

Saliency DetectionSuperpixels

Learning Spatial-Semantic Features for Robust Video Object Segmentation

2024-07-10 · Xin Li, Deshui Miao, Zhenyu He, YaoWei Wang 외

Tracking and segmenting multiple similar objects with complex or separate parts in long-term videos is inherently challenging due to the ambiguity of target parts and identity confusion caused by occlusion, background cl…

ObjectSemantic SegmentationVideo Object SegmentationVideo Semantic Segmentation