paper-with-me

홈 › Papers

Mask Frozen-DETR: High Quality Instance Segmentation with One GPU

2023-08-07 · Zhanhao Liang, Yuhui Yuan

In this paper, we aim to study how to build a strong instance segmenter with minimal training time and GPUs, as opposed to the majority of current approaches that pursue more accurate instance segmenter by building more advanced frameworks at the cost of longer training time and higher GPU requirements. To achieve this, we introduce a simple and general framework, termed Mask Frozen-DETR, which can convert any existing DETR-based object detection model into a powerful instance segmentation model. Our method only requires training an additional lightweight mask network that predicts instance masks within the bounding boxes given by a frozen DETR-based object detector. Remarkably, our method outperforms the state-of-the-art instance segmentation method Mask DINO in terms of performance on the COCO test-dev split (55.3% vs. 54.7%) while being over 10X times faster to train. Furthermore, all of our experiments can be trained using only one Tesla V100 GPU with 16 GB of memory, demonstrating the significant efficiency of our proposed framework.

📄 PDF Abstract BibTeX arXiv:2308.03747

Code (0)

등록된 구현이 없습니다.

Tasks

GPUInstance Segmentationobject-detectionObject DetectionSemantic Segmentation

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Residual Connection 설명 없음
Vision Transformer The Vision Transformer, or ViT, is a model for image classification that employs a Transformer-like architecture over…

Similar Papers 제목 키워드 기반

Towards Instance Segmentation with Polygon Detection Transformers

2026-03-10 · Jiacheng Sun, Jiaqi Lin, Wenlong Hu, Haoyang Li 외 arxiv

One of the bottlenecks for instance segmentation today lies in the conflicting requirements of high-resolution inputs and lightweight, real-time inference. To address this bottleneck, we present a Polygon Detection Trans…

Instance SegmentationCell Segmentation

SOLQ: Segmenting Objects by Learning Queries

2021-06-04 · NeurIPS 2021 12 · Bin Dong, Fangao Zeng, Tiancai Wang, Xiangyu Zhang 외

In this paper, we propose an end-to-end framework for instance segmentation. Based on the recently introduced DETR [1], our method, termed SOLQ, segments objects by learning unified queries. In SOLQ, each query represent…

Instance SegmentationObject DetectionSegmentationSemantic Segmentation

KS-DETR: Knowledge Sharing in Attention Learning for Detection Transformer

2023-02-22 · Kaikai Zhao, Norimichi Ukita

Scaled dot-product attention applies a softmax function on the scaled dot-product of queries and keys to calculate weights and then multiplies the weights and values. In this work, we study how to improve the learning of…

Knowledge DistillationTransfer Learning

Aqua Boundary-Saliency Attention Module for Lightweight Underwater Salient Instance Segmentation Detection Transformer

2026-06-06 · M. Fazri Nizar, Julian Supardi, Muhammad Naufal Rachmatullah arxiv

Underwater instance segmentation integrates pixel-level mask prediction and instance-level discrimination for marine resource exploration, ecological monitoring, and underwater robotic perception. Recent prompt-based and…

Instance Segmentation

The Instance-centric Transformer for the RVOS Track of LSVOS Challenge: 3rd Place Solution

2024-08-20 · Bin Cao, Yisi Zhang, Hanyi Wang, Xingjian He 외

Referring Video Object Segmentation is an emerging multi-modal task that aims to segment objects in the video given a natural language expression. In this work, we build two instance-centric models and fuse predicted res…

Referring Video Object SegmentationRetrievalSemantic SegmentationVideo Object Segmentation+1