paper-with-me

홈 › Papers

Mask Scoring R-CNN

2019-03-01 · CVPR 2019 6 · Zhaojin Huang, Lichao Huang, Yongchao Gong, Chang Huang, Xinggang Wang

Letting a deep network be aware of the quality of its own predictions is an interesting yet important problem. In the task of instance segmentation, the confidence of instance classification is used as mask quality score in most instance segmentation frameworks. However, the mask quality, quantified as the IoU between the instance mask and its ground truth, is usually not well correlated with classification score. In this paper, we study this problem and propose Mask Scoring R-CNN which contains a network block to learn the quality of the predicted instance masks. The proposed network block takes the instance feature and the corresponding predicted mask together to regress the mask IoU. The mask scoring strategy calibrates the misalignment between mask quality and mask score, and improves instance segmentation performance by prioritizing more accurate mask predictions during COCO AP evaluation. By extensive evaluations on the COCO dataset, Mask Scoring R-CNN brings consistent and noticeable gain with different models, and outperforms the state-of-the-art Mask R-CNN. We hope our simple and effective approach will provide a new direction for improving instance segmentation. The source code of our method is available at \url{https://github.com/zjhuang22/maskscoring_rcnn}.

📄 PDF Abstract BibTeX arXiv:1903.00241

Code (3)

zjhuang22/maskscoring_rcnn 공식 구현 pytorch
MS-Mind/MS-Code-08/tree/main/MTCNN mindspore
open-mmlab/mmdetection pytorch

Tasks

General ClassificationInstance SegmentationSegmentationSemantic Segmentation

Methods 이 논문이 사용한 방법론

RPN A Region Proposal Network, or RPN, is a fully convolutional network that simultaneously predicts object bounds and objectness scores at each position. The RPN is trained…
Mask Scoring R-CNN 설명 없음
Deformable Convolution Deformable convolutions add 2D offsets to the regular grid sampling locations in the standard convolution. It enables free…
FPN 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
RoIAlign Region of Interest Align, or RoIAlign, is an operation for extracting a small feature map from each RoI in detection and segmentation based tasks. It removes the harsh…
Average Pooling 설명 없음
Mask R-CNN Mask R-CNN extends Faster R-CNN to solve instance segmentation tasks. It achieves this by adding a branch for predicting an…

Similar Papers 제목 키워드 기반

Masked Language Model Scoring

2019-10-31 · ACL 2020 6 · Julian Salazar, Davis Liang, Toan Q. Nguyen, Katrin Kirchhoff

Pretrained masked language models (MLMs) require finetuning for most NLP tasks. Instead, we evaluate MLMs out of the box via their pseudo-log-likelihood scores (PLLs), which are computed by masking tokens one by one. We …

AttributeDomain AdaptationLanguage ModelingLanguage Modelling+4

Where to Mask: Structure-Guided Masking for Graph Masked Autoencoders

2024-04-24 · Chuang Liu, Yuyao Wang, Yibing Zhan, Xueqi Ma 외

Graph masked autoencoders (GMAE) have emerged as a significant advancement in self-supervised pre-training for graph-structured data. Previous GMAE models primarily utilize a straightforward random masking strategy for n…

Transfer Learning

Variable Attention Masking for Configurable Transformer Transducer Speech Recognition

2022-11-02 · Pawel Swietojanski, Stefan Braun, Dogan Can, Thiago Fraga da Silva 외

This work studies the use of attention masking in transformer transducer based speech recognition for building a single configurable model for different deployment scenarios. We present a comprehensive set of experiments…

speech-recognitionSpeech Recognition

A Better Way to Do Masked Language Model Scoring

2023-05-17 · Carina Kauf, Anna Ivanova

Estimating the log-likelihood of a given sentence under an autoregressive language model is straightforward: one can simply apply the chain rule and sum the log-likelihood values for each successive token. However, for m…

Language ModelingLanguage ModellingSentence

Stability-Weighted Decoding for Diffusion Language Models

2026-04-18 · Yue Wu, Jian Huang arxiv

Diffusion large language models (dLLMs) enable parallel text generation by iteratively denoising a fully masked sequence, unmasking a subset of masked tokens at each step. Existing decoding strategies rely on static conf…

Mathematical ReasoningCode GenerationText Generation