paper-with-me

홈 › Papers

Object Detection with Mask-based Feature Encoding

2018-02-12 · Xiaochuan Fan, Hao Guo, Kang Zheng, Wei Feng, Song Wang

Region-based Convolutional Neural Networks (R-CNNs) have achieved great success in the field of object detection. The existing R-CNNs usually divide a Region-of-Interest (ROI) into grids, and then localize objects by utilizing the spatial information reflected by the relative position of each grid in the ROI. In this paper, we propose a novel feature-encoding approach, where spatial information is represented through the spatial distributions of visual patterns. In particular, we design a Mask Weight Network (MWN) to learn a set of masks and then apply channel-wise masking operations to ROI feature map, followed by a global pooling and a cheap fully-connected layer. We integrate the newly designed feature encoder into the Faster R-CNN architecture. The resulting new Faster R-CNNs can preserve the object-detection accuracy of the standard Faster R-CNNs by using substantially fewer parameters. Compared to R-FCNs using state-of-art PS ROI pooling and deformable PS ROI pooling, the new Faster R-CNNs can produce higher object-detection accuracy with good run-time efficiency. We also show that a specifically designed and learned MWN can capture global contextual information and further improve the object-detection accuracy. Validation experiments are conducted on both PASCAL VOC and MS COCO datasets.

📄 PDF Abstract BibTeX arXiv:1802.03934

Code (0)

등록된 구현이 없습니다.

Tasks

Objectobject-detectionObject Detection

Methods 이 논문이 사용한 방법론

RPN A Region Proposal Network, or RPN, is a fully convolutional network that simultaneously predicts object bounds and objectness scores at each position. The RPN is trained…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
RoIPool 설명 없음
Faster R-CNN Faster R-CNN is an object detection model that improves on Fast R-CNN by utilising a region proposal network…

Similar Papers 제목 키워드 기반

DMKD: Improving Feature-based Knowledge Distillation for Object Detection Via Dual Masking Augmentation

2023-09-06 · Guang Yang, Yin Tang, Zhijian Wu, Jun Li 외

Recent mainstream masked distillation methods function by reconstructing selectively masked areas of a student network from the feature map of its teacher counterpart. In these methods, the masked regions need to be prop…

Knowledge Distillationobject-detectionObject Detection

ConvMAE: Masked Convolution Meets Masked Autoencoders

2022-05-08 · Peng Gao, Teli Ma, Hongsheng Li, Ziyi Lin 외

Vision Transformers (ViT) become widely-adopted architectures for various vision tasks. Masked auto-encoding for feature pretraining and multi-scale hybrid convolution-transformer architectures can further unleash the po…

Computational Efficiencyimage-classificationImage ClassificationObject Detection+1

Masked Autoencoders Are Stronger Knowledge Distillers

2023-01-01 · ICCV 2023 1 · Shanshan Lao, Guanglu Song, Boxiao Liu, Yu Liu 외

Knowledge distillation (KD) has shown great success in improving student's performance by mimicking the intermediate output of the high-capacity teacher in fine-grained visual tasks, e.g. object detection. This paper…

DecoderKnowledge Distillationobject-detectionObject Detection+1

MCSAE: Masked Cross Self-Attentive Encoding for Speaker Embedding

2020-01-28 · Soonshin Seo, Ji-Hwan Kim

In general, a self-attention mechanism has been applied for speaker embedding encoding. Previous studies focused on training the self-attention in a high-level layer, such as the last pooling layer. However, the effect o…

Speaker Verification

MaskLRF: Self-supervised Pretraining via Masked Autoencoding of Local Reference Frames for Rotation-invariant 3D Point Set Analysis

2024-03-01 · Takahiko Furuya

Following the successes in the fields of vision and language, self-supervised pretraining via masked autoencoding of 3D point set data, or Masked Point Modeling (MPM), has achieved state-of-the-art accuracy in various do…

3D geometryDomain Adaptation