paper-with-me

홈 › Papers

A Tri-Layer Plugin to Improve Occluded Detection

2022-10-18 · Guanqi Zhan, Weidi Xie, Andrew Zisserman

Detecting occluded objects still remains a challenge for state-of-the-art object detectors. The objective of this work is to improve the detection for such objects, and thereby improve the overall performance of a modern object detector. To this end we make the following four contributions: (1) We propose a simple 'plugin' module for the detection head of two-stage object detectors to improve the recall of partially occluded objects. The module predicts a tri-layer of segmentation masks for the target object, the occluder and the occludee, and by doing so is able to better predict the mask of the target object. (2) We propose a scalable pipeline for generating training data for the module by using amodal completion of existing object detection and instance segmentation training datasets to establish occlusion relationships. (3) We also establish a COCO evaluation dataset to measure the recall performance of partially occluded and separated objects. (4) We show that the plugin module inserted into a two-stage detector can boost the performance significantly, by only fine-tuning the detection head, and with additional improvements if the entire architecture is fine-tuned. COCO results are reported for Mask R-CNN with Swin-T or Swin-S backbones, and Cascade Mask R-CNN with a Swin-B backbone.

📄 PDF Abstract BibTeX arXiv:2210.10046

Code (1)

Championchess/Tri-Layer_Plugin_Occluded_Detection 공식 구현 pytorch

Tasks

Instance SegmentationObjectobject-detectionObject DetectionSemantic Segmentation

Methods 이 논문이 사용한 방법론

Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
RPN A Region Proposal Network, or RPN, is a fully convolutional network that simultaneously predicts object bounds and objectness scores at each position. The RPN is trained…
RoIAlign Region of Interest Align, or RoIAlign, is an operation for extracting a small feature map from each RoI in detection and segmentation based tasks. It removes the harsh…
Mask R-CNN Mask R-CNN extends Faster R-CNN to solve instance segmentation tasks. It achieves this by adding a branch for predicting an…
Cascade Mask R-CNN Cascade Mask R-CNN extends Cascade R-CNN to instance segmentation, by adding a mask head to the cascade. In the [Mask…

Similar Papers 제목 키워드 기반

Grid Loss: Detecting Occluded Faces

2016-09-01 · Michael Opitz, Georg Waltner, Georg Poier, Horst Possegger 외

Detection of partially occluded objects is a challenging computer vision problem. Standard Convolutional Neural Network (CNN) detectors fail if parts of the detection window are occluded, since not every sub-part of the …

Face Detection

Offline Tracking with Object Permanence

2023-10-02 · Xianzhong Liu, Holger Caesar

To reduce the expensive labor cost for manual labeling autonomous driving datasets, an alternative is to automatically label the datasets using an offline perception system. However, objects might be temporally occluded.…

3D Multi-Object TrackingAutonomous DrivingMulti-Object TrackingObject+1

Plugin Networks for Inference under Partial Evidence

2019-01-02 · Michal Koperski, Tomasz Konopczynski, Rafał Nowak, Piotr Semberecki 외

In this paper, we propose a novel method to incorporate partial evidence in the inference of deep convolutional neural networks. Contrary to the existing, top performing methods, which either iteratively modify the input…

Multi-Label ClassificationScene RecognitionSemantic Segmentation

Detecting Audio Deepfakes on the Edge:Lightweight SSL-Based Detection in a Browser Plugin

2026-06-29 · Octavian Pascu, Dan Oneata, Horia Cucu, Nicolas M. Muller arxiv

Audio deepfakes are a growing challenge for the general public, as well as for journalists and fact-checkers. The latter need reliable tools to verify the authenticity of their sources, while at the same time keeping the…

Audio Deepfake Detection

Multi-Scale Feature Pyramid Network: A Heavily Occluded Pedestrian Detection Network Based on ResNet

2021-03-05 · Sensors 2021 3 · Xiaotao Shao, Qing Wang, Wei Yang, Yun Chen 외

The existing pedestrian detection algorithms cannot effectively extract features of heavily occluded targets which results in lower detection accuracy. To solve the heavy occlusion in crowds, we propose a multi-scale f…

Object DetectionPedestrian Detection