Points as Queries: Weakly Semi-supervised Object Detection by Points

2021-04-15 · CVPR 2021 1 · Liangyu Chen, Tong Yang, Xiangyu Zhang, Wei zhang, Jian Sun

We propose a novel point annotated setting for the weakly semi-supervised object detection task, in which the dataset comprises small fully annotated images and large weakly annotated images by points. It achieves a balance between tremendous annotation burden and detection performance. Based on this setting, we analyze existing detectors and find that these detectors have difficulty in fully exploiting the power of the annotated points. To solve this, we introduce a new detector, Point DETR, which extends DETR by adding a point encoder. Extensive experiments conducted on MS-COCO dataset in various data settings show the effectiveness of our method. In particular, when using 20% fully labeled data from COCO, our detector achieves a promising performance, 33.3 AP, which outperforms a strong baseline (FCOS) by 2.0 AP, and we demonstrate the point annotations bring over 10 points in various AR metrics.

📄 PDF Abstract BibTeX arXiv:2104.07434

Code (1)

haozheliu-st/point-beyond-class pytorch

Tasks

object-detection Object Detection Semi-Supervised Object Detection

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음

Attention 설명 없음

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.

Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…

Position-Wise Feed-Forward Layer 설명 없음

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…

Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…

Adam 설명 없음

Relational Matching for Weakly Semi-Supervised Oriented Object Detection

2024-01-01 · CVPR 2024 1 · Wenhao Wu, Hau-San Wong, Si Wu, Tianyou Zhang

Oriented object detection has witnessed significant progress in recent years. However the impressive performance of oriented object detectors is at the huge cost of labor-intensive annotations and deteriorates once t…

Graph Matching Object object-detection Object Detection+2

Point-Teaching: Weakly Semi-Supervised Object Detection with Point Annotations

2022-06-01 · Yongtao Ge, Qiang Zhou, Xinlong Wang, Zhibin Wang 외

Point annotations are considerably more time-efficient than bounding box annotations. However, how to use cheap point annotations to boost the performance of semi-supervised object detection remains largely unsolved. In …

Data Augmentation Multiple Instance Learning Object object-detection+2

A Simple Vision Transformer for Weakly Semi-supervised 3D Object Detection

2023-01-01 · ICCV 2023 1 · Dingyuan Zhang, Dingkang Liang, Zhikang Zou, Jingyu Li 외

Advanced 3D object detection methods usually rely on large-scale, elaborately labeled datasets to achieve good performance. However, labeling the bounding boxes for the 3D objects is difficult and expensive. Although…

3D Object Detection Object object-detection Object Detection

Partial Weakly-Supervised Oriented Object Detection

2025-07-03 · Mingxin Liu, Peiyuan Zhang, Yuan Liu, Wei Zhang 외 arxiv

The growing demand for oriented object detection (OOD) across various domains has driven significant research in this area. However, the high cost of dataset annotation remains a major concern. Current mainstream OOD alg…

Object Detection

Semi-Weakly Supervised Object Detection by Sampling Pseudo Ground-Truth Boxes

2022-04-01 · Akhil Meethal, Marco Pedersoli, Zhongwen Zhu, Francisco Perdigon Romero 외

Semi- and weakly-supervised learning have recently attracted considerable attention in the object detection literature since they can alleviate the cost of annotation needed to successfully train deep learning models. St…

Data Augmentation object-detection Object Detection Weakly-supervised Learning+1