paper-with-me

Papers

Dense Distinct Query for End-to-End Object Detection

2023-03-22 · CVPR 2023 1 · Shilong Zhang, Xinjiang Wang, Jiaqi Wang, Jiangmiao Pang, Chengqi Lyu, Wenwei Zhang, Ping Luo, Kai Chen

One-to-one label assignment in object detection has successfully obviated the need for non-maximum suppression (NMS) as postprocessing and makes the pipeline end-to-end. However, it triggers a new dilemma as the widely used sparse queries cannot guarantee a high recall, while dense queries inevitably bring more similar queries and encounter optimization difficulties. As both sparse and dense queries are problematic, then what are the expected queries in end-to-end object detection? This paper shows that the solution should be Dense Distinct Queries (DDQ). Concretely, we first lay dense queries like traditional detectors and then select distinct ones for one-to-one assignments. DDQ blends the advantages of traditional and recent end-to-end detectors and significantly improves the performance of various detectors including FCN, R-CNN, and DETRs. Most impressively, DDQ-DETR achieves 52.1 AP on MS-COCO dataset within 12 epochs using a ResNet-50 backbone, outperforming all existing detectors in the same setting. DDQ also shares the benefit of end-to-end detectors in crowded scenes and achieves 93.8 AP on CrowdHuman. We hope DDQ can inspire researchers to consider the complementarity between traditional methods and end-to-end detectors. The source code can be found at \url{https://github.com/jshilong/DDQ}.

📄 PDF Abstract BibTeX arXiv:2303.12776

Code (2)

jshilong/ddq 공식 구현 pytorch
wokaikaixinxin/rqformer pytorch

Tasks

Objectobject-detectionObject Detection

Methods 이 논문이 사용한 방법론

Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
Max Pooling Max Pooling is a pooling operation that calculates the maximum value for patches of a feature map, and uses it to create a downsampled (pooled) feature map. It is usually…
FCN Fully Convolutional Networks, or FCNs, are an architecture used mainly for semantic segmentation. They employ solely locally connected layers, such as…

Similar Papers 제목 키워드 기반

What Are Expected Queries in End-to-End Object Detection?

2022-06-02 · Shilong Zhang, Xinjiang Wang, Jiaqi Wang, Jiangmiao Pang 외

End-to-end object detection is rapidly progressed after the emergence of DETR. DETRs use a set of sparse queries that replace the dense candidate boxes in most traditional detectors. In comparison, the sparse queries can…

Instance Segmentationobject-detectionObject DetectionSemantic Segmentation

Generalized-Scale Object Counting with Gradual Query Aggregation

2025-11-11 · Jer Pelhan, Alan Lukezic, Matej Kristan arxiv

Few-shot detection-based counters estimate the number of instances in the image specified only by a few test-time exemplars. A common approach to localize objects across multiple sizes is to merge backbone features of di…

Small Object DetectionObject Counting

BEVNeXt: Reviving Dense BEV Frameworks for 3D Object Detection

2023-12-04 · CVPR 2024 1 · Zhenxin Li, Shiyi Lan, Jose M. Alvarez, Zuxuan Wu

Recently, the rise of query-based Transformer decoders is reshaping camera-based 3D object detection. These query-based decoders are surpassing the traditional dense BEV (Bird's Eye View)-based methods. However, we argue…

3D Object DetectionDecoderDepth EstimationObject+3

RQFormer: Rotated Query Transformer for End-to-End Oriented Object Detection

2023-11-29 · Jiaqi Zhao, Zeyu Ding, Yong Zhou, Hancheng Zhu 외

Oriented object detection presents a challenging task due to the presence of object instances with multiple orientations, varying scales, and dense distributions. Recently, end-to-end detectors have made significant stri…

DecoderObjectobject-detectionObject Detection+1

See It All: Contextualized Late Aggregation for 3D Dense Captioning

2024-08-14 · Minjung Kim, Hyung Suk Lim, Seung Hwan Kim, Soonyoung Lee 외

3D dense captioning is a task to localize objects in a 3D scene and generate descriptive sentences for each object. Recent approaches in 3D dense captioning have adopted transformer encoder-decoder frameworks from object…

3D dense captioningAllAttributeCaption Generation+6