paper-with-me

홈 › Papers

Structure Information is the Key: Self-Attention RoI Feature Extractor in 3D Object Detection

2021-11-01 · Diankun Zhang, Zhijie Zheng, Xueting Bi, Xiaojun Liu

Unlike 2D object detection where all RoI features come from grid pixels, the RoI feature extraction of 3D point cloud object detection is more diverse. In this paper, we first compare and analyze the differences in structure and performance between the two state-of-the-art models PV-RCNN and Voxel-RCNN. Then, we find that the performance gap between the two models does not come from point information, but structural information. The voxel features contain more structural information because they do quantization instead of downsampling to point cloud so that they can contain basically the complete information of the whole point cloud. The stronger structural information in voxel features makes the detector have higher performance in our experiments even if the voxel features don't have accurate location information. Then, we propose that structural information is the key to 3D object detection. Based on the above conclusion, we propose a Self-Attention RoI Feature Extractor (SARFE) to enhance structural information of the feature extracted from 3D proposals. SARFE is a plug-and-play module that can be easily used on existing 3D detectors. Our SARFE is evaluated on both KITTI dataset and Waymo Open dataset. With the newly introduced SARFE, we improve the performance of the state-of-the-art 3D detectors by a large margin in cyclist on KITTI dataset while keeping real-time capability.

📄 PDF Abstract BibTeX arXiv:2111.00931

Code (0)

등록된 구현이 없습니다.

Tasks

2D Object Detection3D Object DetectionObjectobject-detectionObject DetectionQuantization

Similar Papers 제목 키워드 기반

Lightweight Recurrent Cross-modal Encoder for Video Question Answering

2023-06-30 · Knowledge-Based Systems 2023 6 · Steve Andreas Immanuel, Cheol Jeong

A video question answering task essentially boils down to how to fuse the information between text and video effectively to predict an answer. Most works employ a transformer encoder as a cross-modal encoder to fuse both…

Action RecognitionQuestion AnsweringTGIF-ActionTGIF-Frame+3

TUNeS: A Temporal U-Net with Self-Attention for Video-based Surgical Phase Recognition

2023-07-19 · Isabel Funke, Dominik Rivoir, Stefanie Krell, Stefanie Speidel

Objective: To enable context-aware computer assistance in the operating room of the future, cognitive systems need to understand automatically which surgical phase is being performed by the medical team. The primary sour…

Surgical phase recognition

MultiResolution Attention Extractor for Small Object Detection

2020-06-10 · Fan Zhang, Licheng Jiao, Lingling Li, Fang Liu 외

Small objects are difficult to detect because of their low resolution and small size. The existing small object detection methods mainly focus on data preprocessing or narrowing the differences between large and small ob…

Hard AttentionObjectobject-detectionObject Detection+1

ESTISR: Adapting Efficient Scene Text Image Super-resolution for Real-Scenes

2023-06-04 · Minghao Fu, Xin Man, Yihan Xu, Jie Shao

While scene text image super-resolution (STISR) has yielded remarkable improvements in accurately recognizing scene text, prior methodologies have placed excessive emphasis on optimizing performance, rather than paying d…

Image RestorationImage Super-ResolutionSuper-Resolution

MultiFormer: A Multi-Person Pose Estimation System Based on CSI and Attention Mechanism

2025-05-28 · Yanyi Qu, Haoyang Ma, Wenhui Xiong

Human pose estimation based on Channel State Information (CSI) has emerged as a promising approach for non-intrusive and precise human activity monitoring, yet faces challenges including accurate multi-person pose recogn…

Multi-Person Pose EstimationPose Estimation