paper-with-me

Papers

Enhancing Object Detection for Autonomous Driving by Optimizing Anchor Generation and Addressing Class Imbalance

2021-04-08 · Manuel Carranza-García, Pedro Lara-Benítez, Jorge García-Gutiérrez, José C. Riquelme

Object detection has been one of the most active topics in computer vision for the past years. Recent works have mainly focused on pushing the state-of-the-art in the general-purpose COCO benchmark. However, the use of such detection frameworks in specific applications such as autonomous driving is yet an area to be addressed. This study presents an enhanced 2D object detector based on Faster R-CNN that is better suited for the context of autonomous vehicles. Two main aspects are improved: the anchor generation procedure and the performance drop in minority classes. The default uniform anchor configuration is not suitable in this scenario due to the perspective projection of the vehicle cameras. Therefore, we propose a perspective-aware methodology that divides the image into key regions via clustering and uses evolutionary algorithms to optimize the base anchors for each of them. Furthermore, we add a module that enhances the precision of the second-stage header network by including the spatial information of the candidate regions proposed in the first stage. We also explore different re-weighting strategies to address the foreground-foreground class imbalance, showing that the use of a reduced version of focal loss can significantly improve the detection of difficult and underrepresented objects in two-stage detectors. Finally, we design an ensemble model to combine the strengths of the different learning strategies. Our proposal is evaluated with the Waymo Open Dataset, which is the most extensive and diverse up to date. The results demonstrate an average accuracy improvement of 6.13% mAP when using the best single model, and of 9.69% mAP with the ensemble. The proposed modifications over the Faster R-CNN do not increase computational cost and can easily be extended to optimize other anchor-based detection frameworks.

📄 PDF Abstract BibTeX arXiv:2104.03888

Code (1)

carranza96/waymo-detection-optimization 공식 구현 tf

Tasks

Autonomous DrivingAutonomous VehiclesEvolutionary Algorithmsobject-detectionObject Detection

Methods 이 논문이 사용한 방법론

Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
RoIPool 설명 없음
RPN A Region Proposal Network, or RPN, is a fully convolutional network that simultaneously predicts object bounds and objectness scores at each position. The RPN is trained…
Focal Loss A Focal Loss function addresses class imbalance during training in tasks like object detection. Focal loss applies a modulating term to the cross entropy loss in order to…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Faster R-CNN Faster R-CNN is an object detection model that improves on Fast R-CNN by utilising a region proposal network…

Similar Papers 제목 키워드 기반

KAN-RCBEVDepth: A multi-modal fusion algorithm in object detection for autonomous driving

2024-08-04 · Zhihao Lai, Chuanhao Liu, Shihui Sheng, Zhiqiang Zhang

Accurate 3D object detection in autonomous driving is critical yet challenging due to occlusions, varying object sizes, and complex urban environments. This paper introduces the KAN-RCBEVDepth method, an innovative appro…

3D Object DetectionAttributeAutonomous DrivingObject+2

YOLO-Vehicle-Pro: A Cloud-Edge Collaborative Framework for Object Detection in Autonomous Driving under Adverse Weather Conditions

2024-10-23 · Xiguang Li, Jiafu Chen, Yunhe Sun, Na Lin 외

With the rapid advancement of autonomous driving technology, efficient and accurate object detection capabilities have become crucial factors in ensuring the safety and reliability of autonomous driving systems. However,…

Autonomous DrivingImage DehazingObjectobject-detection+1

Enhancing Object Detection in Adverse Conditions using Thermal Imaging

2019-09-30 · Kshitij Agrawal, Anbumani Subramanian

Autonomous driving relies on deriving understanding of objects and scenes through images. These images are often captured by sensors in the visible spectrum. For improved detection capabilities we propose the use of ther…

Autonomous DrivingObjectobject-detectionObject Detection+1

Application of YOLOv8 in monocular downward multiple Car Target detection

2025-05-15 · Shijie Lyu

Autonomous driving technology is progressively transforming traditional car driving methods, marking a significant milestone in modern transportation. Object detection serves as a cornerstone of autonomous systems, playi…

Autonomous Drivingobject-detectionObject DetectionSmall Object Detection

Integrating Object Detection Modality into Visual Language Model for Enhanced Autonomous Driving Agent

2024-11-08 · Linfeng He, Yiming Sun, Sihao Wu, Jiaxu Liu 외

In this paper, we propose a novel framework for enhancing visual comprehension in autonomous driving systems by integrating visual language models (VLMs) with additional visual perception module specialised in object det…

Autonomous DrivingLanguage ModelingLanguage Modellingobject-detection+3