Self-Supervised Learning for Real-World Object Detection: a Survey
Self-Supervised Learning (SSL) has emerged as a promising approach in computer vision, enabling networks to learn meaningful representations from large unlabeled datasets. SSL methods fall into two main categories: instance discrimination and Masked Image Modeling (MIM). While instance discrimination is fundamental to SSL, it was originally designed for classification and may be less effective for object detection, particularly for small objects. In this survey, we focus on SSL methods specifically tailored for real-world object detection, with an emphasis on detecting small objects in complex environments. Unlike previous surveys, we offer a detailed comparison of SSL strategies, including object-level instance discrimination and MIM methods, and assess their effectiveness for small object detection using both CNN and ViT-based architectures. Specifically, our benchmark is performed on the widely-used COCO dataset, as well as on a specialized real-world dataset focused on vehicle detection in infrared remote sensing imagery. We also assess the impact of pre-training on custom domain-specific datasets, highlighting how certain SSL strategies are better suited for handling uncurated data. Our findings highlight that instance discrimination methods perform well with CNN-based encoders, while MIM methods are better suited for ViT-based architectures and custom dataset pre-training. This survey provides a practical guide for selecting optimal SSL strategies, taking into account factors such as backbone architecture, object size, and custom pre-training requirements. Ultimately, we show that choosing an appropriate SSL pre-training strategy, along with a suitable encoder, significantly enhances performance in real-world object detection, particularly for small object detection in frugal settings.
Code (0)
등록된 구현이 없습니다.
Tasks
Objectobject-detectionObject DetectionSelf-Supervised LearningSmall Object DetectionSurveyvehicle detectionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Self-Supervised Object Detection via Generative Image Synthesis
We present SSOD, the first end-to-end analysis-by synthesis framework with controllable GANs for the task of self-supervised object detection. We use collections of real world images without bounding box annotations to l…
Image GenerationObjectobject-detectionObject DetectionLISO: Lidar-only Self-Supervised 3D Object Detection
3D object detection is one of the most important components in any Self-Driving stack, but current state-of-the-art (SOTA) lidar object detectors require costly & slow manual annotation of 3D bounding boxes to perform we…
3D Object DetectionObjectobject-detectionObject Detection+1Exploring the Capabilities and Limits of 3D Monocular Object Detection -- A Study on Simulation and Real World Data
3D object detection based on monocular camera data is a key enabler for autonomous driving. The task however, is ill-posed due to lack of depth information in 2D images. Recent deep learning methods show promising result…
3D Object DetectionAutonomous DrivingDepth Estimationobject-detection+1YOLO11-JDE: Fast and Accurate Multi-Object Tracking with Self-Supervised Re-ID
We introduce YOLO11-JDE, a fast and accurate multi-object tracking (MOT) solution that combines real-time object detection with self-supervised Re-Identification (Re-ID). By incorporating a dedicated Re-ID branch into YO…
Multi-Object Trackingobject-detectionObject DetectionObject Tracking+2SL3D: Self-supervised-Self-labeled 3D Recognition
Deep learning has attained remarkable success in many 3D visual recognition tasks, including shape classification, object detection, and semantic segmentation. However, many of these results rely on manually collecting d…
ClusteringObjectobject-detectionObject Detection+3