Contrastive Learning through Auxiliary Branch for Video Object Detection
Video object detection is a challenging task because videos often suffer from image deterioration such as motion blur, occlusion, and deformable shapes, making it significantly more difficult than detecting objects in still images. Prior approaches have improved video object detection performance by employing feature aggregation and complex post-processing techniques, though at the cost of increased computational demands. To improve robustness to image degradation without additional computational load during inference, we introduce a straightforward yet effective Contrastive Learning through Auxiliary Branch (CLAB) method. First, we implement a constrastive auxiliary branch using a contrastive loss to enhance the feature representation capability of the video object detector's backbone. Next, we propose a dynamic loss weighting strategy that emphasizes auxiliary feature learning early in training while gradually prioritizing the detection task as training converges. We validate our approach through comprehensive experiments and ablation studies, demonstrating consistent performance gains. Without bells and whistles, CLAB reaches a performance of 84.0% mAP and 85.2% mAP with ResNet-101 and ResNeXt-101, respectively, on the ImageNet VID dataset, thus achieving state-of-the-art performance for CNN-based models without requiring additional post-processing methods.
Code (0)
등록된 구현이 없습니다.
Tasks
Video Object DetectionContrastive LearningResults from the Paper
| Rank | Task | Dataset | Model | Metrics |
|---|---|---|---|---|
| #16 | Video Object Detection | ImageNet VID | Contrastive Learning through Auxiliary B | MAP : 85.2 |
Similar Papers 제목 키워드 기반
Semantic Noise Reduction via Teacher-Guided Dual-Path Audio-Visual Representation Learning
Recent advances in audio-visual representation learning have shown the value of combining contrastive alignment with masked reconstruction. However, jointly optimizing these objectives in a single forward pass forces the…
Representation LearningVideo RetrievalEnhancing IMU-Based Online Handwriting Recognition via Contrastive Learning with Zero Inference Overhead
Online handwriting recognition using inertial measurement units opens up handwriting on paper as input for digital devices. Doing it on edge hardware improves privacy and lowers latency, but entails memory constraints. T…
Handwriting RecognitionContrastive LearningObject-Aware Multi-Branch Relation Networks for Spatio-Temporal Video Grounding
Spatio-temporal video grounding aims to retrieve the spatio-temporal tube of a queried object according to the given sentence. Currently, most existing grounding methods are restricted to well-aligned segment-sentence pa…
DiversityObjectRelationRelation Network+3Video Class Agnostic Segmentation with Contrastive Learning for Autonomous Driving
Semantic segmentation in autonomous driving predominantly focuses on learning from large-scale data with a closed set of known classes without considering unknown objects. Motivated by safety reasons, we address the vide…
Autonomous DrivingContrastive LearningSegmentationSemantic SegmentationSelf-Supervised Video Representation Learning with Motion-Contrastive Perception
Visual-only self-supervised learning has achieved significant improvement in video representation learning. Existing related methods encourage models to learn video representations by utilizing contrastive learning or de…
Contrastive LearningRepresentation LearningSelf-Supervised Learning