OVLW-DETR: Open-Vocabulary Light-Weighted Detection Transformer
Open-vocabulary object detection focusing on detecting novel categories guided by natural language. In this report, we propose Open-Vocabulary Light-Weighted Detection Transformer (OVLW-DETR), a deployment friendly open-vocabulary detector with strong performance and low latency. Building upon OVLW-DETR, we provide an end-to-end training recipe that transferring knowledge from vision-language model (VLM) to object detector with simple alignment. We align detector with the text encoder from VLM by replacing the fixed classification layer weights in detector with the class-name embeddings extracted from the text encoder. Without additional fusing module, OVLW-DETR is flexible and deployment friendly, making it easier to implement and modulate. improving the efficiency of interleaved attention computation. Experimental results demonstrate that the proposed approach is superior over existing real-time open-vocabulary detectors on standard Zero-Shot LVIS benchmark. Source code and pre-trained models are available at [https://github.com/Atten4Vis/LW-DETR].
Code (1)
Tasks
Language ModelingLanguage Modellingobject-detectionObject DetectionOpen-vocabulary object detectionOpen Vocabulary Object DetectionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
A Lightweight Modular Framework for Low-Cost Open-Vocabulary Object Detection Training
Object detection is a fundamental challenge in computer vision, centered on recognizing objects within images, with diverse applications in areas like image analysis, robotics, and autonomous vehicles. Although existing …
Autonomous VehiclesComputational Efficiencyobject-detectionObject Detection+5Open-Vocabulary DETR with Conditional Matching
Open-vocabulary object detection, which is concerned with the problem of detecting novel objects guided by natural language, has gained increasing attention from the community. Ideally, we would like to extend an open-vo…
Language Modellingobject-detectionObject DetectionOpen-vocabulary object detection+1OV-DEIM: Real-time DETR-Style Open-Vocabulary Object Detection with GridSynthetic Augmentation
Real-time open-vocabulary object detection (OVOD) is essential for practical deployment in dynamic environments, where models must recognize a large and evolving set of categories under strict latency constraints. Curren…
Data AugmentationObject DetectionDetRefiner: Model-Agnostic Detection Refinement with Feature Fusion Transformer
Open-vocabulary object detection (OVOD) aims to detect both seen and unseen categories, yet existing methods often struggle to generalize to novel objects due to limited integration of global and local contextual cues. W…
Object DetectionDeCo-DETR: Decoupled Cognition DETR for efficient Open-Vocabulary Object Detection
Open-vocabulary object detection (OVOD) enables models to recognize objects beyond predefined categories, but existing approaches remain limited in practical deployment. On the one hand, multimodal designs often incur su…
Object Detection