홈 › Papers

DOD-SA: Infrared-Visible Decoupled Object Detection with Single-Modality Annotations

Infrared-visible object detection has shown great potential in real-world applications, enabling robust all-day perception by leveraging the complementary information of infrared and visible images. However, existing methods typically require dual-modality annotations to output decoupled detection results, leading to high annotation costs and limiting scalability in large-scale remote sensing applications. To address this challenge, we propose a novel infrared-visible \textbf{D}ecoupled \textbf{O}bject \textbf{D}etection framework with \textbf{S}ingle-modality \textbf{A}nnotations, called DOD-SA. It is built upon a Single- and Dual-Modality Collaborative Teacher-Student Network (CoSD-TSNet), which consists of a single-modality branch (SM-Branch) and a dual-modality decoupled branch (DMD-Branch). This design enables cross-modality knowledge transfer from the labeled modality to the unlabeled modality, and facilitates effective cross-branch supervision. To further improve the quality of pseudo-labels, we introduce a Progressive and Self-Tuning Training Strategy (PaST) that trains the model in three stages: 1) SM-Branch self-training, 2) SM-Branch guiding the learning of DMD-Branch, and 3) DMD-Branch refinement. In addition, we design a Pseudo Label Assigner (PLA) to match labels across modalities, explicitly addressing modality misalignment during training.

Code (0)

등록된 구현이 없습니다.

Tasks

Similar Papers 제목 키워드 기반