UIU-Net: U-Net in U-Net for Infrared Small Object Detection
Learning-based infrared small object detection methods currently rely heavily on the classification backbone network. This tends to result in tiny object loss and feature distinguishability limitations as the network depth increases. Furthermore, small objects in infrared images are frequently emerged bright and dark, posing severe demands for obtaining precise object contrast information. For this reason, we in this paper propose a simple and effective ``U-Net in U-Net'' framework, UIU-Net for short, and detect small objects in infrared images. As the name suggests, UIU-Net embeds a tiny U-Net into a larger U-Net backbone, enabling the multi-level and multi-scale representation learning of objects. Moreover, UIU-Net can be trained from scratch, and the learned features can enhance global and local contrast information effectively. More specifically, the UIU-Net model is divided into two modules: the resolution-maintenance deep supervision (RM-DS) module and the interactive-cross attention (IC-A) module. RM-DS integrates Residual U-blocks into a deep supervision network to generate deep multi-scale resolution-maintenance features while learning global context information. Further, IC-A encodes the local context information between the low-level details and high-level semantic features. Extensive experiments conducted on two infrared single-frame image datasets, i.e., SIRST and Synthetic datasets, show the effectiveness and superiority of the proposed UIU-Net in comparison with several state-of-the-art infrared small object detection methods. The proposed UIU-Net also produces powerful generalization performance for video sequence infrared small object datasets, e.g., ATR ground/air video sequence dataset. The codes of this work are available openly at \url{https://github.com/danfenghong/IEEE_TIP_UIU-Net}.
Code (1)
Tasks
Objectobject-detectionObject DetectionRepresentation LearningSmall Object DetectionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
HCF-Net: Hierarchical Context Fusion Network for Infrared Small Object Detection
Infrared small object detection is an important computer vision task involving the recognition and localization of tiny objects in infrared images, which usually contain only a few pixels. However, it encounters difficul…
channel selectionobject-detectionObject DetectionSmall Object Detection$\textit{A Contrario}$ Paradigm for YOLO-based Infrared Small Target Detection
Detecting small to tiny targets in infrared images is a challenging task in computer vision, especially when it comes to differentiating these targets from noisy or textured backgrounds. Traditional object detection meth…
object-detectionObject DetectionSegmentationInfra-YOLO: Efficient Neural Network Structure with Model Compression for Real-Time Infrared Small Object Detection
Although convolutional neural networks have made outstanding achievements in visible light target detection, there are still many challenges in infrared small object detection because of the low signal-to-noise ratio, in…
Efficient Neural NetworkModel CompressionObjectobject-detection+2Deep learning based infrared small object segmentation: Challenges and future directions
Infrared sensing is a core method for supporting unmanned systems, such as autonomous vehicles and drones. Recently, infrared sensors have been widely deployed on mobile and stationary platforms for detection and classif…
Autonomous VehiclesObject RecognitionSemantic SegmentationRobust infrared small target detection using self-supervised and a contrario paradigms
Detecting small targets in infrared images poses significant challenges in defense applications due to the presence of complex backgrounds and the small size of the targets. Traditional object detection methods often str…
object-detectionObject DetectionSelf-Supervised LearningSmall Object Detection