Multispectral Object Detection with Deep Learning
Object detection in natural scenes can be a challenging task. In many real-life situations, the visible spectrum is not suitable for traditional computer vision tasks. Moving outside the visible spectrum range, such as the thermal spectrum or the near-infrared (NIR) images, is much more beneficial in low visibility conditions, NIR images are very helpful for understanding the object's material quality. In this work, we have taken images with both the Thermal and NIR spectrum for the object detection task. As multi-spectral data with both Thermal and NIR is not available for the detection task, we needed to collect data ourselves. Data collection is a time-consuming process, and we faced many obstacles that we had to overcome. We train the YOLO v3 network from scratch to detect an object from multi-spectral images. Also, to avoid overfitting, we have done data augmentation and tune hyperparameters.
Code (0)
등록된 구현이 없습니다.
Tasks
Data AugmentationDeep LearningMultispectral Object DetectionObjectobject-detectionObject DetectionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Optimizing Multispectral Object Detection: A Bag of Tricks and Comprehensive Benchmarks
Multispectral object detection, utilizing RGB and TIR (thermal infrared) modalities, is widely recognized as a challenging task. It requires not only the effective extraction of features from both modalities and robust f…
Multispectral Object DetectionObjectobject-detectionObject DetectionMultispectral Fusion for Object Detection with Cyclic Fuse-and-Refine Blocks
Multispectral images (e.g. visible and infrared) may be particularly useful when detecting objects with the same model in different environments (e.g. day/night outdoor scenes). To effectively use the different spectra, …
Multispectral Object DetectionObjectobject-detectionObject DetectionGuided Attentive Feature Fusion for Multispectral Pedestrian Detection
Multispectral image pairs can provide complementary visual information, making pedestrian detection systems more robust and reliable. To benefit from both RGB and thermal IR modalities, we introduce a novel attentive …
Multispectral Object Detectionobject-detectionObject DetectionPedestrian DetectionYOLOv11-RGBT: Towards a Comprehensive Single-Stage Multispectral Object Detection Framework
Multispectral object detection, which integrates information from multiple bands, can enhance detection accuracy and environmental adaptability, holding great application potential across various fields. Although existin…
Multispectral Object Detectionobject-detectionObject DetectionFrom Words to Wavelengths: VLMs for Few-Shot Multispectral Object Detection
Multispectral object detection is critical for safety-sensitive applications such as autonomous driving and surveillance, where robust perception under diverse illumination conditions is essential. However, the limited a…
Multispectral Object DetectionAutonomous Driving