Multi-label Video Classification for Underwater Ship Inspection
Today ship hull inspection including the examination of the external coating, detection of defects, and other types of external degradation such as corrosion and marine growth is conducted underwater by means of Remotely Operated Vehicles (ROVs). The inspection process consists of a manual video analysis which is a time-consuming and labor-intensive process. To address this, we propose an automatic video analysis system using deep learning and computer vision to improve upon existing methods that only consider spatial information on individual frames in underwater ship hull video inspection. By exploring the benefits of adding temporal information and analyzing frame-based classifiers, we propose a multi-label video classification model that exploits the self-attention mechanism of transformers to capture spatiotemporal attention in consecutive video frames. Our proposed method has demonstrated promising results and can serve as a benchmark for future research and development in underwater video inspection applications.
Code (0)
등록된 구현이 없습니다.
Tasks
ClassificationVideo ClassificationSimilar Papers 제목 키워드 기반
End-To-End Underwater Video Enhancement: Dataset and Model
Underwater video enhancement (UVE) aims to improve the visibility and frame quality of underwater videos, which has significant implications for marine research and exploration. However, existing methods primarily focus …
Image EnhancementVideo EnhancementUnderwater single-channel acoustic signal multitarget recognition using convolutional neural networks
The radiated noise from ships is of great significance to target recognition, and several deep learning methods have been developed for the recognition of underwater acoustic signals. Previous studies have focused on sin…
Audio ClassificationAudio Multiple Target ClassificationBinary ClassificationDecodable but not structured: linear probing enables Underwater Acoustic Target Recognition with pretrained audio embeddings
Increasing levels of anthropogenic noise from ships contribute significantly to underwater sound pollution, posing risks to marine ecosystems. This makes monitoring crucial to understand and quantify the impact of the sh…
Transfer LearningThe Computation of Generalized Embeddings for Underwater Acoustic Target Recognition using Contrastive Learning
The increasing level of sound pollution in marine environments poses an increased threat to ocean health, making it crucial to monitor underwater noise. By monitoring this noise, the sources responsible for this pollutio…
Contrastive LearningSound ClassificationFathomNet: An underwater image training database for ocean exploration and discovery
Thousands of hours of marine video data are collected annually from remotely operated vehicles (ROVs) and other underwater assets. However, current manual methods of analysis impede the full utilization of collected data…
object-detectionObject Detection