Underwater Object Tracker: UOSTrack for Marine Organism Grasping of Underwater Vehicles
A visual single-object tracker is an indispensable component of underwater vehicles (UVs) in marine organism grasping tasks. Its accuracy and stability are imperative to guide the UVs to perform grasping behavior. Although single-object trackers show competitive performance in the challenge of underwater image degradation, there are still issues with sample imbalance and exclusion of similar objects that need to be addressed for application in marine organism grasping. This paper proposes Underwater OSTrack (UOSTrack), which consists of underwater image and open-air sequence hybrid training (UOHT), and motion-based post-processing (MBPP). The UOHT training paradigm is designed to train the sample-imbalanced underwater tracker so that the tracker is exposed to a great number of underwater domain training samples and learns the feature expressions. The MBPP paradigm is proposed to exclude similar objects. It uses the estimation box predicted with a Kalman filter and the candidate boxes in the response map to relocate the lost tracked object in the candidate area. UOSTrack achieves an average performance improvement of 4.41% and 7.98% maximum compared to state-of-the-art methods on various benchmarks, respectively. Field experiments have verified the accuracy and stability of our proposed UOSTrack for UVs in marine organism grasping tasks. More details can be found at https://github.com/LiYunfengLYF/UOSTrack.
Code (2)
Tasks
Data AugmentationmbppObjectobject-detectionObject DetectionObject TrackingSimilar Papers 제목 키워드 기반
Semi-Supervised Visual Tracking of Marine Animals using Autonomous Underwater Vehicles
In-situ visual observations of marine organisms is crucial to developing behavioural understandings and their relations to their surrounding ecosystem. Typically, these observations are collected via divers, tags, and re…
GPUVisual TrackingUWBench: A Comprehensive Vision-Language Benchmark for Underwater Understanding
Large vision-language models (VLMs) have achieved remarkable success in natural scene understanding, yet their application to underwater environments remains largely unexplored. Underwater imagery presents unique challen…
Visual Question AnsweringMultimodal ReasoningScene UnderstandingObject RecognitionSLENet: A Guidance-Enhanced Network for Underwater Camouflaged Object Detection
Underwater Camouflaged Object Detection (UCOD) aims to identify objects that blend seamlessly into underwater environments. This task is critically important to marine ecology. However, it remains largely underexplored a…
Object DetectionExpose Camouflage in the Water: Underwater Camouflaged Instance Segmentation and Dataset
With the development of underwater exploration and marine protection, underwater vision tasks are widespread. Due to the degraded underwater environment, characterized by color distortion, low contrast, and blurring, cam…
Instance SegmentationEfficient Object Detection of Marine Debris using Pruned YOLO Model
Marine debris poses significant harm to marine life due to substances like microplastics, polychlorinated biphenyls, and pesticides, which damage habitats and poison organisms. Human-based solutions, such as diving, are …
object-detectionObject Detection