FOLT: Fast Multiple Object Tracking from UAV-captured Videos Based on Optical Flow
Multiple object tracking (MOT) has been successfully investigated in computer vision. However, MOT for the videos captured by unmanned aerial vehicles (UAV) is still challenging due to small object size, blurred object appearance, and very large and/or irregular motion in both ground objects and UAV platforms. In this paper, we propose FOLT to mitigate these problems and reach fast and accurate MOT in UAV view. Aiming at speed-accuracy trade-off, FOLT adopts a modern detector and light-weight optical flow extractor to extract object detection features and motion features at a minimum cost. Given the extracted flow, the flow-guided feature augmentation is designed to augment the object detection feature based on its optical flow, which improves the detection of small objects. Then the flow-guided motion prediction is also proposed to predict the object's position in the next frame, which improves the tracking performance of objects with very large displacements between adjacent frames. Finally, the tracker matches the detected objects and predicted objects using a spatially matching scheme to generate tracks for every object. Experiments on Visdrone and UAVDT datasets show that our proposed model can successfully track small objects with large and irregular motion and outperform existing state-of-the-art methods in UAV-MOT tasks.
Code (0)
등록된 구현이 없습니다.
Tasks
motion predictionMultiple Object TrackingObjectobject-detectionObject DetectionObject TrackingOptical Flow EstimationSimilar Papers 제목 키워드 기반
FastTrackTr:Towards Fast Multi-Object Tracking with Transformers
Transformer-based multi-object tracking (MOT) methods have captured the attention of many researchers in recent years. However, these models often suffer from slow inference speeds due to their structure or other issues.…
Multi-Object TrackingObjectObject TrackingIs Non-IID Data a Threat in Federated Online Learning to Rank?
In this perspective paper we study the effect of non independent and identically distributed (non-IID) data on federated online learning to rank (FOLTR) and chart directions for future work in this new and largely unexpl…
Federated LearningInformation RetrievalLearning-To-RankRetrievalAn Analysis of Untargeted Poisoning Attack and Defense Methods for Federated Online Learning to Rank Systems
Federated online learning to rank (FOLTR) aims to preserve user privacy by not sharing their searchable data and search interactions, while guaranteeing high search effectiveness, especially in contexts where individual …
Federated LearningLearning-To-RankModel PoisoningUnlearning for Federated Online Learning to Rank: A Reproducibility Study
This paper reports on findings from a comparative study on the effectiveness and efficiency of federated unlearning strategies within Federated Online Learning to Rank (FOLTR), with specific attention to systematically a…
Learning-To-RankA Large Scale Urban Surveillance Video Dataset for Multiple-Object Tracking and Behavior Analysis
Multiple-object tracking and behavior analysis have been the essential parts of surveillance video analysis for public security and urban management. With billions of surveillance video captured all over the world, multi…
ManagementMultiple Object TrackingObjectObject Tracking