MLVSNet: Multi-Level Voting Siamese Network for 3D Visual Tracking
Benefiting from the excellent performance of Siamese-based trackers, huge progress on 2D visual tracking has been achieved. However, 3D visual tracking is still under-explored. Inspired by the idea of Hough voting in 3D object detection, in this paper, we propose a Multi-level Voting Siamese Network (MLVSNet) for 3D visual tracking from outdoor point cloud sequences. To deal with sparsity in outdoor 3D point clouds, we propose to perform Hough voting on multi-level features to get more vote centers and retain more useful information, instead of voting only on the final level feature as in previous methods. We also design an efficient and lightweight Target-Guided Attention (TGA) module to transfer the target information and highlight the target points in the search area. Moreover, we propose a Vote-cluster Feature Enhancement (VFE) module to exploit the relationships between different vote clusters. Extensive experiments on the 3D tracking benchmark of KITTI dataset demonstrate that our MLVSNet outperforms state-of-the-art methods with significant margins. Code will be available at https://github.com/CodeWZT/MLVSNet.
Code (1)
Tasks
3D Object Detectionobject-detectionObject DetectionVisual TrackingMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Applying Deep Neural Networks to automate visual verification of manual bracket installations in aerospace
In this work, we explore a deep learning based automated visual inspection and verification algorithm, based on the Siamese Neural Network architecture. Consideration is also given to how the input pairs of images can af…
Transfer LearningDMV: Visual Object Tracking via Part-level Dense Memory and Voting-based Retrieval
We propose a novel memory-based tracker via part-level dense memory and voting-based retrieval, called DMV. Since deep learning techniques have been introduced to the tracking field, Siamese trackers have attracted many …
Object TrackingRetrievalTemplate MatchingVisual Object TrackingGLT-T++: Global-Local Transformer for 3D Siamese Tracking with Ranking Loss
Siamese trackers based on 3D region proposal network (RPN) have shown remarkable success with deep Hough voting. However, using a single seed point feature as the cue for voting fails to produce high-quality 3D proposals…
3D Single Object TrackingObject TrackingRegion ProposalMultiple Context Features in Siamese Networks for Visual Object Tracking
Siamese networks have been successfully utilized to learn a robust matching function between pairs of images. Visual object tracking methods based on siamese networks have been gaining popularity recently due to their ro…
Object TrackingVisual Object TrackingHybrid Style Siamese Network: Incorporating style loss in complementary apparels retrieval
Image Retrieval grows to be an integral part of fashion e-commerce ecosystem as it keeps expanding in multitudes. Other than the retrieval of visually similar items, the retrieval of visually compatible or complementary …
Complimentary Image RetrievalImage RetrievalRetrievalStyle Transfer