SeqTrack3D: Exploring Sequence Information for Robust 3D Point Cloud Tracking
3D single object tracking (SOT) is an important and challenging task for the autonomous driving and mobile robotics. Most existing methods perform tracking between two consecutive frames while ignoring the motion patterns of the target over a series of frames, which would cause performance degradation in the scenes with sparse points. To break through this limitation, we introduce Sequence-to-Sequence tracking paradigm and a tracker named SeqTrack3D to capture target motion across continuous frames. Unlike previous methods that primarily adopted three strategies: matching two consecutive point clouds, predicting relative motion, or utilizing sequential point clouds to address feature degradation, our SeqTrack3D combines both historical point clouds and bounding box sequences. This novel method ensures robust tracking by leveraging location priors from historical boxes, even in scenes with sparse points. Extensive experiments conducted on large-scale datasets show that SeqTrack3D achieves new state-of-the-art performances, improving by 6.00% on NuScenes and 14.13% on Waymo dataset. The code will be made public at https://github.com/aron-lin/seqtrack3d.
Code (1)
Tasks
3D Single Object TrackingAutonomous DrivingObject TrackingSimilar Papers 제목 키워드 기반
Unified Sequence-to-Sequence Learning for Single- and Multi-Modal Visual Object Tracking
In this paper, we introduce a new sequence-to-sequence learning framework for RGB-based and multi-modal object tracking. First, we present SeqTrack for RGB-based tracking. It casts visual tracking as a sequence generatio…
DecoderObjectObject TrackingRgb-T Tracking+2Point2Sequence: Learning the Shape Representation of 3D Point Clouds with an Attention-based Sequence to Sequence Network
Exploring contextual information in the local region is important for shape understanding and analysis. Existing studies often employ hand-crafted or explicit ways to encode contextual information of local regions. Howev…
3D Part Segmentation3D Point Cloud ClassificationDecoderShape Representation Of 3D Point CloudsTPU-GAN: Learning temporal coherence from dynamic point cloud sequences
Point cloud sequence is an important data representation that provides flexible shape and motion information. Prior work demonstrates that incorporating scene flow information into loss can make model learn temporally co…
Generative Adversarial Networkpoint cloud upsamplingSuper-ResolutionPointHR: Exploring High-Resolution Architectures for 3D Point Cloud Segmentation
Significant progress has been made recently in point cloud segmentation utilizing an encoder-decoder framework, which initially encodes point clouds into low-resolution representations and subsequently decodes high-resol…
DecoderPoint Cloud SegmentationSemantic Segmentation3DMambaComplete: Exploring Structured State Space Model for Point Cloud Completion
Point cloud completion aims to generate a complete and high-fidelity point cloud from an initially incomplete and low-quality input. A prevalent strategy involves leveraging Transformer-based models to encode global feat…
MambaPoint Cloud CompletionPoint cloud reconstruction