CXTrack: Improving 3D Point Cloud Tracking with Contextual Information
3D single object tracking plays an essential role in many applications, such as autonomous driving. It remains a challenging problem due to the large appearance variation and the sparsity of points caused by occlusion and limited sensor capabilities. Therefore, contextual information across two consecutive frames is crucial for effective object tracking. However, points containing such useful information are often overlooked and cropped out in existing methods, leading to insufficient use of important contextual knowledge. To address this issue, we propose CXTrack, a novel transformer-based network for 3D object tracking, which exploits ConteXtual information to improve the tracking results. Specifically, we design a target-centric transformer network that directly takes point features from two consecutive frames and the previous bounding box as input to explore contextual information and implicitly propagate target cues. To achieve accurate localization for objects of all sizes, we propose a transformer-based localization head with a novel center embedding module to distinguish the target from distractors. Extensive experiments on three large-scale datasets, KITTI, nuScenes and Waymo Open Dataset, show that CXTrack achieves state-of-the-art tracking performance while running at 34 FPS.
Code (0)
등록된 구현이 없습니다.
Tasks
3D Object Tracking3D Single Object TrackingAutonomous DrivingObjectObject TrackingSimilar Papers 제목 키워드 기반
3D Single-object Tracking in Point Clouds with High Temporal Variation
The high temporal variation of the point clouds is the key challenge of 3D single-object tracking (3D SOT). Existing approaches rely on the assumption that the shape variation of the point clouds and the motion of the ob…
3D Single Object TrackingObject TrackingDigging into Intrinsic Contextual Information for High-fidelity 3D Point Cloud Completion
The common occurrence of occlusion-induced incompleteness in point clouds has made point cloud completion (PCC) a highly-concerned task in the field of geometric processing. Existing PCC methods typically produce complet…
Point Cloud CompletionContextual Modeling for 3D Dense Captioning on Point Clouds
3D dense captioning, as an emerging vision-language task, aims to identify and locate each object from a set of point clouds and generate a distinctive natural language sentence for describing each located object. Howeve…
3D dense captioningDense CaptioningObjectSentenceSTTracker: Spatio-Temporal Tracker for 3D Single Object Tracking
3D single object tracking with point clouds is a critical task in 3D computer vision. Previous methods usually input the last two frames and use the predicted box to get the template point cloud in previous frame and the…
3D Single Object TrackingObjectObject TrackingPoint 4D Transformer Networks for Spatio-Temporal Modeling in Point Cloud Videos
Point cloud videos exhibit irregularities and lack of order along the spatial dimension where points emerge inconsistently across different frames. To capture the dynamics in point cloud videos, point tracking is usu…
3D Action RecognitionAction RecognitionPoint TrackingSemantic Segmentation