MVCTrack: Boosting 3D Point Cloud Tracking via Multimodal-Guided Virtual Cues
3D single object tracking is essential in autonomous driving and robotics. Existing methods often struggle with sparse and incomplete point cloud scenarios. To address these limitations, we propose a Multimodal-guided Virtual Cues Projection (MVCP) scheme that generates virtual cues to enrich sparse point clouds. Additionally, we introduce an enhanced tracker MVCTrack based on the generated virtual cues. Specifically, the MVCP scheme seamlessly integrates RGB sensors into LiDAR-based systems, leveraging a set of 2D detections to create dense 3D virtual cues that significantly improve the sparsity of point clouds. These virtual cues can naturally integrate with existing LiDAR-based 3D trackers, yielding substantial performance gains. Extensive experiments demonstrate that our method achieves competitive performance on the NuScenes dataset.
Code (1)
Tasks
3D Single Object TrackingAutonomous DrivingObject TrackingMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Depth-Semantic Alignment and Affinity-Guided Fusion for Structured Radar Point Cloud Generation
Point clouds are an important carrier of three-dimensional spatial information, and their quality directly affects the performance of downstream perception tasks such as object detection and tracking. However, millimeter…
Point Cloud GenerationObject DetectionPoint CloudsPillarTrack:Boosting Pillar Representation for Transformer-based 3D Single Object Tracking on Point Clouds
LiDAR-based 3D single object tracking (3D SOT) is a critical issue in robotics and autonomous driving. Existing 3D SOT methods typically adhere to a point-based processing pipeline, wherein the re-sampling operation inva…
3D Single Object TrackingAutonomous DrivingObject TrackingFusionPainting: Multimodal Fusion with Adaptive Attention for 3D Object Detection
Accurate detection of obstacles in 3D is an essential task for autonomous driving and intelligent transportation. In this work, we propose a general multimodal fusion framework FusionPainting to fuse the 2D RGB image and…
3D Object DetectionAutonomous Drivingobject-detectionObject Detection+2Know Your Surroundings: Panoramic Multi-Object Tracking by Multimodality Collaboration
In this paper, we focus on the multi-object tracking (MOT) problem of automatic driving and robot navigation. Most existing MOT methods track multiple objects using a singular RGB camera, which are prone to camera field-…
Multi-Object TrackingObject TrackingRobot NavigationEnd-to-End 3-D Spatiotemporal Perception with Multimodal Fusion and V2X Collaboration
Multiview cooperative perception and multimodal fusion are essential for reliable 3-D spatiotemporal understanding in autonomous driving, especially in cases with occlusions, limited viewpoints, and communication delays …
Autonomous Driving