paper-with-me

Papers

MVCTrack: Boosting 3D Point Cloud Tracking via Multimodal-Guided Virtual Cues

2024-12-03 · Zhaofeng Hu, Sifan Zhou, Shibo Zhao, Zhihang Yuan, Ci-Jyun Liang

3D single object tracking is essential in autonomous driving and robotics. Existing methods often struggle with sparse and incomplete point cloud scenarios. To address these limitations, we propose a Multimodal-guided Virtual Cues Projection (MVCP) scheme that generates virtual cues to enrich sparse point clouds. Additionally, we introduce an enhanced tracker MVCTrack based on the generated virtual cues. Specifically, the MVCP scheme seamlessly integrates RGB sensors into LiDAR-based systems, leveraging a set of 2D detections to create dense 3D virtual cues that significantly improve the sparsity of point clouds. These virtual cues can naturally integrate with existing LiDAR-based 3D trackers, yielding substantial performance gains. Extensive experiments demonstrate that our method achieves competitive performance on the NuScenes dataset.

📄 PDF Abstract BibTeX arXiv:2412.02734

Code (1)

StiphyJay/MVCTrack 공식 구현 pytorch

Tasks

3D Single Object TrackingAutonomous DrivingObject Tracking

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Similar Papers 제목 키워드 기반

Depth-Semantic Alignment and Affinity-Guided Fusion for Structured Radar Point Cloud Generation

2026-06-25 · Amjad Hussain, Xin Qiu, Fuyuan Ai, Yuchen Tan 외 arxiv

Point clouds are an important carrier of three-dimensional spatial information, and their quality directly affects the performance of downstream perception tasks such as object detection and tracking. However, millimeter…

Point Cloud GenerationObject DetectionPoint Clouds

PillarTrack:Boosting Pillar Representation for Transformer-based 3D Single Object Tracking on Point Clouds

2024-04-11 · Weisheng Xu, Sifan Zhou, Jiaqi Xiong, Ziyu Zhao 외

LiDAR-based 3D single object tracking (3D SOT) is a critical issue in robotics and autonomous driving. Existing 3D SOT methods typically adhere to a point-based processing pipeline, wherein the re-sampling operation inva…

3D Single Object TrackingAutonomous DrivingObject Tracking

FusionPainting: Multimodal Fusion with Adaptive Attention for 3D Object Detection

2021-06-23 · Shaoqing Xu, Dingfu Zhou, Jin Fang, Junbo Yin 외

Accurate detection of obstacles in 3D is an essential task for autonomous driving and intelligent transportation. In this work, we propose a general multimodal fusion framework FusionPainting to fuse the 2D RGB image and…

3D Object DetectionAutonomous Drivingobject-detectionObject Detection+2

Know Your Surroundings: Panoramic Multi-Object Tracking by Multimodality Collaboration

2021-05-31 · Yuhang He, Wentao Yu, Jie Han, Xing Wei 외

In this paper, we focus on the multi-object tracking (MOT) problem of automatic driving and robot navigation. Most existing MOT methods track multiple objects using a singular RGB camera, which are prone to camera field-…

Multi-Object TrackingObject TrackingRobot Navigation

End-to-End 3-D Spatiotemporal Perception with Multimodal Fusion and V2X Collaboration

2025-12-26 · Zhenwei Yang, Yibo Ai, Weidong Zhang arxiv

Multiview cooperative perception and multimodal fusion are essential for reliable 3-D spatiotemporal understanding in autonomous driving, especially in cases with occlusions, limited viewpoints, and communication delays …

Autonomous Driving