CenterRadarNet: Joint 3D Object Detection and Tracking Framework using 4D FMCW Radar
Robust perception is a vital component for ensuring safe autonomous and assisted driving. Automotive radar (77 to 81 GHz), which offers weather-resilient sensing, provides a complementary capability to the vision- or LiDAR-based autonomous driving systems. Raw radio-frequency (RF) radar tensors contain rich spatiotemporal semantics besides 3D location information. The majority of previous methods take in 3D (Doppler-range-azimuth) RF radar tensors, allowing prediction of an object's location, heading angle, and size in bird's-eye-view (BEV). However, they lack the ability to at the same time infer objects' size, orientation, and identity in the 3D space. To overcome this limitation, we propose an efficient joint architecture called CenterRadarNet, designed to facilitate high-resolution representation learning from 4D (Doppler-range-azimuth-elevation) radar data for 3D object detection and re-identification (re-ID) tasks. As a single-stage 3D object detector, CenterRadarNet directly infers the BEV object distribution confidence maps, corresponding 3D bounding box attributes, and appearance embedding for each pixel. Moreover, we build an online tracker utilizing the learned appearance embedding for re-ID. CenterRadarNet achieves the state-of-the-art result on the K-Radar 3D object detection benchmark. In addition, we present the first 3D object-tracking result using radar on the K-Radar dataset V2. In diverse driving scenarios, CenterRadarNet shows consistent, robust performance, emphasizing its wide applicability.
Code (0)
등록된 구현이 없습니다.
Tasks
3D Object Detection3D Object TrackingAutonomous DrivingObjectobject-detectionObject DetectionObject TrackingRepresentation LearningSimilar Papers 제목 키워드 기반
Joint Multi-Object Detection and Tracking with Camera-LiDAR Fusion for Autonomous Driving
Multi-object tracking (MOT) with camera-LiDAR fusion demands accurate results of object detection, affinity computation and data association in real time. This paper presents an efficient multi-modal MOT framework with o…
Autonomous DrivingMulti-Object TrackingObjectobject-detection+2Joint Counting, Detection and Re-Identification for Multi-Object Tracking
The recent trend in 2D multiple object tracking (MOT) is jointly solving detection and tracking, where object detection and appearance feature (or motion) are learned simultaneously. Despite competitive performance, in c…
Multi-Object TrackingMultiple Object TrackingObjectobject-detection+2Global Correlation Network: End-to-End Joint Multi-Object Detection and Tracking
Multi-object tracking (MOT) has made great progress in recent years, but there are still some problems. Most MOT algorithms follow tracking-by-detection framework, which separates detection and tracking into two independ…
ManagementMulti-Object TrackingObjectobject-detection+2Joint Detection, Tracking and Mapping by Semantic Bundle Adjustment
In this paper we propose a novel Semantic Bundle Adjustment framework whereby known rigid stationary objects are detected while tracking the camera and mapping the environment. The system builds on established tracking a…
3D ReconstructionObjectobject-detectionObject DetectionJoint 3D Object Detection and Tracking Using Spatio-Temporal Representation of Camera Image and LiDAR Point Clouds
In this paper, we propose a new joint object detection and tracking (JoDT) framework for 3D object detection and tracking based on camera and LiDAR sensors. The proposed method, referred to as 3D DetecTrack, enables the …
3D Object DetectionGraph Neural NetworkObjectobject-detection+1