Radar Instance Transformer: Reliable Moving Instance Segmentation in Sparse Radar Point Clouds
The perception of moving objects is crucial for autonomous robots performing collision avoidance in dynamic environments. LiDARs and cameras tremendously enhance scene interpretation but do not provide direct motion information and face limitations under adverse weather. Radar sensors overcome these limitations and provide Doppler velocities, delivering direct information on dynamic objects. In this paper, we address the problem of moving instance segmentation in radar point clouds to enhance scene interpretation for safety-critical tasks. Our Radar Instance Transformer enriches the current radar scan with temporal information without passing aggregated scans through a neural network. We propose a full-resolution backbone to prevent information loss in sparse point cloud processing. Our instance transformer head incorporates essential information to enhance segmentation but also enables reliable, class-agnostic instance assignments. In sum, our approach shows superior performance on the new moving instance segmentation benchmarks, including diverse environments, and provides model-agnostic modules to enhance scene interpretation. The benchmark is based on the RadarScenes dataset and will be made available upon acceptance.
Code (0)
등록된 구현이 없습니다.
Tasks
Collision AvoidanceInstance SegmentationSegmentationSemantic SegmentationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Radar Tracker: Moving Instance Tracking in Sparse and Noisy Radar Point Clouds
Robots and autonomous vehicles should be aware of what happens in their surroundings. The segmentation and tracking of moving objects are essential for reliable path planning, including collision avoidance. We investigat…
Collision AvoidanceAutonomous VehiclesPoint CloudsBoosting Instance Awareness via Cross-View Correlation with 4D Radar and Camera for 3D Object Detection
4D millimeter-wave radar has emerged as a promising sensing modality for autonomous driving due to its robustness and affordability. However, its sparse and weak geometric cues make reliable instance activation difficult…
Scene Understanding3D Object DetectionAutonomous DrivingRadar Velocity Transformer: Single-scan Moving Object Segmentation in Noisy Radar Point Clouds
The awareness about moving objects in the surroundings of a self-driving vehicle is essential for safe and reliable autonomous navigation. The interpretation of LiDAR and camera data achieves exceptional results but typi…
Object SegmentationScene UnderstandingTemporal SequencesPoint CloudsDeep Instance Segmentation with Automotive Radar Detection Points
Automotive radar provides reliable environmental perception in all-weather conditions with affordable cost, but it hardly supplies semantic and geometry information due to the sparsity of radar detection points. With the…
Autonomous DrivingClusteringInstance SegmentationSegmentation+1SemRaFiner: Panoptic Segmentation in Sparse and Noisy Radar Point Clouds
Semantic scene understanding, including the perception and classification of moving agents, is essential to enabling safe and robust driving behaviours of autonomous vehicles. Cameras and LiDARs are commonly used for sem…
Panoptic SegmentationAutonomous VehiclesScene UnderstandingData Augmentation