paper-with-me

Papers

Radar Instance Transformer: Reliable Moving Instance Segmentation in Sparse Radar Point Clouds

2023-09-28 · Matthias Zeller, Vardeep S. Sandhu, Benedikt Mersch, Jens Behley, Michael Heidingsfeld, Cyrill Stachniss

The perception of moving objects is crucial for autonomous robots performing collision avoidance in dynamic environments. LiDARs and cameras tremendously enhance scene interpretation but do not provide direct motion information and face limitations under adverse weather. Radar sensors overcome these limitations and provide Doppler velocities, delivering direct information on dynamic objects. In this paper, we address the problem of moving instance segmentation in radar point clouds to enhance scene interpretation for safety-critical tasks. Our Radar Instance Transformer enriches the current radar scan with temporal information without passing aggregated scans through a neural network. We propose a full-resolution backbone to prevent information loss in sparse point cloud processing. Our instance transformer head incorporates essential information to enhance segmentation but also enables reliable, class-agnostic instance assignments. In sum, our approach shows superior performance on the new moving instance segmentation benchmarks, including diverse environments, and provides model-agnostic modules to enhance scene interpretation. The benchmark is based on the RadarScenes dataset and will be made available upon acceptance.

📄 PDF Abstract BibTeX arXiv:2309.16435

Code (0)

등록된 구현이 없습니다.

Tasks

Collision AvoidanceInstance SegmentationSegmentationSemantic Segmentation

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Position-Wise Feed-Forward Layer 설명 없음
Residual Connection 설명 없음
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…

Similar Papers 제목 키워드 기반

Radar Tracker: Moving Instance Tracking in Sparse and Noisy Radar Point Clouds

2025-07-04 · Matthias Zeller, Daniel Casado Herraez, Jens Behley, Michael Heidingsfeld 외 arxiv

Robots and autonomous vehicles should be aware of what happens in their surroundings. The segmentation and tracking of moving objects are essential for reliable path planning, including collision avoidance. We investigat…

Collision AvoidanceAutonomous VehiclesPoint Clouds

Boosting Instance Awareness via Cross-View Correlation with 4D Radar and Camera for 3D Object Detection

2026-02-24 · Xiaokai Bai, Lianqing Zheng, Si-Yuan Cao, Xiaohan Zhang 외 arxiv

4D millimeter-wave radar has emerged as a promising sensing modality for autonomous driving due to its robustness and affordability. However, its sparse and weak geometric cues make reliable instance activation difficult…

Scene Understanding3D Object DetectionAutonomous Driving

Radar Velocity Transformer: Single-scan Moving Object Segmentation in Noisy Radar Point Clouds

2025-07-04 · Matthias Zeller, Vardeep S. Sandhu, Benedikt Mersch, Jens Behley 외 arxiv

The awareness about moving objects in the surroundings of a self-driving vehicle is essential for safe and reliable autonomous navigation. The interpretation of LiDAR and camera data achieves exceptional results but typi…

Object SegmentationScene UnderstandingTemporal SequencesPoint Clouds

Deep Instance Segmentation with Automotive Radar Detection Points

2021-10-05 · Jianan Liu, Weiyi Xiong, Liping Bai, Yuxuan Xia 외

Automotive radar provides reliable environmental perception in all-weather conditions with affordable cost, but it hardly supplies semantic and geometry information due to the sparsity of radar detection points. With the…

Autonomous DrivingClusteringInstance SegmentationSegmentation+1

SemRaFiner: Panoptic Segmentation in Sparse and Noisy Radar Point Clouds

2025-07-09 · Matthias Zeller, Daniel Casado Herraez, Bengisu Ayan, Jens Behley 외 arxiv

Semantic scene understanding, including the perception and classification of moving agents, is essential to enabling safe and robust driving behaviours of autonomous vehicles. Cameras and LiDARs are commonly used for sem…

Panoptic SegmentationAutonomous VehiclesScene UnderstandingData Augmentation