AMVNet: Assertion-based Multi-View Fusion Network for LiDAR Semantic Segmentation
In this paper, we present an Assertion-based Multi-View Fusion network (AMVNet) for LiDAR semantic segmentation which aggregates the semantic features of individual projection-based networks using late fusion. Given class scores from different projection-based networks, we perform assertion-guided point sampling on score disagreements and pass a set of point-level features for each sampled point to a simple point head which refines the predictions. This modular-and-hierarchical late fusion approach provides the flexibility of having two independent networks with a minor overhead from a light-weight network. Such approaches are desirable for robotic systems, e.g. autonomous vehicles, for which the computational and memory resources are often limited. Extensive experiments show that AMVNet achieves state-of-the-art results in both the SemanticKITTI and nuScenes benchmark datasets and that our approach outperforms the baseline method of combining the class scores of the projection-based networks.
Code (0)
등록된 구현이 없습니다.
Tasks
Autonomous VehiclesLIDAR Semantic SegmentationSemantic SegmentationSimilar Papers 제목 키워드 기반
Model Assertions for Monitoring and Improving ML Models
ML models are increasingly deployed in settings with real world interactions such as vehicles, but unfortunately, these models can fail in systematic ways. To prevent errors, ML engineering teams monitor and continuously…
Active LearningmodelSemanticBEVFusion: Rethink LiDAR-Camera Fusion in Unified Bird's-Eye View Representation for 3D Object Detection
LiDAR and camera are two essential sensors for 3D object detection in autonomous driving. LiDAR provides accurate and reliable 3D geometry information while the camera provides rich texture with color. Despite the increa…
3D geometry3D Object DetectionAutonomous Drivingobject-detection+1Multi-View Fusion of Sensor Data for Improved Perception and Prediction in Autonomous Driving
We present an end-to-end method for object detection and trajectory prediction utilizing multi-view representations of LiDAR returns and camera images. In this work, we recognize the strengths and weaknesses of different…
Autonomous Drivingobject-detectionObject DetectionTrajectory PredictionBEVFusion4D: Learning LiDAR-Camera Fusion Under Bird's-Eye-View via Cross-Modality Guidance and Temporal Aggregation
Integrating LiDAR and Camera information into Bird's-Eye-View (BEV) has become an essential topic for 3D object detection in autonomous driving. Existing methods mostly adopt an independent dual-branch framework to gener…
3D Object DetectionAutonomous Drivingobject-detectionObject DetectionFusing Bird View LIDAR Point Cloud and Front View Camera Image for Deep Object Detection
We propose a new method for fusing a LIDAR point cloud and camera-captured images in the deep convolutional neural network (CNN). The proposed method constructs a new layer called non-homogeneous pooling layer to transfo…
3D Object DetectionAutonomous DrivingObjectobject-detection+1