paper-with-me

홈 › Papers

AMVNet: Assertion-based Multi-View Fusion Network for LiDAR Semantic Segmentation

2020-12-09 · Venice Erin Liong, Thi Ngoc Tho Nguyen, Sergi Widjaja, Dhananjai Sharma, Zhuang Jie Chong

In this paper, we present an Assertion-based Multi-View Fusion network (AMVNet) for LiDAR semantic segmentation which aggregates the semantic features of individual projection-based networks using late fusion. Given class scores from different projection-based networks, we perform assertion-guided point sampling on score disagreements and pass a set of point-level features for each sampled point to a simple point head which refines the predictions. This modular-and-hierarchical late fusion approach provides the flexibility of having two independent networks with a minor overhead from a light-weight network. Such approaches are desirable for robotic systems, e.g. autonomous vehicles, for which the computational and memory resources are often limited. Extensive experiments show that AMVNet achieves state-of-the-art results in both the SemanticKITTI and nuScenes benchmark datasets and that our approach outperforms the baseline method of combining the class scores of the projection-based networks.

📄 PDF Abstract BibTeX arXiv:2012.04934

Code (0)

등록된 구현이 없습니다.

Tasks

Autonomous VehiclesLIDAR Semantic SegmentationSemantic Segmentation

Similar Papers 제목 키워드 기반

Model Assertions for Monitoring and Improving ML Models

2020-03-03 · Daniel Kang, Deepti Raghavan, Peter Bailis, Matei Zaharia

ML models are increasingly deployed in settings with real world interactions such as vehicles, but unfortunately, these models can fail in systematic ways. To prevent errors, ML engineering teams monitor and continuously…

Active Learningmodel

SemanticBEVFusion: Rethink LiDAR-Camera Fusion in Unified Bird's-Eye View Representation for 3D Object Detection

2022-12-09 · Qi Jiang, Hao Sun, Xi Zhang

LiDAR and camera are two essential sensors for 3D object detection in autonomous driving. LiDAR provides accurate and reliable 3D geometry information while the camera provides rich texture with color. Despite the increa…

3D geometry3D Object DetectionAutonomous Drivingobject-detection+1

Multi-View Fusion of Sensor Data for Improved Perception and Prediction in Autonomous Driving

2020-08-27 · Sudeep Fadadu, Shreyash Pandey, Darshan Hegde, Yi Shi 외

We present an end-to-end method for object detection and trajectory prediction utilizing multi-view representations of LiDAR returns and camera images. In this work, we recognize the strengths and weaknesses of different…

Autonomous Drivingobject-detectionObject DetectionTrajectory Prediction

BEVFusion4D: Learning LiDAR-Camera Fusion Under Bird's-Eye-View via Cross-Modality Guidance and Temporal Aggregation

2023-03-30 · Hongxiang Cai, Zeyuan Zhang, Zhenyu Zhou, Ziyin Li 외

Integrating LiDAR and Camera information into Bird's-Eye-View (BEV) has become an essential topic for 3D object detection in autonomous driving. Existing methods mostly adopt an independent dual-branch framework to gener…

3D Object DetectionAutonomous Drivingobject-detectionObject Detection

Fusing Bird View LIDAR Point Cloud and Front View Camera Image for Deep Object Detection

2017-11-17 · Zining Wang, Wei Zhan, Masayoshi Tomizuka

We propose a new method for fusing a LIDAR point cloud and camera-captured images in the deep convolutional neural network (CNN). The proposed method constructs a new layer called non-homogeneous pooling layer to transfo…

3D Object DetectionAutonomous DrivingObjectobject-detection+1