paper-with-me

Papers

MoNet: Motion-based Point Cloud Prediction Network

2020-11-21 · Fan Lu, Guang Chen, Yinlong Liu, Zhijun Li, Sanqing Qu, Tianpei Zou

Predicting the future can significantly improve the safety of intelligent vehicles, which is a key component in autonomous driving. 3D point clouds accurately model 3D information of surrounding environment and are crucial for intelligent vehicles to perceive the scene. Therefore, prediction of 3D point clouds has great significance for intelligent vehicles, which can be utilized for numerous further applications. However, due to point clouds are unordered and unstructured, point cloud prediction is challenging and has not been deeply explored in current literature. In this paper, we propose a novel motion-based neural network named MoNet. The key idea of the proposed MoNet is to integrate motion features between two consecutive point clouds into the prediction pipeline. The introduction of motion features enables the model to more accurately capture the variations of motion information across frames and thus make better predictions for future motion. In addition, content features are introduced to model the spatial content of individual point clouds. A recurrent neural network named MotionRNN is proposed to capture the temporal correlations of both features. Besides, we propose an attention-based motion align module to address the problem of missing motion features in the inference pipeline. Extensive experiments on two large scale outdoor LiDAR datasets demonstrate the performance of the proposed MoNet. Moreover, we perform experiments on applications using the predicted point clouds and the results indicate the great application potential of the proposed method.

📄 PDF Abstract BibTeX arXiv:2011.10812

Code (0)

등록된 구현이 없습니다.

Tasks

Autonomous DrivingPrediction

Methods 이 논문이 사용한 방법론

MoNet Mixture model network (MoNet) is a general framework allowing to design convolutional deep architectures on non-Euclidean domains such as graphs and manifolds. Image and…

Similar Papers 제목 키워드 기반

BE-STI: Spatial-Temporal Integrated Network for Class-Agnostic Motion Prediction With Bidirectional Enhancement

2022-01-01 · CVPR 2022 1 · Yunlong Wang, Hongyu Pan, Jun Zhu, Yu-Huan Wu 외

Determining the motion behavior of inexhaustible categories of traffic participants is critical for autonomous driving. In recent years, there has been a rising concern in performing class-agnostic motion prediction …

Autonomous Drivingmotion predictionPredictionSemantic Segmentation

Self-Supervised Class-Agnostic Motion Prediction with Spatial and Temporal Consistency Regularizations

2024-03-20 · CVPR 2024 1 · Kewei Wang, Yizheng Wu, Jun Cen, Zhiyu Pan 외

The perception of motion behavior in a dynamic environment holds significant importance for autonomous driving systems, wherein class-agnostic motion prediction methods directly predict the motion of the entire point clo…

Autonomous Drivingmotion predictionPrediction

AGAR: Attention Graph-RNN for Adaptative Motion Prediction of Point Clouds of Deformable Objects

2023-07-19 · Pedro Gomes, Silvia Rossi, Laura Toni

This paper focuses on motion prediction for point cloud sequences in the challenging case of deformable 3D objects, such as human body motion. First, we investigate the challenges caused by deformable shapes and complex …

Action Recognitionmotion prediction

TPCN: Temporal Point Cloud Networks for Motion Forecasting

2021-03-04 · CVPR 2021 1 · Maosheng Ye, Tongyi Cao, Qifeng Chen

We propose the Temporal Point Cloud Networks (TPCN), a novel and flexible framework with joint spatial and temporal learning for trajectory prediction. Unlike existing approaches that rasterize agents and map information…

Motion ForecastingTrajectory Prediction

3DMotion-Net: Learning Continuous Flow Function for 3D Motion Prediction

2020-06-24 · Shuaihang Yuan, Xiang Li, Anthony Tzes, Yi Fang

In this paper, we deal with the problem to predict the future 3D motions of 3D object scans from previous two consecutive frames. Previous methods mostly focus on sparse motion prediction in the form of skeletons. While …

motion prediction