paper-with-me

홈 › Papers

An LSTM Approach to Temporal 3D Object Detection in LiDAR Point Clouds

2020-07-24 · ECCV 2020 8 · Rui Huang, Wanyue Zhang, Abhijit Kundu, Caroline Pantofaru, David A. Ross, Thomas Funkhouser, Alireza Fathi

Detecting objects in 3D LiDAR data is a core technology for autonomous driving and other robotics applications. Although LiDAR data is acquired over time, most of the 3D object detection algorithms propose object bounding boxes independently for each frame and neglect the useful information available in the temporal domain. To address this problem, in this paper we propose a sparse LSTM-based multi-frame 3d object detection algorithm. We use a U-Net style 3D sparse convolution network to extract features for each frame's LiDAR point-cloud. These features are fed to the LSTM module together with the hidden and memory features from last frame to predict the 3d objects in the current frame as well as hidden and memory features that are passed to the next frame. Experiments on the Waymo Open Dataset show that our algorithm outperforms the traditional frame by frame approach by 7.5% mAP@0.7 and other multi-frame approaches by 1.2% while using less memory and computation per frame. To the best of our knowledge, this is the first work to use an LSTM for 3D object detection in sparse point clouds.

📄 PDF Abstract BibTeX arXiv:2007.12392

Code (0)

등록된 구현이 없습니다.

Tasks

3D Object DetectionAutonomous DrivingObjectobject-detectionObject Detection

Methods 이 논문이 사용한 방법론

ReLU How Do I Communicate to Expedia? How Do I Communicate to Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Live Support & Special Travel…
Max Pooling Max Pooling is a pooling operation that calculates the maximum value for patches of a feature map, and uses it to create a downsampled (pooled) feature map. It is usually…
Sigmoid Activation 설명 없음
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
Tanh Activation 설명 없음
LSTM An LSTM is a type of recurrent neural network that addresses the vanishing gradient problem in vanilla…
Concatenated Skip Connection A Concatenated Skip Connection is a type of skip connection that seeks to reuse features by concatenating them to new layers, allowing more information to be retained from…
U-Net 설명 없음

Similar Papers 제목 키워드 기반

MGTANet: Encoding Sequential LiDAR Points Using Long Short-Term Motion-Guided Temporal Attention for 3D Object Detection

2022-12-01 · Junho Koh, Junhyung Lee, Youngwoo Lee, Jaekyum Kim 외

Most scanning LiDAR sensors generate a sequence of point clouds in real-time. While conventional 3D object detectors use a set of unordered LiDAR points acquired over a fixed time interval, recent studies have revealed t…

3D Object DetectionObjectobject-detectionObject Detection

Enhancing Lidar-based Object Detection in Adverse Weather using Offset Sequences in Time

2024-01-17 · Raphael van Kempen, Tim Rehbronn, Abin Jose, Johannes Stegmaier 외

Automated vehicles require an accurate perception of their surroundings for safe and efficient driving. Lidar-based object detection is a widely used method for environment perception, but its performance is significantl…

Objectobject-detectionObject Detection

Future Does Matter: Boosting 3D Object Detection with Temporal Motion Estimation in Point Cloud Sequences

2024-09-06 · Rui Yu, Runkai Zhao, Cong Nie, Heng Wang 외

Accurate and robust LiDAR 3D object detection is essential for comprehensive scene understanding in autonomous driving. Despite its importance, LiDAR detection performance is limited by inherent constraints of point clou…

3D Object DetectionAutonomous DrivingMotion EstimationMotion Forecasting+4

ADoPT: LiDAR Spoofing Attack Detection Based on Point-Level Temporal Consistency

2023-10-23 · Minkyoung Cho, Yulong Cao, Zixiang Zhou, Z. Morley Mao

Deep neural networks (DNNs) are increasingly integrated into LiDAR (Light Detection and Ranging)-based perception systems for autonomous vehicles (AVs), requiring robust performance under adversarial conditions. We aim t…

Anomaly DetectionAutonomous Vehicles

Joint 3D Object Detection and Tracking Using Spatio-Temporal Representation of Camera Image and LiDAR Point Clouds

2021-12-14 · Junho Koh, Jaekyum Kim, Jinhyuk Yoo, Yecheol Kim 외

In this paper, we propose a new joint object detection and tracking (JoDT) framework for 3D object detection and tracking based on camera and LiDAR sensors. The proposed method, referred to as 3D DetecTrack, enables the …

3D Object DetectionGraph Neural NetworkObjectobject-detection+1