BEV-MODNet: Monocular Camera based Bird's Eye View Moving Object Detection for Autonomous Driving
Detection of moving objects is a very important task in autonomous driving systems. After the perception phase, motion planning is typically performed in Bird's Eye View (BEV) space. This would require projection of objects detected on the image plane to top view BEV plane. Such a projection is prone to errors due to lack of depth information and noisy mapping in far away areas. CNNs can leverage the global context in the scene to project better. In this work, we explore end-to-end Moving Object Detection (MOD) on the BEV map directly using monocular images as input. To the best of our knowledge, such a dataset does not exist and we create an extended KITTI-raw dataset consisting of 12.9k images with annotations of moving object masks in BEV space for five classes. The dataset is intended to be used for class agnostic motion cue based object detection and classes are provided as meta-data for better tuning. We design and implement a two-stream RGB and optical flow fusion architecture which outputs motion segmentation directly in BEV space. We compare it with inverse perspective mapping of state-of-the-art motion segmentation predictions on the image plane. We observe a significant improvement of 13% in mIoU using the simple baseline implementation. This demonstrates the ability to directly learn motion segmentation output in BEV space. Qualitative results of our baseline and the dataset annotations can be found in https://sites.google.com/view/bev-modnet.
Code (0)
등록된 구현이 없습니다.
Tasks
Autonomous DrivingMotion PlanningMotion SegmentationMoving Object Detectionobject-detectionObject DetectionOptical Flow EstimationSegmentationSimilar Papers 제목 키워드 기반
Lift-Attend-Splat: Bird's-eye-view camera-lidar fusion using transformers
Combining complementary sensor modalities is crucial to providing robust perception for safety-critical robotics applications such as autonomous driving (AD). Recent state-of-the-art camera-lidar fusion methods for AD re…
3D Object DetectionAutonomous DrivingDepth EstimationMonocular Depth Estimation+3BirdSLAM: Monocular Multibody SLAM in Bird's-Eye View
In this paper, we present BirdSLAM, a novel simultaneous localization and mapping (SLAM) system for the challenging scenario of autonomous driving platforms equipped with only a monocular camera. BirdSLAM tackles challen…
Autonomous DrivingMonocular ReconstructionObject LocalizationSimultaneous Localization and MappingFIERY: Future Instance Prediction in Bird's-Eye View from Surround Monocular Cameras
Driving requires interacting with road agents and predicting their future behaviour in order to navigate safely. We present FIERY: a probabilistic future prediction model in bird's-eye view from monocular cameras. Our mo…
Autonomous DrivingBird's-Eye View Semantic SegmentationFuture predictionInstance Segmentation+4FisheyeMODNet: Moving Object detection on Surround-view Cameras for Autonomous Driving
Moving Object Detection (MOD) is an important task for achieving robust autonomous driving. An autonomous vehicle has to estimate collision risk with other interacting objects in the environment and calculate an optional…
Autonomous DrivingDecision MakingMoving Object Detectionobject-detection+1Multi-Stage CNN-Based Monocular 3D Vehicle Localization and Orientation Estimation
This paper aims to design a 3D object detection model from 2D images taken by monocular cameras by combining the estimated bird's-eye view elevation map and the deep representation of object features. The proposed model …
3D Object DetectionObjectobject-detectionObject Detection