Joint 3D Estimation of Objects and Scene Layout
We propose a novel generative model that is able to reason jointly about the 3D scene layout as well as the 3D location and orientation of objects in the scene. In particular, we infer the scene topology, geometry as well as traffic activities from a short video sequence acquired with a single camera mounted on a moving car. Our generative model takes advantage of dynamic information in the form of vehicle tracklets as well as static information coming from semantic labels and geometry (i.e., vanishing points). Experiments show that our approach outperforms a discriminative baseline based on multiple kernel learning (MKL) which has access to the same image information. Furthermore, as we reason about objects in 3D, we are able to significantly increase the performance of state-of-the-art object detectors in their ability to estimate object orientation.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
SceneCAD: Predicting Object Alignments and Layouts in RGB-D Scans
We present a novel approach to reconstructing lightweight, CAD-based representations of scanned 3D environments from commodity RGB-D sensors. Our key idea is to jointly optimize for both CAD model alignments as well as l…
Graph Neural NetworkObjectTotal3DUnderstanding: Joint Layout, Object Pose and Mesh Reconstruction for Indoor Scenes from a Single Image
Semantic reconstruction of indoor scenes refers to both scene understanding and object reconstruction. Existing works either address one part of this problem or focus on independent objects. In this paper, we bridge the …
3D Object Detection3D Shape ReconstructionMonocular 3D Object DetectionObject+5MVRackLay: Monocular Multi-View Layout Estimation for Warehouse Racks and Shelves
In this paper, we propose and showcase, for the first time, monocular multi-view layout estimation for warehouse racks and shelves. Unlike typical layout estimation methods, MVRackLay estimates multi-layered layouts, whe…
Holistic 3D Scene Understanding from a Single Image with Implicit Representation
We present a new pipeline for holistic 3D scene understanding from a single image, which could predict object shapes, object poses, and scene layout. As it is a highly ill-posed problem, existing methods usually suffer f…
3D Object Detection3D Shape ReconstructionGraph Neural NetworkMonocular 3D Object Detection+5PQ-Transformer: Jointly Parsing 3D Objects and Layouts from Point Clouds
3D scene understanding from point clouds plays a vital role for various robotic applications. Unfortunately, current state-of-the-art methods use separate neural networks for different tasks like object detection or room…
object-detectionObject DetectionRoom Layout EstimationScene Understanding