Holistic 3D Scene Understanding From a Single Geo-Tagged Image

2015-06-01 · CVPR 2015 6 · Shenlong Wang, Sanja Fidler, Raquel Urtasun

In this paper we are interested in exploiting geographic priors to help outdoor scene understanding. Towards this goal we propose a holistic approach that reasons jointly about 3D object detection, pose estimation, semantic segmentation as well as depth reconstruction from a single image. Our approach takes advantage of large-scale crowd-sourced maps to generate dense geographic, geometric and semantic priors by rendering the 3D world. We demonstrate the effectiveness of our holistic model on the challenging KITTI dataset, and show significant improvements over the baselines in all metrics and tasks.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

3D Object Detection object-detection Object Detection Pose Estimation Scene Understanding Semantic Segmentation

Panoptic 3D Scene Reconstruction From a Single RGB Image

2021-11-03 · NeurIPS 2021 12 · Manuel Dahnert, Ji Hou, Matthias Nießner, Angela Dai

Understanding 3D scenes from a single image is fundamental to a wide variety of tasks, such as for robotics, motion planning, or augmented reality. Existing works in 3D perception from a single RGB image tend to focus on…

2D Panoptic Segmentation 3D Instance Segmentation 3D Scene Reconstruction 3D Semantic Segmentation+6

Holistic++ Scene Understanding: Single-view 3D Holistic Scene Parsing and Human Pose Estimation with Human-Object Interaction and Physical Commonsense

2019-09-04 · ICCV 2019 10 · Yixin Chen, Siyuan Huang, Tao Yuan, Siyuan Qi 외

We propose a new 3D holistic++ scene understanding problem, which jointly tackles two tasks from a single-view image: (i) holistic scene parsing and reconstruction---3D estimations of object bounding boxes, camera pose, …

3D Human Pose Estimation Human-Object Interaction Detection Pose Estimation Scene Parsing+1

Holistic 3D Scene Understanding from a Single Image with Implicit Representation

2021-03-11 · CVPR 2021 1 · Cheng Zhang, Zhaopeng Cui, yinda zhang, Bing Zeng 외

We present a new pipeline for holistic 3D scene understanding from a single image, which could predict object shapes, object poses, and scene layout. As it is a highly ill-posed problem, existing methods usually suffer f…

3D Object Detection 3D Shape Reconstruction Graph Neural Network Monocular 3D Object Detection+5

DeepContext: Context-Encoding Neural Pathways for 3D Holistic Scene Understanding

2016-03-16 · ICCV 2017 10 · Yinda Zhang, Mingru Bai, Pushmeet Kohli, Shahram Izadi 외

While deep neural networks have led to human-level performance on computer vision tasks, they have yet to demonstrate similar gains for holistic scene understanding. In particular, 3D context has been shown to be an extr…

Object Scene Understanding

PanoContext-Former: Panoramic Total Scene Understanding with a Transformer

2023-05-21 · CVPR 2024 1 · Yuan Dong, Chuan Fang, Liefeng Bo, Zilong Dong 외

Panoramic image enables deeper understanding and more holistic perception of $360^\circ$ surrounding environment, which can naturally encode enriched scene context information compared to standard perspective image. Prev…

3D Object Detection object-detection Object Detection Scene Understanding