paper-with-me

홈 › Papers

PlaneSegNet: Fast and Robust Plane Estimation Using a Single-stage Instance Segmentation CNN

2021-03-29 · Yaxu Xie, Jason Rambach, Fangwen Shu, Didier Stricker

Instance segmentation of planar regions in indoor scenes benefits visual SLAM and other applications such as augmented reality (AR) where scene understanding is required. Existing methods built upon two-stage frameworks show satisfactory accuracy but are limited by low frame rates. In this work, we propose a real-time deep neural architecture that estimates piece-wise planar regions from a single RGB image. Our model employs a variant of a fast single-stage CNN architecture to segment plane instances. Considering the particularity of the target detected, we propose Fast Feature Non-maximum Suppression (FF-NMS) to reduce the suppression errors resulted from overlapping bounding boxes of planes. We also utilize a Residual Feature Augmentation module in the Feature Pyramid Network (FPN). Our method achieves significantly higher frame-rates and comparable segmentation accuracy against two-stage methods. We automatically label over 70,000 images as ground truth from the Stanford 2D-3D-Semantics dataset. Moreover, we incorporate our method with a state-of-the-art planar SLAM and validate its benefits.

📄 PDF Abstract BibTeX arXiv:2103.15428

Code (0)

등록된 구현이 없습니다.

Tasks

Instance SegmentationScene UnderstandingSegmentationSemantic Segmentation

Similar Papers 제목 키워드 기반

PlaneRecTR++: Unified Query Learning for Joint 3D Planar Reconstruction and Pose Estimation

2023-07-25 · ICCV 2023 1 · Jingjia Shi, Shuaifeng Zhi, Kai Xu

3D plane reconstruction from images can usually be divided into several sub-tasks of plane detection, segmentation, parameters regression and possibly depth prediction for per-frame, along with plane correspondence and r…

Camera Pose EstimationDepth EstimationDepth PredictionPose Estimation+1

Ground Plane Polling for 6DoF Pose Estimation of Objects on the Road

2018-11-16 · Akshay Rangesh, Mohan M. Trivedi

This paper introduces an approach to produce accurate 3D detection boxes for objects on the ground using single monocular images. We do so by merging 2D visual cues, 3D object dimensions, and ground plane constraints to …

ObjectPose Estimation

PlaneRecNet: Multi-Task Learning with Cross-Task Consistency for Piece-Wise Plane Detection and Reconstruction from a Single RGB Image

2021-10-21 · Yaxu Xie, Fangwen Shu, Jason Rambach, Alain Pagani 외

Piece-wise 3D planar reconstruction provides holistic scene understanding of man-made environments, especially for indoor scenarios. Most recent approaches focused on improving the segmentation and reconstruction results…

DecoderDepth EstimationInstance SegmentationMulti-Task Learning+3

Fast and robust multiplane single molecule localization microscopy using deep neural network

2020-01-07 · Toshimitsu Aritake, Hideitsu Hino, Shigeyuki Namiki, Daisuke Asanuma 외

Single molecule localization microscopy is widely used in biological research for measuring the nanostructures of samples smaller than the diffraction limit. This study uses multifocal plane microscopy and addresses the …

compressed sensing

MonoGround: Detecting Monocular 3D Objects from the Ground

2022-06-15 · CVPR 2022 1 · Zequn Qin, Xi Li

Monocular 3D object detection has attracted great attention for its advantages in simplicity and cost. Due to the ill-posed 2D to 3D mapping essence from the monocular imaging process, monocular 3D object detection suffe…

3D Object DetectionDepth EstimationMonocular 3D Object DetectionObject+2