paper-with-me

Papers

A Dense Material Segmentation Dataset for Indoor and Outdoor Scene Parsing

2022-07-21 · Paul Upchurch, Ransen Niu

A key algorithm for understanding the world is material segmentation, which assigns a label (metal, glass, etc.) to each pixel. We find that a model trained on existing data underperforms in some settings and propose to address this with a large-scale dataset of 3.2 million dense segments on 44,560 indoor and outdoor images, which is 23x more segments than existing data. Our data covers a more diverse set of scenes, objects, viewpoints and materials, and contains a more fair distribution of skin types. We show that a model trained on our data outperforms a state-of-the-art model across datasets and viewpoints. We propose a large-scale scene parsing benchmark and baseline of 0.729 per-pixel accuracy, 0.585 mean class accuracy and 0.420 mean IoU across 46 materials.

📄 PDF Abstract BibTeX arXiv:2207.10614

Code (2)

apple/ml-dms-dataset 공식 구현 pytorch
junweizheng93/materobot pytorch

Tasks

Material ClassificationMaterial RecognitionMaterial SegmentationScene ParsingSemantic Segmentation

Similar Papers 제목 키워드 기반

DIODE: A Dense Indoor and Outdoor DEpth Dataset

2019-08-01 · Igor Vasiljevic, Nick Kolkin, Shanyi Zhang, Ruotian Luo 외

We introduce DIODE, a dataset that contains thousands of diverse high resolution color images with accurate, dense, long-range depth measurements. DIODE (Dense Indoor/Outdoor DEpth) is the first public dataset to include…

Incorporating Near-Infrared Information into Semantic Image Segmentation

2014-06-24 · Neda Salamati, Diane Larlus, Gabriela Csurka, Sabine Süsstrunk

Recent progress in computational photography has shown that we can acquire near-infrared (NIR) information in addition to the normal visible (RGB) band, with only slight modifications to standard digital cameras. Due to …

Image SegmentationSegmentationSemantic Segmentation

TOD3Cap: Towards 3D Dense Captioning in Outdoor Scenes

2024-03-28 · Bu Jin, Yupeng Zheng, Pengfei Li, Weize Li 외

3D dense captioning stands as a cornerstone in achieving a comprehensive understanding of 3D scenes through natural language. It has recently witnessed remarkable achievements, particularly in indoor settings. However, t…

3D dense captioningDense Captioning

Semi-Dense 3D Semantic Mapping from Monocular SLAM

2016-11-13 · Xuanpeng Li, Rachid Belaroussi

The bundle of geometry and appearance in computer vision has proven to be a promising solution for robots across a wide variety of applications. Stereo cameras and RGB-D sensors are widely used to realise fast 3D reconst…

3D ReconstructionSemantic Segmentation

Towards Panoptic 3D Parsing for Single Image in the Wild

2021-11-04 · Sainan Liu, Vincent Nguyen, Yuan Gao, Subarna Tripathi 외

Performing single image holistic understanding and 3D reconstruction is a central task in computer vision. This paper presents an integrated system that performs dense scene labeling, object detection, instance segmentat…

3D Reconstruction3D Shape ReconstructionAutonomous DrivingDepth Estimation+7