paper-with-me

홈 › Papers

High-frequency shape recovery from shading by CNN and domain adaptation

2021-08-06 · Kodai Tokieda, Takafumi Iwaguchi, Hiroshi Kawasaki

Importance of structured-light based one-shot scanning technique is increasing because of its simple system configuration and ability of capturing moving objects. One severe limitation of the technique is that it can capture only sparse shape, but not high frequency shapes, because certain area of projection pattern is required to encode spatial information. In this paper, we propose a technique to recover high-frequency shapes by using shading information, which is captured by one-shot RGB-D sensor based on structured light with single camera. Since color image comprises shading information of object surface, high-frequency shapes can be recovered by shape from shading techniques. Although multiple images with different lighting positions are required for shape from shading techniques, we propose a learning based approach to recover shape from a single image. In addition, to overcome the problem of preparing sufficient amount of data for training, we propose a new data augmentation method for high-frequency shapes using synthetic data and domain adaptation. Experimental results are shown to confirm the effectiveness of the proposed method.

📄 PDF Abstract BibTeX arXiv:2108.02937

Code (0)

등록된 구현이 없습니다.

Tasks

Data AugmentationDomain AdaptationVocal Bursts Intensity Prediction

Similar Papers 제목 키워드 기반

Better Shading for Better Shape Recovery

2014-06-01 · CVPR 2014 6 · Moumen T. El-Melegy, Aly S. Abdelrahim, Aly A. Farag

The basic idea of shape from shading is to infer the shape of a surface from its shading information in a single image. Since this problem is ill-posed, a number of simplifying assumptions have been often used. However t…

Fight Ill-Posedness With Ill-Posedness: Single-Shot Variational Depth Super-Resolution From Shading

2018-06-01 · CVPR 2018 6 · Bjoern Haefner, Yvain Quéau, Thomas Möllenhoff, Daniel Cremers

We put forward a principled variational approach for up-sampling a single depth map to the resolution of the companion color image provided by an RGB-D sensor. We combine heterogeneous depth and color data in order to jo…

Super-Resolution

Depth From Shading, Defocus, and Correspondence Using Light-Field Angular Coherence

2015-06-01 · CVPR 2015 6 · Michael W. Tao, Pratul P. Srinivasan, Jitendra Malik, Szymon Rusinkiewicz 외

Light-field cameras are now used in consumer and industrial applications. Recent papers and products have demonstrated practical depth recovery algorithms from a passive single-shot capture. However, current light field…

Depth Estimation

Boundary Cues for 3D Object Shape Recovery

2019-12-24 · CVPR 2013 6 · Kevin Karsch, Zicheng Liao, Jason Rock, Jonathan T. Barron 외

Early work in computer vision considered a host of geometric cues for both shape reconstruction and recognition. However, since then, the vision community has focused heavily on shading cues for reconstruction, and moved…

Object

Shading-Based Shape Refinement of RGB-D Images

2013-06-01 · CVPR 2013 6 · Lap-Fai Yu, Sai-Kit Yeung, Yu-Wing Tai, Stephen Lin

We present a shading-based shape refinement algorithm which uses a noisy, incomplete depth map from Kinect to help resolve ambiguities in shape-from-shading. In our framework, the partial depth information is used to ove…