Shape and Material Capture at Home
In this paper, we present a technique for estimating the geometry and reflectance of objects using only a camera, flashlight, and optionally a tripod. We propose a simple data capture technique in which the user goes around the object, illuminating it with a flashlight and capturing only a few images. Our main technical contribution is the introduction of a recursive neural architecture, which can predict geometry and reflectance at 2^{k}*2^{k} resolution given an input image at 2^{k}*2^{k} and estimated geometry and reflectance from the previous step at 2^{k-1}*2^{k-1}. This recursive architecture, termed RecNet, is trained with 256x256 resolution but can easily operate on 1024x1024 images during inference. We show that our method produces more accurate surface normal and albedo, especially in regions of specular highlights and cast shadows, compared to previous approaches, given three or fewer input images. For the video and code, please visit the project website http://dlichy.github.io/ShapeAndMaterialAtHome/.
Code (1)
Similar Papers 제목 키워드 기반
Push-Forward Signed Distance Functions enable interpretable and robust continuous shape quantification
We introduce the Push-Forward Signed Distance Morphometric (PF-SDM), a novel method for shape quantification in biomedical imaging that is continuous, interpretable, and invariant to shape-preserving transformations. PF-…
Automated Model Discovery for Tensional Homeostasis: Constitutive Machine Learning in Growth and Remodeling
Soft biological tissues exhibit a tendency to maintain a preferred state of tensile stress, known as tensional homeostasis, which is restored even after external mechanical stimuli. This macroscopic behavior can be descr…
Model DiscoveryRobotic Dough Shaping
Robotic manipulation of deformable objects gains great attention due to its wide applications including medical surgery, home assistance, and automatic food preparation. The ability to deform soft objects remains a great…
SandLeHome: A Simulation Environment for Deformable Object Manipulation in Household Scenarios
Household environments present one of the most common, impactful yet challenging application domains for robotics. Within household scenarios, manipulating deformable objects is particularly difficult, both in simulation…
Degradation mode estimation using reconstructed open circuit voltage curves from multi-year home storage field data
A battery's open circuit voltage (OCV) curve can be seen as its electrochemical signature. Its shape and age-related shift provide information on aging processes and material composition on both electrodes. However, most…