Shape from Blur: Recovering Textured 3D Shape and Motion of Fast Moving Objects
We address the novel task of jointly reconstructing the 3D shape, texture, and motion of an object from a single motion-blurred image. While previous approaches address the deblurring problem only in the 2D image domain, our proposed rigorous modeling of all object properties in the 3D domain enables the correct description of arbitrary object motion. This leads to significantly better image decomposition and sharper deblurring results. We model the observed appearance of a motion-blurred object as a combination of the background and a 3D object with constant translation and rotation. Our method minimizes a loss on reconstructing the input image via differentiable rendering with suitable regularizers. This enables estimating the textured 3D mesh of the blurred object with high fidelity. Our method substantially outperforms competing approaches on several benchmarks for fast moving objects deblurring. Qualitative results show that the reconstructed 3D mesh generates high-quality temporal super-resolution and novel views of the deblurred object.
Code (1)
Tasks
DeblurringObjectSuper-ResolutionTranslationSimilar Papers 제목 키워드 기반
Recovering 3D Shapes from Ultra-Fast Motion-Blurred Images
We consider the problem of 3D shape recovery from ultra-fast motion-blurred images. While 3D reconstruction from static images has been extensively studied, recovering geometry from extreme motion-blurred images remains …
Inverse Rendering3D ReconstructionDeep Textured 3D Reconstruction of Human Bodies
Recovering textured 3D models of non-rigid human body shapes is challenging due to self-occlusions caused by complex body poses and shapes, clothing obstructions, lack of surface texture, background clutter, sparse set o…
3D ReconstructionIm2Avatar: Colorful 3D Reconstruction from a Single Image
Existing works on single-image 3D reconstruction mainly focus on shape recovery. In this work, we study a new problem, that is, simultaneously recovering 3D shape and surface color from a single image, namely "colorful 3…
3D ReconstructionHallucinationSHARP 2020: The 1st Shape Recovery from Partial Textured 3D Scans Challenge Results
The SHApe Recovery from Partial textured 3D scans challenge, SHARP 2020, is the first edition of a challenge fostering and benchmarking methods for recovering complete textured 3D scans from raw incomplete data. SHARP 20…
BenchmarkingKinematics-Driven Gaussian Shape Deformation for Blurry Monocular Dynamic Scenes
Reconstructing dynamic 3D scenes from blurry monocular videos is challenging as motion-induced blur entangles object motion and geometry, hindering geometric consistency. We present Kinematics-GS, a kinematics-aware fram…