Restore3D: Breathing Life into Broken Objects with Shape and Texture Restoration
Restoring incomplete or damaged 3D objects is crucial for cultural heritage preservation, occluded object reconstruction, and artistic design. Existing methods primarily focus on geometric completion, often neglecting texture restoration and struggling with relatively complex and diverse objects. We introduce Restore3D, a novel framework that simultaneously restores both the shape and texture of broken objects using multi-view images. To address limited training data, we develop an automated data generation pipeline that synthesizes paired incomplete-complete samples from large-scale 3D datasets. Central to Restore3D is a multi-view model, enhanced by a carefully designed Mask Self-Perceiver module with a Depth-Aware Mask Rectifier. The rectified masks learned by the self-perceiver guide an image integration and enhancement phase, helping retain observed shape and texture patterns while refining the generated regions and mitigating the low-resolution limitations of the base model, yielding high-resolution, semantically coherent, and view-consistent multi-view images. A coarse-to-fine reconstruction strategy is then employed to recover detailed textured 3D meshes from refined multi-view images. Experiments on synthetic and real broken-object benchmarks show that Restore3D improves multi-view restoration quality and textured-mesh reconstruction over representative inpainting, completion, and reconstruction baselines in the evaluated settings. Project Page: restore3dx.github.io
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Reassembling Broken Objects using Breaking Curves
Reassembling 3D broken objects is a challenging task. A robust solution that generalizes well must deal with diverse patterns associated with different types of broken objects. We propose a method that tackles the pairwi…
ObjectBreathing Life Into Sketches Using Text-to-Video Priors
A sketch is one of the most intuitive and versatile tools humans use to convey their ideas visually. An animated sketch opens another dimension to the expression of ideas and is widely used by designers for a variety of …
Rodent Breathing Waveforms in ApoE Rats: Statistical and Entropic Differentiation
Apolipoprotein E (ApoE) gene variations are involved in lipid metabolism and cholesterol transport, with the ApoE4 allele being a known risk factor associated with neurodegenerative conditions later in life. Emerging evi…
The human longevity record may hold for decades
Since 1990 Jeanne Louise Calment has held the record for human longevity. She was born on 21 February 1875, became the longest-lived human on 12 May 1990 when she was 115.21 and died on 4 August 1997 at age 122.45 years.…
Corrupted but Not Broken: Understanding and Mitigating the Negative Impacts of Corrupted Data in Visual Instruction Tuning
Visual Instruction Tuning (VIT) aims to enhance Multimodal Large Language Models (MLLMs), yet its effectiveness is often compromised by corrupted datasets with issues such as hallucinated content, incorrect responses, an…
Optical Character Recognition (OCR)