Imagine with the Teacher: Complete Shape in a Multi-View Distillation Way
Point cloud completion aims to recover the completed 3D shape of an object from its partial observation caused by occlusion, sensor's limitation, noise, etc. When some key semantic information is lost in the incomplete point cloud, the neural network needs to infer the missing part based on the input information. Intuitively we would apply an autoencoder architecture to solve this kind of problem, which take the incomplete point cloud as input and is supervised by the ground truth. This process that develops model's imagination from incomplete shape to complete shape is done automatically in the latent space. But the knowledge for mapping from incomplete to complete still remains dark and could be further explored. Motivated by the knowledge distillation's teacher-student learning strategy, we design a knowledge transfer way for completing 3d shape. In this work, we propose a novel View Distillation Point Completion Network (VD-PCN), which solve the completion problem by a multi-view distillation way. The design methodology fully leverages the orderliness of 2d pixels, flexibleness of 2d processing and powerfulness of 2d network. Extensive evaluations on PCN, ShapeNet55/34, and MVP datasets confirm the effectiveness of our design and knowledge transfer strategy, both quantitatively and qualitatively. Committed to facilitate ongoing research, we will make our code publicly available.
Code (0)
등록된 구현이 없습니다.
Tasks
Point Cloud CompletionTransfer LearningSimilar Papers 제목 키워드 기반
Time-Conditioned Generative Modeling of Object-Centric Representations for Video Decomposition and Prediction
When perceiving the world from multiple viewpoints, humans have the ability to reason about the complete objects in a compositional manner even when an object is completely occluded from certain viewpoints. Meanwhile, hu…
DisentanglementGaussian ProcessesObjectVideo GenerationKTNet: Knowledge Transfer for Unpaired 3D Shape Completion
Unpaired 3D object completion aims to predict a complete 3D shape from an incomplete input without knowing the correspondence between the complete and incomplete shapes. In this paper, we propose the novel KTNet to solve…
Point Cloud CompletionTransfer LearningThinking Without Images: Internalizing Visual Manipulation with On-Policy Self-Distillation
''Thinking with Images'' has emerged as an effective paradigm for fine-grained visual reasoning: by explicitly zooming into relevant regions and reasoning over crops, models can access local evidence that is difficult to…
Visual ReasoningImplicit 3D Human Mesh Recovery using Consistency with Pose and Shape from Unseen-view
From an image of a person, we can easily infer the natural 3D pose and shape of the person even if ambiguity exists. This is because we have a mental model that allows us to imagine a person's appearance at different vie…
3D Human Pose EstimationHuman Mesh RecoverySelf-Supervised LearningCasPoinTr: Point Cloud Completion with Cascaded Networks and Knowledge Distillation
Point clouds collected from real-world environments are often incomplete due to factors such as limited sensor resolution, single viewpoints, occlusions, and noise. These challenges make point cloud completion essential …
Knowledge DistillationPoint Cloud CompletionPoint Clouds