Hole Filling Method for Depth Image Based Rendering Based on Boundary Decision
In three-dimensional display systems, depth image based rendering is the most commonly used technique for generating images captured from a virtual viewpoint through reference views and depth maps. However, disoccluded hole filling remain a challenging issue as newly exposed area appears in the virtual view. Image inpainting based hole filling is a popular approach for filling in the hole, but the conventional methods generate annoying artifacts along the boundaries of the foreground objects. This letter presents a robust hole filling method that generates a virtual view with high quality. First, by using the local and neighboring property of the depth map, the background region is filled prior to the foreground region. Also, in the matching step to find the data to fill in, depth homogeneity is considered. Finally, based on the boundary decision using the depth property, the boundary regions are filled with background-relevant data to reduce boundary artifacts. Experimental results show that the views synthesized by the proposed method achieve higher visual comfort than the view synthesized by the existing methods.
Code (1)
Tasks
Image InpaintingSimilar Papers 제목 키워드 기반
A Hole Filling Approach Based on Background Reconstruction for View Synthesis in 3D Video
The depth image based rendering (DIBR) plays a key role in 3D video synthesis, by which other virtual views can be generated from a 2D video and its depth map. However, in the synthesis process, the background occluded b…
Motion CompensationHole Filling with Multiple Reference Views in DIBR View Synthesis
Depth-image-based rendering (DIBR) oriented view synthesis has been widely employed in the current depth-based 3D video systems by synthesizing a virtual view from an arbitrary viewpoint. However, holes may appear in the…
Indoor Depth Completion with Boundary Consistency and Self-Attention
Depth estimation features are helpful for 3D recognition. Commodity-grade depth cameras are able to capture depth and color image in real-time. However, glossy, transparent or distant surface cannot be scanned properly b…
Depth CompletionDepth EstimationImage InpaintingUVTran: Accurate Hole-Filling Parameterization with Transformers
In industrial design, N-sided hole filling is typically formulated as the construction of a single trimmed B-spline surface by minimizing a fairness energy subject to geometric boundary constraints. This formulation requ…
Layered Depth Refinement with Mask Guidance
Depth maps are used in a wide range of applications from 3D rendering to 2D image effects such as Bokeh. However, those predicted by single image depth estimation (SIDE) models often fail to capture isolated holes in obj…
Depth EstimationDepth PredictionImage MattingSelf-Supervised Learning