Local Layering for Joint Motion Estimation and Occlusion Detection
Most motion estimation algorithms (optical flow, layered models) cannot handle large amount of occlusion in textureless regions, as motion is often initialized with no occlusion assumption despite that occlusion may be included in the final objective. To handle such situations, we propose a local layering model where motion and occlusion relationships are inferred jointly. In particular, the uncertainties of occlusion relationships are retained so that motion is inferred by considering all the possibilities of local occlusion relationships. In addition, the local layering model handles articulated objects with self-occlusion. We demonstrate that the local layering model can handle motion and occlusion well for both challenging synthetic and real sequences.
Code (0)
등록된 구현이 없습니다.
Tasks
Motion EstimationOptical Flow EstimationSimilar Papers 제목 키워드 기반
Aggregation of local parametric candidates with exemplar-based occlusion handling for optical flow
Handling all together large displacements, motion details and occlusions remains an open issue for reliable computation of optical flow in a video sequence. We propose a two-step aggregation paradigm to address this prob…
Occlusion HandlingOptical Flow EstimationJoint-Motion Mutual Learning for Pose Estimation in Videos
Human pose estimation in videos has long been a compelling yet challenging task within the realm of computer vision. Nevertheless, this task remains difficult because of the complex video scenes, such as video defocus an…
Pose EstimationOcclusions, Motion and Depth Boundaries with a Generic Network for Disparity, Optical Flow or Scene Flow Estimation
Occlusions play an important role in disparity and optical flow estimation, since matching costs are not available in occluded areas and occlusions indicate depth or motion boundaries. Moreover, occlusions are relevant f…
Motion SegmentationOptical Flow EstimationScene Flow EstimationSegmentationLayering Virtual Try-On
In the real world, fashion is about layering: adding a jacket over a shirt, or a sequence of adding and removing layers, rather than just a single-layer swap. This fundamental real-world task remains a challenge in exist…
Layered RGBD Scene Flow Estimation
As consumer depth sensors become widely available, estimating scene flow from RGBD sequences has received increasing attention. Although the depth information allows the recovery of 3D motion from a single view, it poses…
Optical Flow EstimationScene Flow EstimationScene Segmentation