Mask-FPAN: Semi-Supervised Face Parsing in the Wild With De-Occlusion and UV GAN
Fine-grained semantic segmentation of a person's face and head, including facial parts and head components, has progressed a great deal in recent years. However, it remains a challenging task, whereby considering ambiguous occlusions and large pose variations are particularly difficult. To overcome these difficulties, we propose a novel framework termed Mask-FPAN. It uses a de-occlusion module that learns to parse occluded faces in a semi-supervised way. In particular, face landmark localization, face occlusionstimations, and detected head poses are taken into account. A 3D morphable face model combined with the UV GAN improves the robustness of 2D face parsing. In addition, we introduce two new datasets named FaceOccMask-HQ and CelebAMaskOcc-HQ for face paring work. The proposed Mask-FPAN framework addresses the face parsing problem in the wild and shows significant performance improvements with MIOU from 0.7353 to 0.9013 compared to the state-of-the-art on challenging face datasets.
Code (0)
등록된 구현이 없습니다.
Tasks
Face ModelFace ParsingSemantic SegmentationSimilar Papers 제목 키워드 기반
Recyclable Semi-supervised Method Based on Multi-model Ensemble for Video Scene Parsing
Pixel-level Scene Understanding is one of the fundamental problems in computer vision, which aims at recognizing object classes, masks and semantics of each pixel in the given image. Since the real-world is actually vide…
Scene ParsingScene UnderstandingSemantic SegmentationVideo Semantic SegmentationWeakly Supervised Body Part Segmentation with Pose based Part Priors
Human body part segmentation refers to the task of predicting the semantic segmentation mask for each body part. Fully supervised body part segmentation methods achieve good performances but require an enormous amount of…
Face ParsingSegmentationSemantic SegmentationSemi-supervised Video Semantic Segmentation Using Unreliable Pseudo Labels for PVUW2024
Pixel-level Scene Understanding is one of the fundamental problems in computer vision, which aims at recognizing object classes, masks and semantics of each pixel in the given image. Compared with image scene parsing, vi…
Scene ParsingScene UnderstandingSemantic SegmentationVideo Semantic SegmentationSelf-Supervised Log Parsing
Logs are extensively used during the development and maintenance of software systems. They collect runtime events and allow tracking of code execution, which enables a variety of critical tasks such as troubleshooting an…
Anomaly DetectionFault DetectionLanguage ModelingLanguage Modelling+3FedParsing: a Semi-Supervised Federated Learning Model on Semantic Parsing
Although many semantic parsing models have been proven to work effectively on "NL-to-SQL", the limitation of annotated datasets remains a great challenge. In many semi-supervised models, while they use unlabeled data to …
Federated LearningSemantic Parsing