paper-with-me

홈 › Papers

YOLO-FaceV2: A Scale and Occlusion Aware Face Detector

2022-08-03 · Ziping Yu, Hongbo Huang, Weijun Chen, YongXin Su, Yahui Liu, Xiuying Wang

In recent years, face detection algorithms based on deep learning have made great progress. These algorithms can be generally divided into two categories, i.e. two-stage detector like Faster R-CNN and one-stage detector like YOLO. Because of the better balance between accuracy and speed, one-stage detectors have been widely used in many applications. In this paper, we propose a real-time face detector based on the one-stage detector YOLOv5, named YOLO-FaceV2. We design a Receptive Field Enhancement module called RFE to enhance receptive field of small face, and use NWD Loss to make up for the sensitivity of IoU to the location deviation of tiny objects. For face occlusion, we present an attention module named SEAM and introduce Repulsion Loss to solve it. Moreover, we use a weight function Slide to solve the imbalance between easy and hard samples and use the information of the effective receptive field to design the anchor. The experimental results on WiderFace dataset show that our face detector outperforms YOLO and its variants can be find in all easy, medium and hard subsets. Source code in https://github.com/Krasjet-Yu/YOLO-FaceV2

📄 PDF Abstract BibTeX arXiv:2208.02019

Code (1)

krasjet-yu/yolo-facev2 공식 구현 pytorch

Tasks

Face Detection

Methods 이 논문이 사용한 방법론

RFE 설명 없음
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
RoIPool 설명 없음
SEAM Self-supervised Equivariant Attention Mechanism, or SEAM, is an attention mechanism for weakly supervised semantic segmentation. The SEAM applies consistency…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
RPN A Region Proposal Network, or RPN, is a fully convolutional network that simultaneously predicts object bounds and objectness scores at each position. The RPN is trained…
Faster R-CNN Faster R-CNN is an object detection model that improves on Fast R-CNN by utilising a region proposal network…

Similar Papers 제목 키워드 기반

FaceVR: Real-Time Facial Reenactment and Eye Gaze Control in Virtual Reality

2016-10-11 · Justus Thies, Michael Zollhöfer, Marc Stamminger, Christian Theobalt 외

We propose FaceVR, a novel image-based method that enables video teleconferencing in VR based on self-reenactment. State-of-the-art face tracking methods in the VR context are focused on the animation of rigged 3d avatar…

Face-Driven Zero-Shot Voice Conversion with Memory-based Face-Voice Alignment

2023-09-18 · Zheng-Yan Sheng, Yang Ai, Yan-Nian Chen, Zhen-Hua Ling

This paper presents a novel task, zero-shot voice conversion based on face images (zero-shot FaceVC), which aims at converting the voice characteristics of an utterance from any source speaker to a newly coming target sp…

Voice Conversion

Seeing Your Speech Style: A Novel Zero-Shot Identity-Disentanglement Face-based Voice Conversion

2024-09-01 · Yan Rong, Li Liu

Face-based Voice Conversion (FVC) is a novel task that leverages facial images to generate the target speaker's voice style. Previous work has two shortcomings: (1) suffering from obtaining facial embeddings that are wel…

Contrastive LearningDisentanglementDiversityVoice Conversion

FaceVerse: a Fine-grained and Detail-controllable 3D Face Morphable Model from a Hybrid Dataset

2022-03-26 · CVPR 2022 1 · Lizhen Wang, ZhiYuan Chen, Tao Yu, Chenguang Ma 외

We present FaceVerse, a fine-grained 3D Neural Face Model, which is built from hybrid East Asian face datasets containing 60K fused RGB-D images and 2K high-fidelity 3D head scan models. A novel coarse-to-fine structure …

2k3D Face ReconstructionFace ModelFace Reconstruction

APB2FaceV2: Real-Time Audio-Guided Multi-Face Reenactment

2020-10-25 · Jiangning Zhang, Xianfang Zeng, Chao Xu, Jun Chen 외

Audio-guided face reenactment aims to generate a photorealistic face that has matched facial expression with the input audio. However, current methods can only reenact a special person once the model is trained or need e…

CPUFace ReenactmentGPU