Detecting facial landmarks in the video based on a hybrid framework
To dynamically detect the facial landmarks in the video, we propose a novel hybrid framework termed as detection-tracking-detection (DTD). First, the face bounding box is achieved from the first frame of the video sequence based on a traditional face detection method. Then, a landmark detector detects the facial landmarks, which is based on a cascaded deep convolution neural network (DCNN). Next, the face bounding box in the current frame is estimated and validated after the facial landmarks in the previous frame are tracked based on the median flow. Finally, the facial landmarks in the current frame are exactly detected from the validated face bounding box via the landmark detector. Experimental results indicate that the proposed framework can detect the facial landmarks in the video sequence more effectively and with lower consuming time compared to the frame-by-frame method via the DCNN.
Code (0)
등록된 구현이 없습니다.
Tasks
Face DetectionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Detecting speaking persons in video
We present a novel method for detecting speaking persons in video, by extracting facial landmarks with a neural network and analysing these landmarks statistically over time
Deep Learning Framework to Detect Face Masks from Video Footage
The use of facial masks in public spaces has become a social obligation since the wake of the COVID-19 global pandemic and the identification of facial masks can be imperative to ensure public safety. Detection of facial…
Deep LearningFace DetectionA Lightweight and Interpretable Deepfakes Detection Framework
The recent realistic creation and dissemination of so-called deepfakes poses a serious threat to social life, civil rest, and law. Celebrity defaming, election manipulation, and deepfakes as evidence in court of law are …
Face SwappingA Detailed Look At CNN-based Approaches In Facial Landmark Detection
Facial landmark detection has been studied over decades. Numerous neural network (NN)-based approaches have been proposed for detecting landmarks, especially the convolutional neural network (CNN)-based approaches. In ge…
Facial Landmark DetectionEnhancing Facial Consistency in Conditional Video Generation via Facial Landmark Transformation
Landmark-guided character animation generation is an important field. Generating character animations with facial features consistent with a reference image remains a significant challenge in conditional video generation…
Video Generation