Neonatal Face and Facial Landmark Detection from Video Recordings
This paper explores automated face and facial landmark detection of neonates, which is an important first step in many video-based neonatal health applications, such as vital sign estimation, pain assessment, sleep-wake classification, and jaundice detection. Utilising three publicly available datasets of neonates in the clinical environment, 366 images (258 subjects) and 89 (66 subjects) were annotated for training and testing, respectively. Transfer learning was applied to two YOLO-based models, with input training images augmented with random horizontal flipping, photo-metric colour distortion, translation and scaling during each training epoch. Additionally, the re-orientation of input images and fusion of trained deep learning models was explored. Our proposed model based on YOLOv7Face outperformed existing methods with a mean average precision of 84.8% for face detection, and a normalised mean error of 0.072 for facial landmark detection. Overall, this will assist in the development of fully automated neonatal health assessment algorithms.
Code (0)
등록된 구현이 없습니다.
Tasks
Face DetectionFacial Landmark DetectionTransfer LearningSimilar Papers 제목 키워드 기반
NeoLoc-68: End-to-end 68-point neonatal facial landmark localisation in neonatal clinical environments
Facial landmark localisation is a prerequisite for developing automated, non-contact neonatal pain assessment methods. Clinicians use pain scales to judge the severity of pain, many of which rely on facial expression. Ho…
Facial Landmark DetectionDetecting facial landmarks in the video based on a hybrid framework
To dynamically detect the facial landmarks in the video, we propose a novel hybrid framework termed as detection-tracking-detection (DTD). First, the face bounding box is achieved from the first frame of the video sequen…
Face DetectionInfantFace: Detecting infant faces in neonatal clinical environments
Reliable localisation of the neonatal face is the first step for several video-camera based non-contact assessments such as pain and distress related facial expression analysis, pain scoring, cardiorespiratory signal ext…
Domain AdaptationFace DetectionDeep Learning Framework to Detect Face Masks from Video Footage
The use of facial masks in public spaces has become a social obligation since the wake of the COVID-19 global pandemic and the identification of facial masks can be imperative to ensure public safety. Detection of facial…
Deep LearningFace DetectionFAB: A Robust Facial Landmark Detection Framework for Motion-Blurred Videos
Recently, facial landmark detection algorithms have achieved remarkable performance on static images. However, these algorithms are neither accurate nor stable in motion-blurred videos. The missing of structure informati…
DeblurringFacial Landmark Detection