Fast Video-based Face Recognition in Collaborative Learning Environments
Face recognition is a classical problem in Computer Vision that has experienced significant progress. Yet, in digital videos, face recognition is complicated by occlusion, pose and lighting variations, and persons entering/leaving the scene. The thesis's goal is to develop a fast method for face recognition in digital videos that is applicable to large datasets. The thesis introduces several methods to address the problems associated with video face recognition. First, to address issues associated with pose and lighting variations, a collection of face prototypes is associated with each student. Second, to speed up the process, sampling, K-means Clustering, and a combination of both are used to reduce the number of face prototypes per student. Third, the videos are processed at different frame rates. Fourth, the thesis proposes the use of active sets to address occlusion and to eliminate face recognition application on video frames with slow face motions. Fifth, the thesis develops a group face detector that recognizes students within a collaborative learning group, while rejecting out-of-group face detections. Sixth, the thesis introduces a face DeID for protecting the students' identities. Seventh, the thesis uses data augmentation to increase the training set's size. The different methods are combined using multi-objective optimization to guarantee that the full method remains fast without sacrificing accuracy. To test the approach, the thesis develops the AOLME dataset of 138 student faces (81 boys and 57 girls) of ages 10 to 14, who are predominantly Latina/o students. Compared to the baseline method, the final optimized method resulted in fast recognition times with significant improvements in face recognition accuracy. Using face prototype sampling only, the proposed method achieved an accuracy of 71.8% compared to 62.3% for the baseline system, while running 11.6 times faster.
Code (0)
등록된 구현이 없습니다.
Tasks
Data AugmentationFace RecognitionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Facial Recognition in Collaborative Learning Videos
Face recognition in collaborative learning videos presents many challenges. In collaborative learning videos, students sit around a typical table at different positions to the recording camera, come and go, move around, …
Face DetectionFace RecognitionVideo Face Recognition System: RetinaFace-mnet-faster and Secondary Search
Face recognition is widely used in the scene. However, different visual environments require different methods, and face recognition has a difficulty in complex environments. Therefore, this paper mainly experiments comp…
Face RecognitionRetrievalFast Low-parameter Video Activity Localization in Collaborative Learning Environments
Research on video activity detection has primarily focused on identifying well-defined human activities in short video segments. The majority of the research on video activity recognition is focused on the development of…
Action DetectionActivity DetectionActivity RecognitionTransfer LearningSemantics-Driven Cloud-Edge Collaborative Inference
With the proliferation of video data in smart city applications like intelligent transportation, efficient video analytics has become crucial but also challenging. This paper proposes a semantics-driven cloud-edge collab…
Collaborative InferenceLicense Plate RecognitionLong Term Object Detection and Tracking in Collaborative Learning Environments
Human activity recognition in videos is a challenging problem that has drawn a lot of interest, particularly when the goal requires the analysis of a large video database. AOLME project provides a collaborative learning …
Activity RecognitionActivity Recognition In VideosData AugmentationHand Detection+3