paper-with-me

홈 › Papers

Task-adaptive Q-Face

2024-05-15 · Haomiao Sun, Mingjie He, Shiguang Shan, Hu Han, Xilin Chen

Although face analysis has achieved remarkable improvements in the past few years, designing a multi-task face analysis model is still challenging. Most face analysis tasks are studied as separate problems and do not benefit from the synergy among related tasks. In this work, we propose a novel task-adaptive multi-task face analysis method named as Q-Face, which simultaneously performs multiple face analysis tasks with a unified model. We fuse the features from multiple layers of a large-scale pre-trained model so that the whole model can use both local and global facial information to support multiple tasks. Furthermore, we design a task-adaptive module that performs cross-attention between a set of query vectors and the fused multi-stage features and finally adaptively extracts desired features for each face analysis task. Extensive experiments show that our method can perform multiple tasks simultaneously and achieves state-of-the-art performance on face expression recognition, action unit detection, face attribute analysis, age estimation, and face pose estimation. Compared to conventional methods, our method opens up new possibilities for multi-task face analysis and shows the potential for both accuracy and efficiency.

📄 PDF Abstract BibTeX arXiv:2405.09059

Code (0)

등록된 구현이 없습니다.

Tasks

Action Unit DetectionAge EstimationAttributePose Estimation

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Similar Papers 제목 키워드 기반

Deep Adaptive Attention for Joint Facial Action Unit Detection and Face Alignment

2018-03-15 · ECCV 2018 9 · Zhiwen Shao, Zhilei Liu, Jianfei Cai, Lizhuang Ma

Facial action unit (AU) detection and face alignment are two highly correlated tasks since facial landmarks can provide precise AU locations to facilitate the extraction of meaningful local features for AU detection. Mos…

Action Unit DetectionFace AlignmentFacial Action Unit Detection

J$\hat{\text{A}}$A-Net: Joint Facial Action Unit Detection and Face Alignment via Adaptive Attention

2020-03-18 · Zhiwen Shao, Zhilei Liu, Jianfei Cai, Lizhuang Ma

Facial action unit (AU) detection and face alignment are two highly correlated tasks, since facial landmarks can provide precise AU locations to facilitate the extraction of meaningful local features for AU detection. Ho…

Action Unit DetectionFace AlignmentFacial Action Unit Detection

X2-Softmax: Margin Adaptive Loss Function for Face Recognition

2023-12-08 · Jiamu Xu, Xiaoxiang Liu, Xinyuan Zhang, Yain-Whar Si 외

Learning the discriminative features of different faces is an important task in face recognition. By extracting face features in neural networks, it becomes easy to measure the similarity of different face images, which …

Face Recognition

End-to-end Face-swapping via Adaptive Latent Representation Learning

2023-03-07 · Chenhao Lin, Pengbin Hu, Chao Shen, Qian Li

Taking full advantage of the excellent performance of StyleGAN, style transfer-based face swapping methods have been extensively investigated recently. However, these studies require separate face segmentation and blendi…

AttributeFace SwappingRepresentation LearningStyle Transfer

AdaptiveFace: Adaptive Margin and Sampling for Face Recognition

2019-06-01 · CVPR 2019 6 · Hao Liu, Xiangyu Zhu, Zhen Lei, Stan Z. Li

Training large-scale unbalanced data is the central topic in face recognition. In the past two years, face recognition has achieved remarkable improvements due to the introduction of margin based Softmax loss. However, t…

Face Recognition