Learning to Cluster Faces via Transformer
Face clustering is a useful tool for applications like automatic face annotation and retrieval. The main challenge is that it is difficult to cluster images from the same identity with different face poses, occlusions, and image quality. Traditional clustering methods usually ignore the relationship between individual images and their neighbors which may contain useful context information. In this paper, we repurpose the well-known Transformer and introduce a Face Transformer for supervised face clustering. In Face Transformer, we decompose the face clustering into two steps: relation encoding and linkage predicting. Specifically, given a face image, a \textbf{relation encoder} module aggregates local context information from its neighbors and a \textbf{linkage predictor} module judges whether a pair of images belong to the same cluster or not. In the local linkage graph view, Face Transformer can generate more robust node and edge representations compared to existing methods. Experiments on both MS-Celeb-1M and DeepFashion show that our method achieves state-of-the-art performance, e.g., 91.12\% in pairwise F-score on MS-Celeb-1M.
Code (0)
등록된 구현이 없습니다.
Tasks
ClusteringFace ClusteringRelationRetrievalMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Robust Load Prediction of Power Network Clusters Based on Cloud-Model-Improved Transformer
Load data from power network clusters indicates economic development in each area, crucial for predicting regional trends and guiding power enterprise decisions. The Transformer model, a leading method for load predictio…
Self-supervised Video-centralised Transformer for Video Face Clustering
This paper presents a novel method for face clustering in videos using a video-centralised transformer. Previous works often employed contrastive learning to learn frame-level representation and used average pooling to a…
ClusteringContrastive LearningFace ClusteringConstrained Clustering and Its Application to Face Clustering in Videos
In this paper, we focus on face clustering in videos. Given the detected faces from real-world videos, we partition all faces into K disjoint clusters. Different from clustering on a collection of facial images, the face…
ClusteringConstrained ClusteringFace ClusteringVoRTX: Volumetric 3D Reconstruction With Transformers for Voxelwise View Selection and Fusion
Recent volumetric 3D reconstruction methods can produce very accurate results, with plausible geometry even for unobserved surfaces. However, they face an undesirable trade-off when it comes to multi-view fusion. They ca…
3D ReconstructionDiversityClustering Millions of Faces by Identity
In this work, we attempt to address the following problem: Given a large number of unlabeled face images, cluster them into the individual identities present in this data. We consider this a relevant problem in different…
Clustering