paper-with-me

Papers

Learning to Cluster Faces via Transformer

2021-04-23 · Jinxing Ye, Xioajiang Peng, Baigui Sun, Kai Wang, Xiuyu Sun, Hao Li, Hanqing Wu

Face clustering is a useful tool for applications like automatic face annotation and retrieval. The main challenge is that it is difficult to cluster images from the same identity with different face poses, occlusions, and image quality. Traditional clustering methods usually ignore the relationship between individual images and their neighbors which may contain useful context information. In this paper, we repurpose the well-known Transformer and introduce a Face Transformer for supervised face clustering. In Face Transformer, we decompose the face clustering into two steps: relation encoding and linkage predicting. Specifically, given a face image, a \textbf{relation encoder} module aggregates local context information from its neighbors and a \textbf{linkage predictor} module judges whether a pair of images belong to the same cluster or not. In the local linkage graph view, Face Transformer can generate more robust node and edge representations compared to existing methods. Experiments on both MS-Celeb-1M and DeepFashion show that our method achieves state-of-the-art performance, e.g., 91.12\% in pairwise F-score on MS-Celeb-1M.

📄 PDF Abstract BibTeX arXiv:2104.11502

Code (0)

등록된 구현이 없습니다.

Tasks

ClusteringFace ClusteringRelationRetrieval

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Position-Wise Feed-Forward Layer 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Residual Connection 설명 없음

Similar Papers 제목 키워드 기반

Robust Load Prediction of Power Network Clusters Based on Cloud-Model-Improved Transformer

2024-07-30 · Cheng Jiang, Gang Lu, Xue Ma, Di wu

Load data from power network clusters indicates economic development in each area, crucial for predicting regional trends and guiding power enterprise decisions. The Transformer model, a leading method for load predictio…

Self-supervised Video-centralised Transformer for Video Face Clustering

2022-03-24 · Yujiang Wang, Mingzhi Dong, Jie Shen, Yiming Luo 외

This paper presents a novel method for face clustering in videos using a video-centralised transformer. Previous works often employed contrastive learning to learn frame-level representation and used average pooling to a…

ClusteringContrastive LearningFace Clustering

Constrained Clustering and Its Application to Face Clustering in Videos

2013-06-01 · CVPR 2013 6 · Baoyuan Wu, Yifan Zhang, Bao-Gang Hu, Qiang Ji

In this paper, we focus on face clustering in videos. Given the detected faces from real-world videos, we partition all faces into K disjoint clusters. Different from clustering on a collection of facial images, the face…

ClusteringConstrained ClusteringFace Clustering

VoRTX: Volumetric 3D Reconstruction With Transformers for Voxelwise View Selection and Fusion

2021-12-01 · Noah Stier, Alexander Rich, Pradeep Sen, Tobias Höllerer

Recent volumetric 3D reconstruction methods can produce very accurate results, with plausible geometry even for unobserved surfaces. However, they face an undesirable trade-off when it comes to multi-view fusion. They ca…

3D ReconstructionDiversity

Clustering Millions of Faces by Identity

2016-04-04 · Charles Otto, Dayong Wang, Anil K. Jain

In this work, we attempt to address the following problem: Given a large number of unlabeled face images, cluster them into the individual identities present in this data. We consider this a relevant problem in different…

Clustering