paper-with-me

홈 › Papers

Unsupervised Learning of Landmarks by Descriptor Vector Exchange

2019-08-18 · ICCV 2019 10 · James Thewlis, Samuel Albanie, Hakan Bilen, Andrea Vedaldi

Equivariance to random image transformations is an effective method to learn landmarks of object categories, such as the eyes and the nose in faces, without manual supervision. However, this method does not explicitly guarantee that the learned landmarks are consistent with changes between different instances of the same object, such as different facial identities. In this paper, we develop a new perspective on the equivariance approach by noting that dense landmark detectors can be interpreted as local image descriptors equipped with invariance to intra-category variations. We then propose a direct method to enforce such an invariance in the standard equivariant loss. We do so by exchanging descriptor vectors between images of different object instances prior to matching them geometrically. In this manner, the same vectors must work regardless of the specific object identity considered. We use this approach to learn vectors that can simultaneously be interpreted as local descriptors and dense landmarks, combining the advantages of both. Experiments on standard benchmarks show that this approach can match, and in some cases surpass state-of-the-art performance amongst existing methods that learn landmarks without supervision. Code is available at www.robots.ox.ac.uk/~vgg/research/DVE/.

📄 PDF Abstract BibTeX arXiv:1908.06427

Code (1)

jamt9000/DVE 공식 구현 pytorch

Tasks

Facial Landmark DetectionObjectUnsupervised Facial Landmark Detection

Similar Papers 제목 키워드 기반

Unsupervised Learning of Object Landmarks via Self-Training Correspondence

2020-12-01 · NeurIPS 2020 12 · Dimitrios Mallis, Enrique Sanchez, Matthew Bell, Georgios Tzimiropoulos

This paper addresses the problem of unsupervised discovery of object landmarks. We take a different path compared to that of existing works, based on 2 novel perspectives: (1) Self-training: starting from generic keypoin…

ClusteringObjectUnsupervised Landmark Detection

From Keypoints to Object Landmarks via Self-Training Correspondence: A novel approach to Unsupervised Landmark Discovery

2022-05-31 · Dimitrios Mallis, Enrique Sanchez, Matt Bell, Georgios Tzimiropoulos

This paper proposes a novel paradigm for the unsupervised learning of object landmark detectors. Contrary to existing methods that build on auxiliary tasks such as image generation or equivariance, we propose a self-trai…

Contrastive LearningImage Generation

Leveraging Image based Prior for Visual Place Recognition

2015-05-13 · Tsukamoto Taisho, Tanaka Kanji

In this study, we propose a novel scene descriptor for visual place recognition. Unlike popular bag-of-words scene descriptors which rely on a library of vector quantized visual features, our proposed descriptor is based…

Visual Place Recognition

A Document Descriptor using Covariance of Word Vectors

2018-07-01 · ACL 2018 7 · Marwan Torki

In this paper, we address the problem of finding a novel document descriptor based on the covariance matrix of the word vectors of a document. Our descriptor has a fixed length, which makes it easy to use in many supervi…

Landmark2Vec: An Unsupervised Neural Network-Based Landmark Positioning Method

2020-01-28 · Alireza Razavi

A Neural Network-based method for unsupervised landmarks map estimation from measurements taken from landmarks is introduced. The measurements needed for training the network are the signals observed/received from landma…