argmax centroid
We propose a general method to construct centroid approximation for the distribution of maximum points of a random function (a.k.a. argmax distribution), which finds broad applications in machine learning. Our method optimizes a set of centroid points to compactly approximate the argmax distribution with a simple objective function, without explicitly drawing exact samples from the argmax distribution. Theoretically, the argmax centroid method can be shown to minimize a surrogate of Wasserstein distance between the ground-truth argmax distribution and the centroid approximation under proper conditions. We demonstrate the applicability and effectiveness of our method on a variety of real-world multi-task learning applications, including few-shot image classification, personalized dialogue systems and multi-target domain adaptation.
Code (0)
등록된 구현이 없습니다.
Tasks
Domain AdaptationFew-Shot Image Classificationimage-classificationImage ClassificationMulti-target Domain AdaptationMulti-Task LearningSimilar Papers 제목 키워드 기반
An Approach Towards Learning K-means-friendly Deep Latent Representation
Clustering is a long-standing problem area in data mining. The centroid-based classical approaches to clustering mainly face difficulty in the case of high dimensional inputs such as images. With the advent of deep neura…
ClusteringA Generalized Argmax Theorem with Applications
The argmax theorem is a useful result for deriving the limiting distribution of estimators in many applications. The conclusion of the argmax theorem states that the argmax of a sequence of stochastic processes converges…
Localization with Sampling-Argmax
Soft-argmax operation is commonly adopted in detection-based methods to localize the target position in a differentiable manner. However, training the neural network with soft-argmax makes the shape of the probability ma…
3D Human Pose EstimationArgmax Flows and Multinomial Diffusion: Learning Categorical Distributions
Generative flows and diffusion models have been predominantly trained on ordinal data, for example natural images. This paper introduces two extensions of flows and diffusion for categorical data such as language or imag…
DenoisingImage SegmentationLanguage ModellingSegmentation+1Heatmap Regression without Soft-Argmax for Facial Landmark Detection
Facial landmark detection is an important task in computer vision with numerous applications, such as head pose estimation, expression analysis, face swapping, etc. Heatmap regression-based methods have been widely used …
Facial Landmark DetectionStructured PredictionHead Pose EstimationFace Swapping