Clustering Unclustered Data: Unsupervised Binary Labeling of Two Datasets Having Different Class Balances
We consider the unsupervised learning problem of assigning labels to unlabeled data. A naive approach is to use clustering methods, but this works well only when data is properly clustered and each cluster corresponds to an underlying class. In this paper, we first show that this unsupervised labeling problem in balanced binary cases can be solved if two unlabeled datasets having different class balances are available. More specifically, estimation of the sign of the difference between probability densities of two unlabeled datasets gives the solution. We then introduce a new method to directly estimate the sign of the density difference without density estimation. Finally, we demonstrate the usefulness of the proposed method against several clustering methods on various toy problems and real-world datasets.
Code (0)
등록된 구현이 없습니다.
Tasks
ClusteringDensity EstimationSimilar Papers 제목 키워드 기반
A Dynamic Framework for Semantic Grouping of Common Data Elements (CDE) Using Embeddings and Clustering
This research aims to develop a dynamic and scalable framework to facilitate harmonization of Common Data Elements (CDEs) across heterogeneous biomedical datasets by addressing challenges such as semantic heterogeneity, …
Clusteringscientific discoveryClustering by Attention: Leveraging Prior Fitted Transformers for Data Partitioning
Clustering is a core task in machine learning with wide-ranging applications in data mining and pattern recognition. However, its unsupervised nature makes it inherently challenging. Many existing clustering algorithms s…
SPICE: Semantic Pseudo-labeling for Image Clustering
The similarity among samples and the discrepancy between clusters are two crucial aspects of image clustering. However, current deep clustering methods suffer from the inaccurate estimation of either feature similarity o…
ClusteringContrastive LearningDeep ClusteringImage Clustering+3Auto-Dialabel: Labeling Dialogue Data with Unsupervised Learning
The lack of labeled data is one of the main challenges when building a task-oriented dialogue system. Existing dialogue datasets usually rely on human labeling, which is expensive, limited in size, and in low coverage. I…
Active LearningClusteringSemantic-Aware Task Clustering for Constructive and Cooperative Multi-Tasking
Cooperative multi-task semantic communication (CMT-SemCom) improves task execution performance by leveraging shared representations. However, as we demonstrated in [1], cooperative multi-tasking can be either constructiv…
Semantic Communication