paper-with-me

Papers

Unsupervised Feature Analysis with Class Margin Optimization

2015-06-03 · Sen Wang, Feiping Nie, Xiaojun Chang, Lina Yao, Xue Li, Quan Z. Sheng

Unsupervised feature selection has been always attracting research attention in the communities of machine learning and data mining for decades. In this paper, we propose an unsupervised feature selection method seeking a feature coefficient matrix to select the most distinctive features. Specifically, our proposed algorithm integrates the Maximum Margin Criterion with a sparsity-based model into a joint framework, where the class margin and feature correlation are taken into account at the same time. To maximize the total data separability while preserving minimized within-class scatter simultaneously, we propose to embed Kmeans into the framework generating pseudo class label information in a scenario of unsupervised feature selection. Meanwhile, a sparsity-based model, ` 2 ,p-norm, is imposed to the regularization term to effectively discover the sparse structures of the feature coefficient matrix. In this way, noisy and irrelevant features are removed by ruling out those features whose corresponding coefficients are zeros. To alleviate the local optimum problem that is caused by random initializations of K-means, a convergence guaranteed algorithm with an updating strategy for the clustering indicator matrix, is proposed to iteractively chase the optimal solution. Performance evaluation is extensively conducted over six benchmark data sets. From plenty of experimental results, it is demonstrated that our method has superior performance against all other compared approaches.

📄 PDF Abstract BibTeX arXiv:1506.01330

Code (0)

등록된 구현이 없습니다.

Tasks

ClusteringFeature Correlationfeature selection

Similar Papers 제목 키워드 기반

Unsupervised Broadcast News Summarization; a comparative study on Maximal Marginal Relevance (MMR) and Latent Semantic Analysis (LSA)

2023-01-05 · Majid Ramezani, Mohammad-Salar Shahryari, Amir-Reza Feizi-Derakhshi, Mohammad-Reza Feizi-Derakhshi

The methods of automatic speech summarization are classified into two groups: supervised and unsupervised methods. Supervised methods are based on a set of features, while unsupervised methods perform summarization based…

News Summarization

Marginal Laplacian Score

2023-11-29 · Guy Hay, Ohad Volk

High-dimensional imbalanced data poses a machine learning challenge. In the absence of sufficient or high-quality labels, unsupervised feature selection methods are crucial for the success of subsequent algorithms. There…

feature selection

Maximizing Conditional Independence for Unsupervised Domain Adaptation

2022-03-07 · Yi-Ming Zhai, You-Wei Luo

Unsupervised domain adaptation studies how to transfer a learner from a labeled source domain to an unlabeled target domain with different distributions. Existing methods mainly focus on matching the marginal distributio…

Domain AdaptationUnsupervised Domain Adaptation

Unsupervised 3D Learning for Shape Analysis via Multiresolution Instance Discrimination

2020-08-03 · Peng-Shuai Wang, Yu-Qi Yang, Qian-Fang Zou, Zhirong Wu 외

Although unsupervised feature learning has demonstrated its advantages to reducing the workload of data labeling and network design in many fields, existing unsupervised 3D learning methods still cannot offer a generic n…

3D Point Cloud Linear Classification3D Semantic Segmentation

Statistical-mechanical analysis of pre-training and fine tuning in deep learning

2015-01-19 · Masayuki Ohzeki

In this paper, we present a statistical-mechanical analysis of deep learning. We elucidate some of the essential components of deep learning---pre-training by unsupervised learning and fine tuning by supervised learning.…

Deep Learning