paper-with-me

홈 › Papers

Expand Globally, Shrink Locally: Discriminant Multi-label Learning with Missing Labels

2020-04-08 · Zhongchen Ma, Songcan Chen

In multi-label learning, the issue of missing labels brings a major challenge. Many methods attempt to recovery missing labels by exploiting low-rank structure of label matrix. However, these methods just utilize global low-rank label structure, ignore both local low-rank label structures and label discriminant information to some extent, leaving room for further performance improvement. In this paper, we develop a simple yet effective discriminant multi-label learning (DM2L) method for multi-label learning with missing labels. Specifically, we impose the low-rank structures on all the predictions of instances from the same labels (local shrinking of rank), and a maximally separated structure (high-rank structure) on the predictions of instances from different labels (global expanding of rank). In this way, these imposed low-rank structures can help modeling both local and global low-rank label structures, while the imposed high-rank structure can help providing more underlying discriminability. Our subsequent theoretical analysis also supports these intuitions. In addition, we provide a nonlinear extension via using kernel trick to enhance DM2L and establish a concave-convex objective to learn these models. Compared to the other methods, our method involves the fewest assumptions and only one hyper-parameter. Even so, extensive experiments show that our method still outperforms the state-of-the-art methods.

📄 PDF Abstract BibTeX arXiv:2004.03951

Code (0)

등록된 구현이 없습니다.

Tasks

Missing LabelsMulti-Label Learning

Similar Papers 제목 키워드 기반

Boosting the Discriminant Power of Naive Bayes

2022-09-20 · Shihe Wang, Jianfeng Ren, Xiaoyu Lian, Ruibin Bai 외

Naive Bayes has been widely used in many applications because of its simplicity and ability in handling both numerical data and categorical data. However, lack of modeling of correlations between features limits its perf…

Ridge Fusion in Statistical Learning

2013-10-15 · Bradley S. Price, Charles J. Geyer, Adam J. Rothman

We propose a penalized likelihood method to jointly estimate multiple precision matrices for use in quadratic discriminant analysis and model based clustering. A ridge penalty and a ridge fusion penalty are used to intro…

Clustering

Feature selection in omics prediction problems using cat scores and false nondiscovery rate control

2009-03-11 · Miika Ahdesmäki, Korbinian Strimmer

We revisit the problem of feature selection in linear discriminant analysis (LDA), that is, when features are correlated. First, we introduce a pooled centroids formulation of the multiclass LDA predictor function, in wh…

feature selection

What Do You Get When You Cross Beam Search with Nucleus Sampling?

2021-07-20 · insights (ACL) 2022 5 · Uri Shaham, Omer Levy

We combine beam search with the probabilistic pruning technique of nucleus sampling to create two deterministic nucleus search algorithms for natural language generation. The first algorithm, p-exact search, locally prun…

Machine TranslationText GenerationTranslation

Introducing Block-Toeplitz Covariance Matrices to Remaster Linear Discriminant Analysis for Event-related Potential Brain-computer Interfaces

2022-02-04 · Jan Sosulski, Michael Tangermann

Covariance matrices of noisy multichannel electroencephalogram time series data are hard to estimate due to high dimensionality. In brain-computer interfaces (BCI) based on event-related potentials and a linear discrimin…

Binary ClassificationClassificationTime SeriesTime Series Analysis