A Fused Elastic Net Logistic Regression Model for Multi-Task Binary Classification
Multi-task learning has shown to significantly enhance the performance of multiple related learning tasks in a variety of situations. We present the fused logistic regression, a sparse multi-task learning approach for binary classification. Specifically, we introduce sparsity inducing penalties over parameter differences of related logistic regression models to encode similarity across related tasks. The resulting joint learning task is cast into a form that lends itself to be efficiently optimized with a recursive variant of the alternating direction method of multipliers. We show results on synthetic data and describe the regime of settings where our multi-task approach achieves significant improvements over the single task learning approach and discuss the implications on applying the fused logistic regression in different real world settings.
Code (0)
등록된 구현이 없습니다.
Tasks
Binary ClassificationGeneral ClassificationMulti-Task LearningregressionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Differentially-Private Logistic Regression for Detecting Multiple-SNP Association in GWAS Databases
Following the publication of an attack on genome-wide association studies (GWAS) data proposed by Homer et al., considerable attention has been given to developing methods for releasing GWAS data in a privacy-preserving …
Privacy PreservingregressionCyanure: An Open-Source Toolbox for Empirical Risk Minimization for Python, C++, and soon more
Cyanure is an open-source C++ software package with a Python interface. The goal of Cyanure is to provide state-of-the-art solvers for learning linear models, based on stochastic variance-reduced stochastic optimization …
Stochastic OptimizationPLUTO: Penalized Unbiased Logistic Regression Trees
We propose a new algorithm called PLUTO for building logistic regression trees to binary response data. PLUTO can capture the nonlinear and interaction patterns in messy data by recursively partitioning the sample space.…
regressionSelection biasVariable SelectionCorrelated Logistic Model With Elastic Net Regularization for Multilabel Image Classification
In this paper, we present correlated logistic (CorrLog) model for multilabel image classification. CorrLog extends conventional logistic regression model into multilabel cases, via explicitly modeling the pairwise correl…
Classificationfeature selectionGeneral Classificationimage-classification+1Exact Instance Compression for Convex Empirical Risk Minimization via Color Refinement
Empirical risk minimization (ERM) can be computationally expensive, with standard solvers scaling poorly even in the convex setting. We propose a novel lossless compression framework for convex ERM based on color refinem…