A Theoretical Analysis of Logistic Regression and Bayesian Classifiers
This study aims to show the fundamental difference between logistic regression and Bayesian classifiers in the case of exponential and unexponential families of distributions, yielding the following findings. First, the logistic regression is a less general representation of a Bayesian classifier. Second, one should suppose distributions of classes for the correct specification of logistic regression equations. Third, in specific cases, there is no difference between predicted probabilities from correctly specified generative Bayesian classifier and discriminative logistic regression.
Code (0)
등록된 구현이 없습니다.
Tasks
regressionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Breast Cancer Diagnosis via Classification Algorithms
In this paper, we analyze the Wisconsin Diagnostic Breast Cancer Data using Machine Learning classification techniques, such as the SVM, Bayesian Logistic Regression (Variational Approximation), and K-Nearest-Neighbors. …
BIG-bench Machine LearningClassificationDiagnosticGeneral Classification+1Machine Learning, Linear and Bayesian Models for Logistic Regression in Failure Detection Problems
In this work, we study the use of logistic regression in manufacturing failures detection. As a data set for the analysis, we used the data from Kaggle competition Bosch Production Line Performance. We considered the use…
BIG-bench Machine LearningGeneral ClassificationregressionOn Uniform Boundedness Properties of SGD and its Momentum Variants
A theoretical, and potentially also practical, problem with stochastic gradient descent is that trajectories may escape to infinity. In this note, we investigate uniform boundedness properties of iterates and function va…
regressionRetrievalLow Complexity Approximate Bayesian Logistic Regression for Sparse Online Learning
Theoretical results show that Bayesian methods can achieve lower bounds on regret for online logistic regression. In practice, however, such techniques may not be feasible especially for very large feature sets. Various …
regressionVariational InferenceSpike and slab variational Bayes for high dimensional logistic regression
Variational Bayes (VB) is a popular scalable alternative to Markov chain Monte Carlo for Bayesian inference. We study a mean-field spike and slab VB approximation of widely used Bayesian model selection priors in sparse …
Bayesian InferenceModel SelectionregressionVocal Bursts Intensity Prediction