paper-with-me

홈 › Papers

A Conditional Multinomial Mixture Model for Superset Label Learning

2012-12-03 · 12 2012 12 · LiPing Liu, Thomas Dietterich

In the superset label learning problem (SLL), each training instance provides a set of candidate labels of which one is the true label of the instance. As in ordinary regression, the candidate label set is a noisy version of the true label. In this work, we solve the problem by maximizing the likelihood of the candidate label sets of training instances. We propose a probabilistic model, the Logistic StickBreaking Conditional Multinomial Model (LSB-CMM), to do the job. The LSBCMM is derived from the logistic stick-breaking process. It first maps data points to mixture components and then assigns to each mixture component a label drawn from a component-specific multinomial distribution. The mixture components can capture underlying structure in the data, which is very useful when the model is weakly supervised. This advantage comes at little cost, since the model introduces few additional parameters. Experimental tests on several real-world problems with superset labels show results that are competitive or superior to the state of the art. The discovered underlying structures also provide improved explanations of the classification predictions.

📄 PDF Abstract BibTeX

Code (1)

xryanyjy/LSB_CMM_Matlab

Similar Papers 제목 키워드 기반

A Gamma-Poisson Mixture Topic Model for Short Text

2020-04-23 · Jocelyn Mazarura, Alta de Waal, Pieter de Villiers

Most topic models are constructed under the assumption that documents follow a multinomial distribution. The Poisson distribution is an alternative distribution to describe the probability of count data. For topic modell…

text-classificationText ClassificationTopic Models

GEOMETRIC AUGMENTATION FOR ROBUST NEURAL NETWORK CLASSIFIERS

2019-05-01 · ICLR 2019 5 · Robert M. Taylor, Yusong Tan

We introduce a novel geometric perspective and unsupervised model augmentation framework for transforming traditional deep (convolutional) neural networks into adversarially robust classifiers. Class-conditional probabil…

General ClassificationTime SeriesTime Series Analysis

Fast Inference for Interactive Models of Text

2016-12-01 · COLING 2016 12 · Jeffrey Lund, Paul Felt, Kevin Seppi, Eric Ringger

Probabilistic models are a useful means for analyzing large text corpora. Integrating such models with human interaction enables many new use cases. However, adding human interaction to probabilistic models requires infe…

ClusteringTopic Models

Fast Model Selection and Stable Optimization for Softmax-Gated Multinomial-Logistic Mixture of Experts Models

2026-02-08 · TrungKhang Tran, TrungTin Nguyen, Md Abul Bashar, Nhat Ho 외 arxiv

Mixture-of-Experts (MoE) architectures combine specialized predictors through a learned gate and are effective across regression and classification, but for classification with softmax multinomial-logistic gating, rigoro…

Density Estimation

Asymptotic Behavior of Bayesian Generalization Error in Multinomial Mixtures

2022-03-14 · Takumi Watanabe, Sumio Watanabe

Multinomial mixtures are widely used in the information engineering field, however, their mathematical properties are not yet clarified because they are singular learning models. In fact, the models are non-identifiable …