Variational Sequential Labelers for Semi-Supervised Learning
We introduce a family of multitask variational methods for semi-supervised sequence labeling. Our model family consists of a latent-variable generative model and a discriminative labeler. The generative models use latent variables to define the conditional probability of a word given its context, drawing inspiration from word prediction objectives commonly used in learning word embeddings. The labeler helps inject discriminative information into the latent space. We explore several latent variable configurations, including ones with hierarchical structure, which enables the model to account for both label-specific and word-specific information. Our models consistently outperform standard sequential baselines on 8 sequence labeling datasets, and improve further with unlabeled data.
Code (1)
Tasks
Learning Word EmbeddingsWord EmbeddingsSimilar Papers 제목 키워드 기반
DSAL: Deeply Supervised Active Learning from Strong and Weak Labelers for Biomedical Image Segmentation
Image segmentation is one of the most essential biomedical image processing problems for different imaging modalities, including microscopy and X-ray in the Internet-of-Medical-Things (IoMT) domain. However, annotating b…
Active LearningEnsemble LearningImage SegmentationSemantic SegmentationEvent Representation with Sequential, Semi-Supervised Discrete Variables
Within the context of event modeling and understanding, we propose a new method for neural sequence modeling that takes partially-observed sequences of discrete, external knowledge into account. We construct a sequential…
Variational Latent-State GPT for Semi-Supervised Task-Oriented Dialog Systems
Recently, two approaches, fine-tuning large pre-trained language models and variational training, have attracted significant interests, separately, for semi-supervised end-to-end task-oriented dialog (TOD) systems. In th…
Semi-supervised Parsing with a Variational Autoencoding Parser
We propose an end-to-end variational autoencoding parsing (VAP) model for semi-supervised graph-based projective dependency parsing. It encodes the input using continuous latent variables in a sequential manner by deep n…
Dependency ParsingA Probabilistic Semi-Supervised Approach with Triplet Markov Chains
Triplet Markov chains are general generative models for sequential data which take into account three kinds of random variables: (noisy) observations, their associated discrete labels and latent variables which aim at st…
Bayesian InferenceTriplet