Predict and Constrain: Modeling Cardinality in Deep Structured Prediction
Many machine learning problems require the prediction of multi-dimensional labels. Such structured prediction models can benefit from modeling dependencies between labels. Recently, several deep learning approaches to structured prediction have been proposed. Here we focus on capturing cardinality constraints in such models. Namely, constraining the number of non-zero labels that the model outputs. Such constraints have proven very useful in previous structured prediction approaches, but it is a challenge to introduce them into a deep learning framework. Here we show how to do this via a novel deep architecture. Our approach outperforms strong baselines, achieving state-of-the-art results on multi-label classification benchmarks.
Code (0)
등록된 구현이 없습니다.
Tasks
BIG-bench Machine LearningDeep LearningGeneral ClassificationMulti-Label ClassificationMUlTI-LABEL-ClASSIFICATIONPredictionStructured PredictionSimilar Papers 제목 키워드 기반
Structured Prediction for Joint Class Cardinality and Entity Property Inference in Model-Complete Text Comprehension
Model-complete text comprehension aims at interpreting a natural language text with respect to a semantic domain model describing the classes and their properties relevant for the domain in question. Solving this task ca…
ArticlesPredictionReading ComprehensionStructured PredictionTowards Sharper Generalization Bounds for Structured Prediction
In this paper, we investigate the generalization performance of structured prediction learning and obtain state-of-the-art generalization bounds. Our analysis is based on factor graph decomposition of structured predicti…
Generalization BoundsPredictionStructured PredictionGraphical Model Sketch
Structured high-cardinality data arises in many domains, and poses a major challenge for both modeling and inference. Graphical models are a popular approach to modeling structured data but they are unsuitable for high-c…
modelEmbedding Cardinality Constraints in Neural Link Predictors
Neural link predictors learn distributed representations of entities and relations in a knowledge graph. They are remarkably powerful in the link prediction and knowledge base completion tasks, mainly due to the learned …
Knowledge Base CompletionLink PredictionCardinality-Aware Set Prediction and Top-$k$ Classification
We present a detailed study of cardinality-aware top-$k$ classification, a novel approach that aims to learn an accurate top-$k$ set predictor while maintaining a low cardinality. We introduce a new target loss function …
ClassificationPrediction