Graph Structured Prediction Energy Networks
For joint inference over multiple variables, a variety of structured prediction techniques have been developed to model correlations among variables and thereby improve predictions. However, many classical approaches suffer from one of two primary drawbacks: they either lack the ability to model high-order correlations among variables while maintaining computationally tractable inference, or they do not allow to explicitly model known correlations. To address this shortcoming, we introduce `Graph Structured Prediction Energy Networks,' for which we develop inference techniques that allow to both model explicit local and implicit higher-order correlations while maintaining tractability of inference. We apply the proposed method to tasks from the natural language processing and computer vision domain and demonstrate its general utility.
Code (1)
Tasks
PredictionStructured PredictionSimilar Papers 제목 키워드 기반
Structured Prediction in NLP -- A survey
Over the last several years, the field of Structured prediction in NLP has had seen huge advancements with sophisticated probabilistic graphical models, energy-based networks, and its combination with deep learning-based…
PredictionStructured PredictionSurveyText GenerationStructured Prediction Energy Networks
We introduce structured prediction energy networks (SPENs), a flexible framework for structured prediction. A deep architecture is used to define an energy function of candidate labels, and then predictions are produced …
General ClassificationMulti-Label ClassificationMUlTI-LABEL-ClASSIFICATIONPrediction+1End-to-End Learning for Structured Prediction Energy Networks
Structured Prediction Energy Networks (SPENs) are a simple, yet expressive family of structured prediction models (Belanger and McCallum, 2016). An energy function over candidate structured outputs is given by a deep net…
DenoisingImage DenoisingPredictionSemantic Role Labeling+1Relational and Sequential Conformal Inference for Energy Time Series over Graphs via Foundation Models
Accurate energy demand forecasting is essential for the reliable operation and planning of modern sustainable energy systems. Spatial-temporal graph neural networks (STGNNs) have recently achieved strong performance in p…
SPEECH: Structured Prediction with Energy-Based Event-Centric Hyperspheres
Event-centric structured prediction involves predicting structured outputs of events. In most NLP cases, event structures are complex with manifold dependency, and it is challenging to effectively represent these complic…
Event DetectionEvent Relation ExtractionPredictionStructured Prediction