Unsupervised Relation Extraction: A Variational Autoencoder Approach
Unsupervised relation extraction works by clustering entity pairs that have the same relations in the text. Some existing variational autoencoder (VAE)-based approaches train the relation extraction model as an encoder that generates relation classifications. A decoder is trained along with the encoder to reconstruct the encoder input based on the encoder-generated relation classifications. These classifications are a latent variable so they are required to follow a pre-defined prior distribution which results in unstable training. We propose a VAE-based unsupervised relation extraction technique that overcomes this limitation by using the classifications as an intermediate variable instead of a latent variable. Specifically, classifications are conditioned on sentence input, while the latent variable is conditioned on both the classifications and the sentence input. This allows our model to connect the decoder with the encoder without putting restrictions on the classification distribution; which improves training stability. Our approach is evaluated on the NYT dataset and outperforms state-of-the-art methods.
Code (0)
등록된 구현이 없습니다.
Tasks
DecoderRelationRelation ExtractionSentenceSimilar Papers 제목 키워드 기반
Relational Autoencoder for Feature Extraction
Feature extraction becomes increasingly important as data grows high dimensional. Autoencoder as a neural network based feature extraction method achieves great success in generating abstract features of high dimensional…
DenoisingGeneral ClassificationSkeleton Based Action RecognitionAutomatic Feature Extraction for Heartbeat Anomaly Detection
We focus on automatic feature extraction for raw audio heartbeat sounds, aimed at anomaly detection applications in healthcare. We learn features with the help of an autoencoder composed by a 1D non-causal convolutional …
Anomaly DetectionDecoderVariational InferenceR-VGAE: Relational-variational Graph Autoencoder for Unsupervised Prerequisite Chain Learning
The task of concept prerequisite chain learning is to automatically determine the existence of prerequisite relationships among concept pairs. In this paper, we frame learning prerequisite relationships among concepts as…
Relation PredictionA Novel Unsupervised Graph Wavelet Autoencoder for Mechanical System Fault Detection
Reliable fault detection is an essential requirement for safe and efficient operation of complex mechanical systems in various industrial applications. Despite the abundance of existing approaches and the maturity of the…
Fault DetectionGraph Neural NetworkCausal Discovery Inspired Unsupervised Domain Adaptation for Emotion-Cause Pair Extraction
This paper tackles the task of emotion-cause pair extraction in the unsupervised domain adaptation setting. The problem is challenging as the distributions of the events causing emotions in target domains are dramaticall…
Causal DiscoveryDomain AdaptationEmotion-Cause Pair ExtractionTransfer Learning+1