A Case Study on Learning a Unified Encoder of Relations
Typical relation extraction models are trained on a single corpus annotated with a pre-defined relation schema. An individual corpus is often small, and the models may often be biased or overfitted to the corpus. We hypothesize that we can learn a better representation by combining multiple relation datasets. We attempt to use a shared encoder to learn the unified feature representation and to augment it with regularization by adversarial training. The additional corpora feeding the encoder can help to learn a better feature representation layer even though the relation schemas are different. We use ACE05 and ERE datasets as our case study for experiments. The multi-task model obtains significant improvement on both datasets.
Code (0)
등록된 구현이 없습니다.
Tasks
Knowledge Base PopulationRelationRelation ExtractionSimilar Papers 제목 키워드 기반
A correlation-permutation approach for speech-music encoders model merging
Creating a unified speech and music model requires expensive pre-training. Model merging can instead create an unified audio model with minimal computational expense. However, direct merging is challenging when the model…
Re-basinOn the Relation Between Autoencoders and Non-negative Matrix Factorization, and Their Application for Mutational Signature Extraction
The aim of this study is to provide a foundation to understand the relationship between non-negative matrix factorization (NMF) and non-negative autoencoders enabling proper interpretation and understanding of autoencode…
Relation Learning on Social Networks with Multi-Modal Graph Edge Variational Autoencoders
While node semantics have been extensively explored in social networks, little research attention has been paid to profile edge semantics, i.e., social relations. Ideal edge semantics should not only show that two users …
RelationAUTOSHAPE: An Autoencoder-Shapelet Approach for Time Series Clustering
Time series shapelets are discriminative subsequences that have been recently found effective for time series clustering (TSC). The shapelets are convenient for interpreting the clusters. Thus, the main challenge for TSC…
ClusteringRepresentation LearningTime SeriesTime Series Analysis+1Learning causal representations for robust domain adaptation
Domain adaptation solves the learning problem in a target domain by leveraging the knowledge in a relevant source domain. While remarkable advances have been made, almost all existing domain adaptation methods heavily re…
Domain Adaptation