paper-with-me

홈 › Papers

A Relational Memory-based Embedding Model for Triple Classification and Search Personalization

2019-07-13 · ACL 2020 6 · Dai Quoc Nguyen, Tu Dinh Nguyen, Dinh Phung

Knowledge graph embedding methods often suffer from a limitation of memorizing valid triples to predict new ones for triple classification and search personalization problems. To this end, we introduce a novel embedding model, named R-MeN, that explores a relational memory network to encode potential dependencies in relationship triples. R-MeN considers each triple as a sequence of 3 input vectors that recurrently interact with a memory using a transformer self-attention mechanism. Thus R-MeN encodes new information from interactions between the memory and each input vector to return a corresponding vector. Consequently, R-MeN feeds these 3 returned vectors to a convolutional neural network-based decoder to produce a scalar score for the triple. Experimental results show that our proposed R-MeN obtains state-of-the-art results on SEARCH17 for the search personalization task, and on WN11 and FB13 for the triple classification task.

📄 PDF Abstract BibTeX arXiv:1907.06080

Code (1)

daiquocnguyen/R-MeN 공식 구현 tf

Tasks

DecoderGeneral ClassificationGraph EmbeddingKnowledge Graph EmbeddingTriple Classificationvalid

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Position-Wise Feed-Forward Layer 설명 없음
Residual Connection 설명 없음
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
ReLU How Do I Communicate to Expedia? How Do I Communicate to Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Live Support & Special Travel…

Similar Papers 제목 키워드 기반

Query-based Instance Discrimination Network for Relational Triple Extraction

2022-11-03 · Zeqi Tan, Yongliang Shen, Xuming Hu, Wenqi Zhang 외

Joint entity and relation extraction has been a core task in the field of information extraction. Recent approaches usually consider the extraction of relational triples from a stereoscopic perspective, either learning a…

Contrastive LearningJoint Entity and Relation ExtractionRelationRelation Extraction

Dynamic Entity Memory Network for Dialogue Relational Triplet Extraction

2021-11-16 · ACL ARR November 2021 11 · Anonymous

Relational triplet extraction (RTE) is a crucial task in information extraction and has aroused extensive attention. Although advanced studies on RTE have achieved great progress, they are still insufficient for supporti…

Information RetrievalRetrievalRTETriplet

Bridging Text and Knowledge with Multi-Prototype Embedding for Few-Shot Relational Triple Extraction

2020-10-30 · COLING 2020 8 · Haiyang Yu, Ningyu Zhang, Shumin Deng, Hongbin Ye 외

Current supervised relational triple extraction approaches require huge amounts of labeled data and thus suffer from poor performance in few-shot settings. However, people can grasp new knowledge by learning a few instan…

Jointly Extracting Explicit and Implicit Relational Triples with Reasoning Pattern Enhanced Binary Pointer Network

2021-06-01 · NAACL 2021 4 · Yubo Chen, Yunqi Zhang, Changran Hu, Yongfeng Huang

Relational triple extraction is a crucial task for knowledge graph construction. Existing methods mainly focused on explicit relational triples that are directly expressed, but usually suffer from ignoring implicit tripl…

graph constructionImplicit RelationsKnowledge GraphsRelation+3

Path-Enhanced Multi-Relational Question Answering with Knowledge Graph Embeddings

2021-10-29 · Guanglin Niu, Yang Li, Chengguang Tang, Zhongkai Hu 외

The multi-relational Knowledge Base Question Answering (KBQA) system performs multi-hop reasoning over the knowledge graph (KG) to achieve the answer. Recent approaches attempt to introduce the knowledge graph embedding …

Graph EmbeddingKnowledge Base Question AnsweringKnowledge Graph EmbeddingKnowledge Graph Embeddings+1