paper-with-me

홈 › Papers

LNN-EL: A Neuro-Symbolic Approach to Short-text Entity Linking

2021-06-17 · ACL 2021 5 · Hang Jiang, Sairam Gurajada, Qiuhao Lu, Sumit Neelam, Lucian Popa, Prithviraj Sen, Yunyao Li, Alexander Gray

Entity linking (EL), the task of disambiguating mentions in text by linking them to entities in a knowledge graph, is crucial for text understanding, question answering or conversational systems. Entity linking on short text (e.g., single sentence or question) poses particular challenges due to limited context. While prior approaches use either heuristics or black-box neural methods, here we propose LNN-EL, a neuro-symbolic approach that combines the advantages of using interpretable rules based on first-order logic with the performance of neural learning. Even though constrained to using rules, LNN-EL performs competitively against SotA black-box neural approaches, with the added benefits of extensibility and transferability. In particular, we show that we can easily blend existing rule templates given by a human expert, with multiple types of features (priors, BERT encodings, box embeddings, etc), and even scores resulting from previous EL methods, thus improving on such methods. For instance, on the LC-QuAD-1.0 dataset, we show more than $4$\% increase in F1 score over previous SotA. Finally, we show that the inductive bias offered by using logic results in learned rules that transfer well across datasets, even without fine tuning, while maintaining high accuracy.

📄 PDF Abstract BibTeX arXiv:2106.09795

Code (1)

IBM/LNN 공식 구현

Tasks

Entity LinkingInductive BiasQuestion AnsweringSentence

Methods 이 논문이 사용한 방법론

Refunds@Expedia|||How do I get a full refund from Expedia? “How do I get a full refund from Expedia? How do I get a full refund from Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Quick Help &…
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Adam 설명 없음
Weight Decay 설명 없음
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
WordPiece 설명 없음
Multi-Head Attention 설명 없음

Similar Papers 제목 키워드 기반

PSYCHIC: A Neuro-Symbolic Framework for Knowledge Graph Question-Answering Grounding

2023-10-19 · Hanna Abi Akl

The Scholarly Question Answering over Linked Data (Scholarly QALD) at The International Semantic Web Conference (ISWC) 2023 challenge presents two sub-tasks to tackle question answering (QA) over knowledge graphs (KGs). …

Entity LinkingGraph Question AnsweringKnowledge GraphsQuestion Answering

Aggregated Semantic Matching for Short Text Entity Linking

2018-10-01 · CONLL 2018 10 · Feng Nie, Shuyan Zhou, Jing Liu, Jinpeng Wang 외

The task of entity linking aims to identify concepts mentioned in a text fragments and link them to a reference knowledge base. Entity linking in long text has been well studied in previous work. However, short text enti…

Card GamesEntity LinkingInformation RetrievalNamed Entity Recognition (NER)

Zero-shot Entity Linking with Less Data

2022-07-01 · Findings (NAACL) 2022 7 · G P Shrivatsa Bhargav, Dinesh Khandelwal, Saswati Dana, Dinesh Garg 외

Entity Linking (EL) maps an entity mention in a natural language sentence to an entity in a knowledge base (KB). The Zero-shot Entity Linking (ZEL) extends the scope of EL to unseen entities at the test time without requ…

Entity LinkingMulti-Task LearningSentenceType prediction

Old is Gold: Linguistic Driven Approach for Entity and Relation Linking of Short Text

2019-06-01 · NAACL 2019 6 · Ahmad Sakor, on, Isaiah o Mulang{'}, Kuldeep Singh 외

Short texts challenge NLP tasks such as named entity recognition, disambiguation, linking and relation inference because they do not provide sufficient context or are partially malformed (e.g. wrt. capitalization, long t…

Entity LinkingImplicit Relationsnamed-entity-recognitionNamed Entity Recognition+3

DELICATE: Diachronic Entity LInking using Classes And Temporal Evidence

2025-11-13 · Cristian Santini, Sebastian Barzaghi, Paolo Sernani, Emanuele Frontoni 외 arxiv

In spite of the remarkable advancements in the field of Natural Language Processing, the task of Entity Linking (EL) remains challenging in the field of humanities due to complex document typologies, lack of domain-speci…

Entity Linking