paper-with-me

홈 › Papers

KNSE: A Knowledge-aware Natural Language Inference Framework for Dialogue Symptom Status Recognition

2023-05-26 · Wei Chen, Shiqi Wei, Zhongyu Wei, Xuanjing Huang

Symptom diagnosis in medical conversations aims to correctly extract both symptom entities and their status from the doctor-patient dialogue. In this paper, we propose a novel framework called KNSE for symptom status recognition (SSR), where the SSR is formulated as a natural language inference (NLI) task. For each mentioned symptom in a dialogue window, we first generate knowledge about the symptom and hypothesis about status of the symptom, to form a (premise, knowledge, hypothesis) triplet. The BERT model is then used to encode the triplet, which is further processed by modules including utterance aggregation, self-attention, cross-attention, and GRU to predict the symptom status. Benefiting from the NLI formalization, the proposed framework can encode more informative prior knowledge to better localize and track symptom status, which can effectively improve the performance of symptom status recognition. Preliminary experiments on Chinese medical dialogue datasets show that KNSE outperforms previous competitive baselines and has advantages in cross-disease and cross-symptom scenarios.

📄 PDF Abstract BibTeX arXiv:2305.16833

Code (0)

등록된 구현이 없습니다.

Tasks

Natural Language InferenceTriplet

Methods 이 논문이 사용한 방법론

Refunds@Expedia|||How do I get a full refund from Expedia? “How do I get a full refund from Expedia? How do I get a full refund from Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Quick Help &…
Multi-Head Attention 설명 없음
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Linear Warmup With Linear Decay Linear Warmup With Linear Decay is a learning rate schedule in which we increase the learning rate linearly for $n$ updates and then linearly decay afterwards.
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
WordPiece 설명 없음
Attention Dropout Attention Dropout is a type of dropout used in attention-based architectures, where elements are randomly dropped out of the…

Similar Papers 제목 키워드 기반

DKPLM: Decomposable Knowledge-enhanced Pre-trained Language Model for Natural Language Understanding

2021-12-02 · Taolin Zhang, Chengyu Wang, Nan Hu, Minghui Qiu 외

Knowledge-Enhanced Pre-trained Language Models (KEPLMs) are pre-trained models with relation triples injecting from knowledge graphs to improve language understanding abilities. To guarantee effective knowledge injection…

Knowledge GraphsKnowledge ProbingLanguage ModelingLanguage Modelling+2

Natural Language Inference with External Knowledge

2018-01-01 · ICLR 2018 1 · Qian Chen, Xiaodan Zhu, Zhen-Hua Ling, Diana Inkpen

Modeling informal inference in natural language is very challenging. With the recent availability of large annotated data, it has become feasible to train complex models such as neural networks to perform natural languag…

Natural Language Inference

Semantics-Aware Inferential Network for Natural Language Understanding

2020-04-28 · Shuailiang Zhang, Hai Zhao, Junru Zhou

For natural language understanding tasks, either machine reading comprehension or natural language inference, both semantics-aware and inference are favorable features of the concerned modeling for better understanding p…

Machine Reading ComprehensionNatural Language InferenceNatural Language UnderstandingReading Comprehension

Improving Medical NLI Using Context-Aware Domain Knowledge

2020-12-01 · Joint Conference on Lexical and Computational Semantics 2020 · Shaika Chowdhury, Philip Yu, Yuan Luo

Domain knowledge is important to understand both the lexical and relational associations of words in natural language text, especially for domain-specific tasks like Natural Language Inference (NLI) in the medical domain…

Natural Language Inference

Neural Natural Language Inference Models Enhanced with External Knowledge

2017-11-12 · ACL 2018 7 · Qian Chen, Xiaodan Zhu, Zhen-Hua Ling, Diana Inkpen 외

Modeling natural language inference is a very challenging task. With the availability of large annotated data, it has recently become feasible to train complex models such as neural-network-based inference models, which …

Natural Language Inference