LingYi: Medical Conversational Question Answering System based on Multi-modal Knowledge Graphs
The medical conversational system can relieve the burden of doctors and improve the efficiency of healthcare, especially during the pandemic. This paper presents a medical conversational question answering (CQA) system based on the multi-modal knowledge graph, namely "LingYi", which is designed as a pipeline framework to maintain high flexibility. Our system utilizes automated medical procedures including medical triage, consultation, image-text drug recommendation and record. To conduct knowledge-grounded dialogues with patients, we first construct a Chinese Medical Multi-Modal Knowledge Graph (CM3KG) and collect a large-scale Chinese Medical CQA (CMCQA) dataset. Compared with the other existing medical question-answering systems, our system adopts several state-of-the-art technologies including medical entity disambiguation and medical dialogue generation, which is more friendly to provide medical services to patients. In addition, we have open-sourced our codes which contain back-end models and front-end web pages at https://github.com/WENGSYX/LingYi. The datasets including CM3KG at https://github.com/WENGSYX/CM3KG and CMCQA at https://github.com/WENGSYX/CMCQA are also released to further promote future research.
Code (1)
Tasks
Conversational Question AnsweringDialogue GenerationEntity DisambiguationKnowledge GraphsMedical Question AnsweringMulti-modal Knowledge GraphQuestion AnsweringSimilar Papers 제목 키워드 기반
IMB: An Italian Medical Benchmark for Question Answering
Online medical forums have long served as vital platforms where patients seek professional healthcare advice, generating vast amounts of valuable knowledge. However, the informal nature and linguistic complexity of forum…
Information RetrievalQuestion AnsweringTowards Data Distillation for End-to-end Spoken Conversational Question Answering
In spoken question answering, QA systems are designed to answer questions from contiguous text spans within the related speech transcripts. However, the most natural way that human seek or test their knowledge is via hum…
Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Conversational Question AnsweringQuestion Answering+2Do not let the history haunt you: Mitigating Compounding Errors in Conversational Question Answering
The Conversational Question Answering (CoQA) task involves answering a sequence of inter-related conversational questions about a contextual paragraph. Although existing approaches employ human-written ground-truth answe…
Conversational Question AnsweringQuestion AnsweringDo not let the history haunt you -- Mitigating Compounding Errors in Conversational Question Answering
The Conversational Question Answering (CoQA) task involves answering a sequence of inter-related conversational questions about a contextual paragraph. Although existing approaches employ human-written ground-truth answe…
Conversational Question AnsweringQuestion AnsweringFauno: The Italian Large Language Model that will leave you senza parole!
This paper presents Fauno, the first and largest open-source Italian conversational Large Language Model (LLM). Our goal with Fauno is to democratize the study of LLMs in Italian, demonstrating that obtaining a fine-tune…
GPULanguage ModelingLanguage ModellingLarge Language Model+1