paper-with-me

홈 › Papers

Dialogue-Contextualized Re-ranking for Medical History-Taking

2023-04-04 · Jian Zhu, Ilya Valmianski, Anitha Kannan

AI-driven medical history-taking is an important component in symptom checking, automated patient intake, triage, and other AI virtual care applications. As history-taking is extremely varied, machine learning models require a significant amount of data to train. To overcome this challenge, existing systems are developed using indirect data or expert knowledge. This leads to a training-inference gap as models are trained on different kinds of data than what they observe at inference time. In this work, we present a two-stage re-ranking approach that helps close the training-inference gap by re-ranking the first-stage question candidates using a dialogue-contextualized model. For this, we propose a new model, global re-ranker, which cross-encodes the dialogue with all questions simultaneously, and compare it with several existing neural baselines. We test both transformer and S4-based language model backbones. We find that relative to the expert system, the best performance is achieved by our proposed global re-ranker with a transformer backbone, resulting in a 30% higher normalized discount cumulative gain (nDCG) and a 77% higher mean average precision (mAP).

📄 PDF Abstract BibTeX arXiv:2304.01974

Code (0)

등록된 구현이 없습니다.

Tasks

Language ModelingLanguage ModellingRe-Ranking

Methods 이 논문이 사용한 방법론

Test 설명 없음

Similar Papers 제목 키워드 기반

MediTOD: An English Dialogue Dataset for Medical History Taking with Comprehensive Annotations

2024-10-18 · Vishal Vivek Saley, Goonjan Saha, Rocktim Jyoti Das, Dinesh Raghu 외

Medical task-oriented dialogue systems can assist doctors by collecting patient medical history, aiding in diagnosis, or guiding treatment selection, thereby reducing doctor burnout and expanding access to medical servic…

Natural Language UnderstandingTask-Oriented Dialogue SystemsText Generation

Note2Chat: Improving LLMs for Multi-Turn Clinical History Taking Using Medical Notes

2026-01-29 · Yang Zhou, Zhenting Sheng, Mingrui Tan, Yuting Song 외 arxiv

Effective clinical history taking is a foundational yet underexplored component of clinical reasoning. While large language models (LLMs) have shown promise on static benchmarks, they often fall short in dynamic, multi-t…

Data Augmentation

Filling the Gap of Utterance-aware and Speaker-aware Representation for Multi-turn Dialogue

2020-09-14 · Longxiang Liu, Zhuosheng Zhang, Hai Zhao, Xi Zhou 외

A multi-turn dialogue is composed of multiple utterances from two or more different speaker roles. Thus utterance- and speaker-aware clues are supposed to be well captured in models. However, in the existing retrieval-ba…

Retrieval

Getting Better Dialogue Context for Knowledge Identification by Leveraging Document-level Topic Shift

2022-09-01 · SIGDIAL (ACL) 2022 9 · Nhat Tran, Diane Litman

To build a goal-oriented dialogue system that can generate responses given a knowledge base, identifying the relevant pieces of information to be grounded in is vital. When the number of documents in the knowledge base i…

Retrieval

Ranking Enhanced Dialogue Generation

2020-08-13 · Changying Hao, Liang Pang, Yanyan Lan, Fei Sun 외

How to effectively utilize the dialogue history is a crucial problem in multi-turn dialogue generation. Previous works usually employ various neural network architectures (e.g., recurrent neural networks, attention mecha…

Dialogue GenerationResponse Generation