Re-framing Incremental Deep Language Models for Dialogue Processing with Multi-task Learning
We present a multi-task learning framework to enable the training of one universal incremental dialogue processing model with four tasks of disfluency detection, language modelling, part-of-speech tagging, and utterance segmentation in a simple deep recurrent setting. We show that these tasks provide positive inductive biases to each other with the optimal contribution of each one relying on the severity of the noise from the task. Our live multi-task model outperforms similar individual tasks, delivers competitive performance, and is beneficial for future use in conversational agents in psychiatric treatment.
Code (1)
Tasks
Language ModellingMulti-Task LearningPart-Of-Speech TaggingSimilar Papers 제목 키워드 기반
Incremental Disfluency Detection for Spoken Learner English
Incremental disfluency detection provides a framework for computing communicative meaning from hesitations, repetitions and false starts commonly found in speech. One application of this area of research is in dialogue-b…
Incremental Dialogue Management: Survey, Discussion, and Implications for HRI
Efforts towards endowing robots with the ability to speak have benefited from recent advancements in NLP, in particular large language models. However, as powerful as current models have become, they still operate on sen…
Dialogue ManagementManagementSentencespeech-recognition+3Multi-Task Learning for Domain-General Spoken Disfluency Detection in Dialogue Systems
Spontaneous spoken dialogue is often disfluent, containing pauses, hesitations, self-corrections and false starts. Processing such phenomena is essential in understanding a speaker's intended meaning and controlling the …
Multi-Task LearningActive Defense Against Social Engineering: The Case for Human Language Technology
We describe a system that supports natural language processing (NLP) components for active defenses against social engineering attacks. We deploy a pipeline of human language technology, including Ask and Framing Detecti…
AttributeDialogue Generationnamed-entity-recognitionNamed Entity Recognition+1Incremental Unit Networks for Multimodal, Fine-grained Information State Representation
We offer a fine-grained information state annotation scheme that follows directly from the Incremental Unit abstract model of dialogue processing when used within a multimodal, co-located, interactive setting. We explain…