paper-with-me

홈 › Papers

When to Talk: Chatbot Controls the Timing of Talking during Multi-turn Open-domain Dialogue Generation

2019-12-20 · Tian Lan, Xian-Ling Mao, He-Yan Huang, Wei Wei

Despite the multi-turn open-domain dialogue systems have attracted more and more attention and made great progress, the existing dialogue systems are still very boring. Nearly all the existing dialogue models only provide a response when the user's utterance is accepted. But during daily conversations, humans always decide whether to continue to utter an utterance based on the context. Intuitively, a dialogue model that can control the timing of talking autonomously based on the conversation context can chat with humans more naturally. In this paper, we explore the dialogue system that automatically controls the timing of talking during the conversation. Specifically, we adopt the decision module for the existing dialogue models. Furthermore, modeling conversation context effectively is very important for controlling the timing of talking. So we also adopt the graph neural networks to process the context with the natural graph structure. Extensive experiments on two benchmarks show that controlling the timing of talking can effectively improve the quality of dialogue generation, and the proposed methods significantly improve the accuracy of the timing of talking. In addition, we have publicly released the codes of our proposed model.

📄 PDF Abstract BibTeX arXiv:1912.09879

Code (0)

등록된 구현이 없습니다.

Tasks

ChatbotDialogue Generation

Similar Papers 제목 키워드 기반

Talking to the crowd: What do people react to in online discussions?

2015-07-08 · EMNLP 2015 9 · Aaron Jaech, Victoria Zayats, Hao Fang, Mari Ostendorf 외

This paper addresses the question of how language use affects community reaction to comments in online discussion forums, and the relative importance of the message vs. the messenger. A new comment ranking task is propos…

MakeItTalk: Speaker-Aware Talking-Head Animation

2020-04-27 · Yang Zhou, Xintong Han, Eli Shechtman, Jose Echevarria 외

We present a method that generates expressive talking heads from a single facial image with audio as the only input. In contrast to previous approaches that attempt to learn direct mappings from audio to raw pixels or po…

Talking Face GenerationTalking Head Generation

Efficient Emotional Adaptation for Audio-Driven Talking-Head Generation

2023-09-10 · ICCV 2023 1 · Yuan Gan, Zongxin Yang, Xihang Yue, Lingyun Sun 외

Audio-driven talking-head synthesis is a popular research topic for virtual human-related applications. However, the inflexibility and inefficiency of existing methods, which necessitate expensive end-to-end training to …

Talking Head Generation

Expressive Talking Head Generation With Granular Audio-Visual Control

2022-01-01 · CVPR 2022 1 · Borong Liang, Yan Pan, Zhizhi Guo, Hang Zhou 외

Generating expressive talking heads is essential for creating virtual humans. However, existing one- or few-shot methods focus on lip-sync and head motion, ignoring the emotional expressions that make talking faces r…

Talking Head Generation

LetsTalk: Latent Diffusion Transformer for Talking Video Synthesis

2024-11-24 · Haojie Zhang, Zhihao Liang, Ruibo Fu, Zhengqi Wen 외

Portrait image animation using audio has rapidly advanced, enabling the creation of increasingly realistic and expressive animated faces. The challenges of this multimodality-guided video generation task involve fusing v…

DiversityImage AnimationVideo Generation