paper-with-me

홈 › Papers

Thinking Clearly, Talking Fast: Concept-Guided Non-Autoregressive Generation for Open-Domain Dialogue Systems

2021-09-09 · EMNLP 2021 11 · Yicheng Zou, Zhihua Liu, Xingwu Hu, Qi Zhang

Human dialogue contains evolving concepts, and speakers naturally associate multiple concepts to compose a response. However, current dialogue models with the seq2seq framework lack the ability to effectively manage concept transitions and can hardly introduce multiple concepts to responses in a sequential decoding manner. To facilitate a controllable and coherent dialogue, in this work, we devise a concept-guided non-autoregressive model (CG-nAR) for open-domain dialogue generation. The proposed model comprises a multi-concept planning module that learns to identify multiple associated concepts from a concept graph and a customized Insertion Transformer that performs concept-guided non-autoregressive generation to complete a response. The experimental results on two public datasets show that CG-nAR can produce diverse and coherent responses, outperforming state-of-the-art baselines in both automatic and human evaluations with substantially faster inference speed.

📄 PDF Abstract BibTeX arXiv:2109.04084

Code (1)

rowitzou/cg-nar 공식 구현 pytorch

Tasks

Dialogue Generation

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Position-Wise Feed-Forward Layer 설명 없음
Tanh Activation 설명 없음
Sigmoid Activation 설명 없음
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…

Similar Papers 제목 키워드 기반

STITCH: Simultaneous Thinking and Talking with Chunked Reasoning for Spoken Language Models

2025-07-21 · Cheng-Han Chiang, Xiaofei Wang, Linjie Li, Chung-Ching Lin 외 arxiv

Spoken Language Models (SLMs) are designed to take speech inputs and produce spoken responses. However, current SLMs lack the ability to perform an internal, unspoken thinking process before responding. In contrast, huma…

FONT: Flow-guided One-shot Talking Head Generation with Natural Head Motions

2023-03-31 · Jin Liu, Xi Wang, Xiaomeng Fu, Yesheng Chai 외

One-shot talking head generation has received growing attention in recent years, with various creative and practical applications. An ideal natural and vivid generated talking head video should contain natural head pose …

DiversityPose PredictionTalking Head GenerationUnsupervised Keypoints

SegTalker: Segmentation-based Talking Face Generation with Mask-guided Local Editing

2024-09-05 · Lingyu Xiong, Xize Cheng, Jintao Tan, Xianjia Wu 외

Audio-driven talking face generation aims to synthesize video with lip movements synchronized to input audio. However, current generative techniques face challenges in preserving intricate regional textures (skin, teeth)…

Face GenerationFacial EditingSegmentationTalking Face Generation

TalkCLIP: Talking Head Generation with Text-Guided Expressive Speaking Styles

2023-04-01 · Yifeng Ma, Suzhen Wang, Yu Ding, Bowen Ma 외

Audio-driven talking head generation has drawn growing attention. To produce talking head videos with desired facial expressions, previous methods rely on extra reference videos to provide expression information, which m…

2D Semantic Segmentation task 3 (25 classes)Talking Head Generation

MEMO: Memory-Guided Diffusion for Expressive Talking Video Generation

2024-12-05 · Longtao Zheng, Yifan Zhang, Hanzhong Guo, Jiachun Pan 외

Recent advances in video diffusion models have unlocked new potential for realistic audio-driven talking video generation. However, achieving seamless audio-lip synchronization, maintaining long-term identity consistency…

Portrait AnimationVideo Generation