Fine-grained Conversational Decoding via Isotropic and Proximal Search
General-purpose text decoding approaches are usually adopted for dialogue response generation. Although the quality of the generated responses can be improved with dialogue-specific encoding methods, conversational decoding methods are still under-explored. Inspired by \citet{wu2023learning} that a good dialogue feature space should follow the rules of locality and isotropy, we present a fine-grained conversational decoding method, termed \textit{isotropic and proximal search (IPS)}. Our method is designed to generate the semantic-concentrated response, while still maintaining informativeness and discrimination against the context. Experiments show that our approach outperforms existing decoding strategies in the dialogue field across both automatic and human evaluation metrics. More in-depth analyses further confirm the effectiveness of our approach.
Code (1)
Tasks
InformativenessResponse GenerationSimilar Papers 제목 키워드 기반
Multi-trait User Simulation with Adaptive Decoding for Conversational Task Assistants
Conversational systems must be robust to user interactions that naturally exhibit diverse conversational traits. Capturing and simulating these diverse traits coherently and efficiently presents a complex challenge. This…
DiversityUser SimulationPlug-and-Play Conversational Models
There has been considerable progress made towards conversational models that generate coherent and fluent responses; however, this often involves training large language models on large dialogue datasets, such as Reddit.…
AttributeLanguage ModelingLanguage ModellingLarge Language Model+1Plug-and-Play Conversational Models
There has been considerable progress made towards conversational models that generate coherent and fluent responses; however, this often involves training large language models on large dialogue datasets, such as Reddit.…
AttributeLanguage ModelingLanguage ModellingLarge Language Model+1FCTalker: Fine and Coarse Grained Context Modeling for Expressive Conversational Speech Synthesis
Conversational Text-to-Speech (TTS) aims to synthesis an utterance with the right linguistic and affective prosody in a conversational context. The correlation between the current utterance and the dialogue history at th…
Speech Synthesistext-to-speechText to SpeechWeighted Anisotropic-Isotropic Total Variation for Poisson Denoising
Poisson noise commonly occurs in images captured by photon-limited imaging systems such as in astronomy and medicine. As the distribution of Poisson noise depends on the pixel intensity value, noise levels vary from pixe…
AstronomyComputational EfficiencyDenoising