Underspecification in Natural Language Understanding for Dialog Automation
With the increasing number of communication platforms that offer variety of ways of connecting two interlocutors, there is a resurgence of chat-based dialog systems. These systems, typically known as \textit{chatbots} have been successfully applied in a range of consumer and enterprise applications. A key technology in such chat-bots is robust natural language understanding (NLU) which can significantly influence and impact the efficacy of the conversation and ultimately the user-experience. While NLU is far from perfect, this paper illustrates the role of \textit{underspecification} and its impact on successful dialog completion.
Code (0)
등록된 구현이 없습니다.
Tasks
Natural Language UnderstandingSpeech RecognitionSimilar Papers 제목 키워드 기반
Bootstrapping Multilingual Intent Models via Machine Translation for Dialog Automation
With the resurgence of chat-based dialog systems in consumer and enterprise applications, there has been much success in developing data-driven and rule-based natural language models to understand human intent. Since the…
Machine TranslationTranslationWhat Prompts Don't Say: Understanding and Managing Underspecification in LLM Prompts
Building LLM-powered software requires developers to communicate their requirements through natural language, but developer prompts are frequently underspecified, failing to fully capture many user-important requirements…
Instruction FollowingDealing with Semantic Underspecification in Multimodal NLP
Intelligent systems that aim at mastering language as humans do must deal with its semantic underspecification, namely, the possibility for a linguistic signal to convey only part of the information needed for communicat…
A neural anisotropic view of underspecification in deep learning
The underspecification of most machine learning pipelines means that we cannot rely solely on validation performance to assess the robustness of deep learning systems to naturally occurring distribution shifts. Instead, …
Deep LearningFairnessInductive BiasUnderspecification in Language Modeling Tasks: A Causality-Informed Study of Gendered Pronoun Resolution
Modern language modeling tasks are often underspecified: for a given token prediction, many words may satisfy the user's intent of producing natural language at inference time, however only one word will minimize the tas…
Language ModelingLanguage ModellingSelection bias