Practical Application of Domain Dependent Confidence Measurement for Spoken Language Understanding Systems
Spoken Language Understanding (SLU), which extracts semantic information from speech, is not flawless, specially in practical applications. The reliability of the output of an SLU system can be evaluated using a semantic confidence measure. Confidence measures are a solution to improve the quality of spoken dialogue systems, by rejecting low-confidence SLU results. In this study we discuss real-world applications of confidence scoring in a customer service scenario. We build confidence models for three major types of dialogue states that are considered as different domains: how may I help you, number capture, and confirmation. Practical challenges to train domain-dependent confidence models, including data limitations, are discussed, and it is shown that feature engineering plays an important role to improve performance. We explore a wide variety of predictor features based on speech recognition, intent classification, and high-level domain knowledge, and find the combined feature set with the best rejection performance for each application.
Code (0)
등록된 구현이 없습니다.
Tasks
Automatic Speech Recognition (ASR)Feature Engineeringintent-classificationIntent ClassificationMachine Translationspeech-recognitionSpeech RecognitionSpoken Dialogue SystemsSpoken Language UnderstandingSimilar Papers 제목 키워드 기반
Confidence Region of Singular Subspaces for Low-rank Matrix Regression
Low-rank matrix regression refers to the instances of recovering a low-rank matrix based on specially designed measurements and the corresponding noisy outcomes. In the last decade, numerous statistical methodologies hav…
regressionUnsupervised Domain Adaptation for Depth Prediction from Images
State-of-the-art approaches to infer dense depth measurements from images rely on CNNs trained end-to-end on a vast amount of data. However, these approaches suffer a drastic drop in accuracy when dealing with environmen…
Depth EstimationDepth PredictionDomain AdaptationPrediction+1Uncertainty-Aware Null Space Networks for Data-Consistent Image Reconstruction
Reconstructing an image from noisy and incomplete measurements is a central task in several image processing applications. In recent years, state-of-the-art reconstruction methods have been developed based on recent adva…
Image ReconstructionMRI ReconstructionUncertainty QuantificationHigh-Resolution Single-Shot Polarimetric Imaging Made Easy
Polarization-based vision has gained increasing attention for providing richer physical cues beyond RGB images. While achieving single-shot capture is highly desirable for practical applications, existing Division-of-Foc…
From Stochastic to Stable: Rank Stability and Structural Sufficiency in AI Visibility Measurement
AI visibility measurement is comparative: practitioners want to know which domains generative search engines cite most often and whether observed differences are large enough to support decisions. Yet the industry lacks …