Syntactic and Semantic Features For Code-Switching Factored Language Models
This paper presents our latest investigations on different features for factored language models for Code-Switching speech and their effect on automatic speech recognition (ASR) performance. We focus on syntactic and semantic features which can be extracted from Code-Switching text data and integrate them into factored language models. Different possible factors, such as words, part-of-speech tags, Brown word clusters, open class words and clusters of open class word embeddings are explored. The experimental results reveal that Brown word clusters, part-of-speech tags and open-class words are the most effective at reducing the perplexity of factored language models on the Mandarin-English Code-Switching corpus SEAME. In ASR experiments, the model containing Brown word clusters and part-of-speech tags and the model also including clusters of open class word embeddings yield the best mixed error rate results. In summary, the best language model can significantly reduce the perplexity on the SEAME evaluation set by up to 10.8% relative and the mixed error rate by up to 3.4% relative.
Code (0)
등록된 구현이 없습니다.
Tasks
Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Language ModelingLanguage Modellingspeech-recognitionSpeech RecognitionWord EmbeddingsSimilar Papers 제목 키워드 기반
Joint Arc-factored Parsing of Syntactic and Semantic Dependencies
In this paper we introduce a joint arc-factored model for syntactic and semantic dependency parsing. The semantic role labeler predicts the full syntactic paths that connect predicates with their arguments. This process …
ARCDependency ParsingSemantic Dependency ParsingSemantic Role LabelingSuperNMT: Neural Machine Translation with Semantic Supersenses and Syntactic Supertags
In this paper we incorporate semantic supersensetags and syntactic supertag features into EN{--}FR and EN{--}DE factored NMT systems. In experiments on various test sets, we observe that such features (and particularly w…
Machine TranslationNamed Entity Recognition (NER)NMTPrepositional Phrase Attachment+2Combination of Recurrent Neural Networks and Factored Language Models for Code-Switching Language Modeling
Bottom-Up Unranked Tree-to-Graph Transducers for Translation into Semantic Graphs
We propose a formal model for translating unranked syntactic trees, such as dependency trees, into semantic graphs. These tree-to-graph transducers can serve as a formal basis of transition systems for semantic parsing w…
ARCSemantic ParsingTranslationIncorporating Lexical and Syntactic Knowledge for Unsupervised Cross-Lingual Transfer
Unsupervised cross-lingual transfer involves transferring knowledge between languages without explicit supervision. Although numerous studies have been conducted to improve performance in such tasks by focusing on cross-…
Cross-Lingual TransferGraph Attentionnamed-entity-recognitionNamed Entity Recognition+6