paper-with-me

홈 › Papers

Syntactic and Semantic Features For Code-Switching Factored Language Models

2017-10-04 · Heike Adel, Ngoc Thang Vu, Katrin Kirchhoff, Dominic Telaar, Tanja Schultz

This paper presents our latest investigations on different features for factored language models for Code-Switching speech and their effect on automatic speech recognition (ASR) performance. We focus on syntactic and semantic features which can be extracted from Code-Switching text data and integrate them into factored language models. Different possible factors, such as words, part-of-speech tags, Brown word clusters, open class words and clusters of open class word embeddings are explored. The experimental results reveal that Brown word clusters, part-of-speech tags and open-class words are the most effective at reducing the perplexity of factored language models on the Mandarin-English Code-Switching corpus SEAME. In ASR experiments, the model containing Brown word clusters and part-of-speech tags and the model also including clusters of open class word embeddings yield the best mixed error rate results. In summary, the best language model can significantly reduce the perplexity on the SEAME evaluation set by up to 10.8% relative and the mixed error rate by up to 3.4% relative.

📄 PDF Abstract BibTeX arXiv:1710.01809

Code (0)

등록된 구현이 없습니다.

Tasks

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Language ModelingLanguage Modellingspeech-recognitionSpeech RecognitionWord Embeddings

Similar Papers 제목 키워드 기반

Joint Arc-factored Parsing of Syntactic and Semantic Dependencies

2013-01-01 · TACL 2013 1 · Xavier Llu{\'\i}s, Xavier Carreras, Llu{\'\i}s M{\`a}rquez

In this paper we introduce a joint arc-factored model for syntactic and semantic dependency parsing. The semantic role labeler predicts the full syntactic paths that connect predicates with their arguments. This process …

ARCDependency ParsingSemantic Dependency ParsingSemantic Role Labeling

SuperNMT: Neural Machine Translation with Semantic Supersenses and Syntactic Supertags

2018-07-01 · ACL 2018 7 · Eva Vanmassenhove, Andy Way

In this paper we incorporate semantic supersensetags and syntactic supertag features into EN{--}FR and EN{--}DE factored NMT systems. In experiments on various test sets, we observe that such features (and particularly w…

Machine TranslationNamed Entity Recognition (NER)NMTPrepositional Phrase Attachment+2

Combination of Recurrent Neural Networks and Factored Language Models for Code-Switching Language Modeling

2013-08-01 · ACL 2013 8 · Heike Adel, Ngoc Thang Vu, Tanja Schultz
Language ModelingLanguage ModellingSpeech Recognition

Bottom-Up Unranked Tree-to-Graph Transducers for Translation into Semantic Graphs

2019-09-01 · WS 2019 9 · Johanna Bj{\"o}rklund, Shay B. Cohen, Frank Drewes, Giorgio Satta

We propose a formal model for translating unranked syntactic trees, such as dependency trees, into semantic graphs. These tree-to-graph transducers can serve as a formal basis of transition systems for semantic parsing w…

ARCSemantic ParsingTranslation

Incorporating Lexical and Syntactic Knowledge for Unsupervised Cross-Lingual Transfer

2024-04-25 · Jianyu Zheng, Fengfei Fan, Jianquan Li

Unsupervised cross-lingual transfer involves transferring knowledge between languages without explicit supervision. Although numerous studies have been conducted to improve performance in such tasks by focusing on cross-…

Cross-Lingual TransferGraph Attentionnamed-entity-recognitionNamed Entity Recognition+6