Seed Words Based Data Selection for Language Model Adaptation
We address the problem of language model customization in applications where the ASR component needs to manage domain-specific terminology; although current state-of-the-art speech recognition technology provides excellent results for generic domains, the adaptation to specialized dictionaries or glossaries is still an open issue. In this work we present an approach for automatically selecting sentences, from a text corpus, that match, both semantically and morphologically, a glossary of terms (words or composite words) furnished by the user. The final goal is to rapidly adapt the language model of an hybrid ASR system with a limited amount of in-domain text data in order to successfully cope with the linguistic domain at hand; the vocabulary of the baseline model is expanded and tailored, reducing the resulting OOV rate. Data selection strategies based on shallow morphological seeds and semantic similarity viaword2vec are introduced and discussed; the experimental setting consists in a simultaneous interpreting scenario, where ASRs in three languages are designed to recognize the domain-specific terms (i.e. dentistry). Results using different metrics (OOV rate, WER, precision and recall) show the effectiveness of the proposed techniques.
Code (0)
등록된 구현이 없습니다.
Tasks
Language ModelingLanguage ModellingSemantic SimilaritySemantic Textual Similarityspeech-recognitionSpeech RecognitionSimilar Papers 제목 키워드 기반
Seed Word Selection for Weakly-Supervised Text Classification with Unsupervised Error Estimation
Weakly-supervised text classification aims to induce text classifiers from only a few user-provided seed words. The vast majority of previous work assumes high-quality seed words are given. However, the expert-annotated …
Binary ClassificationGeneral Classificationtext-classificationText Classification+1Modeling Word Emotion in Historical Language: Quantity Beats Supposed Stability in Seed Word Selection
To understand historical texts, we must be aware that language -- including the emotional connotation attached to words -- changes over time. In this paper, we aim at estimating the emotion which is associated with a giv…
LSIS at SemEval-2017 Task 4: Using Adapted Sentiment Similarity Seed Words For English and Arabic Tweet Polarity Classification
We present, in this paper, our contribution in SemEval2017 task 4 : {``}Sentiment Analysis in Twitter{''}, subtask A: {``}Message Polarity Classification{''}, for English and Arabic languages. Our system is based on a li…
ClassificationGeneral ClassificationSemantic Textual SimilaritySentiment AnalysisAdapted Sentiment Similarity Seed Words For French Tweets' Polarity Classification
We present, in this paper, our contribution in DEFT 2018 task 2 : {``}Global polarity{''}, determining the overall polarity (Positive, Negative, Neutral or MixPosNeg) of tweets regarding public transport, in French langu…
General ClassificationTask 2Word EmbeddingsBoosting Text-to-Image Diffusion Models via Core Token Attention-Based Seed Selection
Text-to-image diffusion models can synthesize high-quality images, yet the outcome is notoriously sensitive to the random seed: different initial seeds often yield large variations in image quality and prompt-image align…