paper-with-me

홈 › Papers

A LSTM Approach with Sub-Word Embeddings for Mongolian Phrase Break Prediction

2018-08-01 · COLING 2018 8 · Rui Liu, Feilong Bao, Guanglai Gao, HUI ZHANG, Yonghe Wang

In this paper, we first utilize the word embedding that focuses on sub-word units to the Mongolian Phrase Break (PB) prediction task by using Long-Short-Term-Memory (LSTM) model. Mongolian is an agglutinative language. Each root can be followed by several suffixes to form probably millions of words, but the existing Mongolian corpus is not enough to build a robust entire word embedding, thus it suffers a serious data sparse problem and brings a great difficulty for Mongolian PB prediction. To solve this problem, we look at sub-word units in Mongolian word, and encode their information to a meaningful representation, then fed it to LSTM to decode the best corresponding PB label. Experimental results show that the proposed model significantly outperforms traditional CRF model using manually features and obtains 7.49{\%} F-Measure gain.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Dictionary LearningMachine TranslationQuestion AnsweringWord Embeddings

Methods 이 논문이 사용한 방법론

Sigmoid Activation 설명 없음
Tanh Activation 설명 없음
CRF Conditional Random Fields or CRFs are a type of probabilistic graph model that take neighboring sample context into account for tasks like classification. Prediction is…
LSTM An LSTM is a type of recurrent neural network that addresses the vanishing gradient problem in vanilla…

Similar Papers 제목 키워드 기반

Mongolian Questions Classification Based on Mulit-Head Attention

2020-10-01 · CCL 2020 10 · Guangyi Wang, Feilong Bao, Weihua Wang

Question classification is a crucial subtask in question answering system. Mongolian is a kind of few resource language. It lacks public labeled corpus. And the complex morphological structure of Mongolian vocabulary mak…

ClassificationQuestion Answering

Incorporating Inner-word and Out-word Features for Mongolian Morphological Segmentation

2020-12-01 · COLING 2020 8 · Na Liu, Xiangdong Su, Haoran Zhang, Guanglai Gao 외

Mongolian morphological segmentation is regarded as a crucial preprocessing step in many Mongolian related NLP applications and has received extensive attention. Recently, end-to-end segmentation approaches with long sho…

DecoderSegmentationSentence

Beyond Word2Vec: Embedding Words and Phrases in Same Vector Space

2017-12-18 · International Conference on Natural Language Processing (ICON) 2017, Kolkata, India 2017 12 · Vijay Prakash Dwivedi, Manish Shrivastava

Word embeddings are being used for several linguistic problems and NLP tasks. Improvements in solutions to such problems are great because of the recent breakthroughs in vector representation of words and research in vec…

Phrase Vector EmbeddingSemantic Textual SimilarityWord Embeddings

Deep learning model for Mongolian Citizens Feedback Analysis using Word Vector Embeddings

2023-02-23 · Zolzaya Dashdorj, Tsetsentsengel Munkhbayar, Stanislav Grigorev

A large amount of feedback was collected over the years. Many feedback analysis models have been developed focusing on the English language. Recognizing the concept of feedback is challenging and crucial in languages whi…

Deep LearningSentenceWord Embeddings

Keyphrase Extraction from Scholarly Articles as Sequence Labeling using Contextualized Embeddings

2019-10-19 · Dhruva Sahrawat, Debanjan Mahata, Mayank Kulkarni, Haimin Zhang 외

In this paper, we formulate keyphrase extraction from scholarly articles as a sequence labeling task solved using a BiLSTM-CRF, where the words in the input text are represented using deep contextualized embeddings. We e…

ArticlesKeyphrase ExtractionWord Embeddings