Combining Word-Level and Character-Level Representations for Relation Classification of Informal Text
Word representation models have achieved great success in natural language processing tasks, such as relation classification. However, it does not always work on informal text, and the morphemes of some misspelling words may carry important short-distance semantic information. We propose a hybrid model, combining the merits of word-level and character-level representations to learn better representations on informal text. Experiments on two dataset of relation classification, SemEval-2010 Task8 and a large-scale one we compile from informal text, show that our model achieves a competitive result in the former and state-of-the-art with the other.
Code (0)
등록된 구현이 없습니다.
Tasks
ClassificationGeneral ClassificationRelationRelation ClassificationRepresentation LearningSlot FillingSimilar Papers 제목 키워드 기반
Gating Mechanisms for Combining Character and Word-level Word Representations: An Empirical Study
In this paper we study how different ways of combining character and word-level representations affect the quality of both final word and sentence representations. We provide strong empirical evidence that modeling chara…
Semantic SimilaritySemantic Textual SimilaritySentenceWord SimilarityGated Word-Character Recurrent Language Model
We introduce a recurrent neural network language model (RNN-LM) with long short-term memory (LSTM) units that utilizes both character-level and word-level inputs. Our model has a gate that adaptively finds the optimal mi…
Language ModelingLanguage ModellingmodelTextual Representations for Crosslingual Information Retrieval
In this paper, we explored different levels of textual representations for cross-lingual information retrieval. Beyond the traditional token level representation, we adopted the subword and character level representation…
Cross-Lingual Information RetrievalInformation RetrievalMachine TranslationRe-Ranking+2Combining Character and Word Information in Neural Machine Translation Using a Multi-Level Attention
Natural language sentences, being hierarchical, can be represented at different levels of granularity, like words, subwords, or characters. But most neural machine translation systems require the sentence to be represent…
DecoderMachine TranslationSentenceTranslationAttending to Characters in Neural Sequence Labeling Models
Sequence labeling architectures use word embeddings for capturing similarity, but suffer when handling previously unseen or rare words. We investigate character-level extensions to such models and propose a novel archite…
ChunkingGrammatical Error DetectionNamed Entity Recognition (NER)Part-Of-Speech Tagging+1