Charagram: Embedding Words and Sentences via Character n-grams
We present Charagram embeddings, a simple approach for learning character-based compositional models to embed textual sequences. A word or sentence is represented using a character n-gram count vector, followed by a single nonlinear transformation to yield a low-dimensional embedding. We use three tasks for evaluation: word similarity, sentence similarity, and part-of-speech tagging. We demonstrate that Charagram embeddings outperform more complex architectures based on character-level recurrent and convolutional neural networks, achieving new state-of-the-art performance on several similarity tasks.
Code (0)
등록된 구현이 없습니다.
Tasks
Part-Of-Speech TaggingSentenceSentence SimilarityWord SimilaritySimilar Papers 제목 키워드 기반
Segmentation-free Compositional $n$-gram Embedding
We propose a new type of representation learning method that models words, phrases and sentences seamlessly. Our method does not depend on word segmentation and any human-annotated resources (e.g., word dictionaries), ye…
Representation LearningSegmentationWord EmbeddingsFast and Accurate Transformer-based Translation with Character-Level Encoding and Subword-Level Decoding
The Transformer translation model is fast to train and achieves state-of-the-art results for various translation tasks. However, unknown input words at test time remain a challenge for the Transformer, especially when …
DecoderTranslationConvolutional Neural Network for Universal Sentence Embeddings
This paper proposes a simple CNN model for creating general-purpose sentence embeddings that can transfer easily across domains and can also act as effective initialization for downstream tasks. Recently, averaging the e…
Semantic Textual SimilaritySentenceSentence EmbeddingsTransfer Learning+1Word-like character n-gram embedding
We propose a new word embedding method called \textit{word-like character} n\textit{-gram embedding}, which learns distributed representations of words by embedding word-like character n-grams. Our method is an extension…
SegmentationWord EmbeddingsAddressing Low-Resource Scenarios with Character-aware Embeddings
Most modern approaches to computing word embeddings assume the availability of text corpora with billions of words. In this paper, we explore a setup where only corpora with millions of words are available, and many word…
Morphological AnalysisWord Embeddings