Exploiting Word Internal Structures for Generic Chinese Sentence Representation
We introduce a novel mixed characterword architecture to improve Chinese sentence representations, by utilizing rich semantic information of word internal structures. Our architecture uses two key strategies. The first is a mask gate on characters, learning the relation among characters in a word. The second is a maxpooling operation on words, adaptively finding the optimal mixture of the atomic and compositional word representations. Finally, the proposed architecture is applied to various sentence composition models, which achieves substantial performance gains over baseline models on sentence similarity task.
Code (0)
등록된 구현이 없습니다.
Tasks
SentenceSentence SimilaritySimilar Papers 제목 키워드 기반
An In-depth Study on Internal Structure of Chinese Words
Unlike English letters, Chinese characters have rich and specific meanings. Usually, the meaning of a word can be derived from its constituent characters in some way. Several previous works on syntactic parsing propose t…
SentenceImprove Chinese Word Embeddings by Exploiting Internal Structure
Character-Level Chinese Dependency Parsing via Modeling Latent Intra-Word Structure
Revealing the syntactic structure of sentences in Chinese poses significant challenges for word-level parsers due to the absence of clear word boundaries. To facilitate a transition from word-level to character-level Chi…
Chinese Dependency ParsingDependency ParsingEnd-to-End Chinese Parsing Exploiting Lexicons
Chinese parsing has traditionally been solved by three pipeline systems including word-segmentation, part-of-speech tagging and dependency parsing modules. In this paper, we propose an end-to-end Chinese parsing model ba…
Dependency ParsingGraph AttentionPart-Of-Speech TaggingSegmentationExploiting Word Semantics to Enrich Character Representations of Chinese Pre-trained Models
Most of the Chinese pre-trained models adopt characters as basic units for downstream tasks. However, these models ignore the information carried by words and thus lead to the loss of some important semantics. In this pa…
Machine Reading ComprehensionNatural Language InferenceReading ComprehensionSentence+2