Learning to Compose over Tree Structures via POS Tags
Recursive Neural Network (RecNN), a type of models which compose words or phrases recursively over syntactic tree structures, has been proven to have superior ability to obtain sentence representation for a variety of NLP tasks. However, RecNN is born with a thorny problem that a shared compositional function for each node of trees can't capture the complex semantic compositionality so that the expressive power of model is limited. In this paper, in order to address this problem, we propose Tag-Guided HyperRecNN/TreeLSTM (TG-HRecNN/TreeLSTM), which introduces hypernetwork into RecNNs to take as inputs Part-of-Speech (POS) tags of word/phrase and generate the semantic composition parameters dynamically. Experimental results on five datasets for two typical NLP tasks show proposed models both obtain significant improvement compared with RecNN and TreeLSTM consistently. Our TG-HTreeLSTM outperforms all existing RecNN-based models and achieves or is competitive with state-of-the-art on four sentence classification benchmarks. The effectiveness of our models is also demonstrated by qualitative analysis.
Code (0)
등록된 구현이 없습니다.
Tasks
POSSemantic CompositionSentenceSentence ClassificationTAGMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
A Bidirectional Tree Tagging Scheme for Joint Medical Relation Extraction
Joint medical relation extraction refers to extracting triples, composed of entities and relations, from the medical text with a single model. One of the solutions is to convert this task into a sequential tagging task. …
Medical Relation ExtractionRelationRelation ExtractionTAG Parsing with Neural Networks and Vector Representations of Supertags
We present supertagging-based models for Tree Adjoining Grammar parsing that use neural network architectures and dense vector representation of supertags (elementary trees) to achieve state-of-the-art performance in unl…
SentenceTAGNeural Combinatory Constituency Parsing
We propose two fast neural combinatory models for constituency parsing: binary and multi-branching. Our models decompose the bottom-up parsing process into 1) classification of tags, labels, and binary orientations or ch…
Constituency ParsingSENTSHex2vec -- Context-Aware Embedding H3 Hexagons with OpenStreetMap Tags
Representation learning of spatial and geographic data is a rapidly developing field which allows for similarity detection between areas and high-quality inference using deep neural networks. Past approaches however conc…
Representation LearningPenn-Helsinki Parsed Corpus of Early Modern English: First Parsing Results and Analysis
We present the first parsing results on the Penn-Helsinki Parsed Corpus of Early Modern English (PPCEME), a 1.9 million word treebank that is an important resource for research in syntactic change. We describe key featur…
TAG