Syntree2Vec - An algorithm to augment syntactic hierarchy into word embeddings
Word embeddings aims to map sense of the words into a lower dimensional vector space in order to reason over them. Training embeddings on domain specific data helps express concepts more relevant to their use case but comes at a cost of accuracy when data is less. Our effort is to minimise this by infusing syntactic knowledge into the embeddings. We propose a graph based embedding algorithm inspired from node2vec. Experimental results have shown that our algorithm improves the syntactic strength and gives robust performance on meagre data.
Code (0)
등록된 구현이 없습니다.
Tasks
Word EmbeddingsMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
HILL: Hierarchy-aware Information Lossless Contrastive Learning for Hierarchical Text Classification
Existing self-supervised methods in natural language processing (NLP), especially hierarchical text classification (HTC), mainly focus on self-supervised contrastive learning, extremely relying on human-designed augmenta…
Contrastive LearningDocument EmbeddingHierarchical Multi-label ClassificationRepresentation Learning+2Outline, Then Details: Syntactically Guided Coarse-To-Fine Code Generation
For a complicated algorithm, its implementation by a human programmer usually starts with outlining a rough control flow followed by iterative enrichments, eventually yielding carefully generated syntactic structures and…
Code GenerationLanguage ModelingLanguage ModellingProgram SynthesisFinding Syntactic Representations in Neural Stacks
Neural network architectures have been augmented with differentiable stacks in order to introduce a bias toward learning hierarchy-sensitive regularities. It has, however, proven difficult to assess the degree to which s…
General ClassificationLanguage ModelingLanguage ModellingEvaluating Hierarchies of Verb Argument Structure with Hierarchical Clustering
Verbs can only be used with a few specific arrangements of their arguments (syntactic frames). Most theorists note that verbs can be organized into a hierarchy of verb classes based on the frames they admit. Here we show…
ClusteringLanguage AcquisitionNatural Language InferenceSemantic ParsingHierarchical Sketch Induction for Paraphrase Generation
We propose a generative model of paraphrase generation, that encourages syntactic diversity by conditioning on an explicit syntactic sketch. We introduce Hierarchical Refinement Quantized Variational Autoencoders (HRQ-VA…
DiversityParaphrase GenerationSentence