Learning Syntactic Dense Embedding with Correlation Graph for Automatic Readability Assessment
Deep learning models for automatic readability assessment generally discard linguistic features traditionally used in machine learning models for the task. We propose to incorporate linguistic features into neural network models by learning syntactic dense embeddings based on linguistic features. To cope with the relationships between the features, we form a correlation graph among features and use it to learn their embeddings so that similar features will be represented by similar embeddings. Experiments with six data sets of two proficiency levels demonstrate that our proposed methodology can complement BERT-only model to achieve significantly better performances for automatic readability assessment.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Tapping the Potential of Coherence and Syntactic Features in Neural Models for Automatic Essay Scoring
In the prompt-specific holistic score prediction task for Automatic Essay Scoring, the general approaches include pre-trained neural model, coherence model, and hybrid model that incorporate syntactic features with neura…
Prompt LearningMixing Dirichlet Topic Models and Word Embeddings to Make lda2vec
Distributed dense word vectors have been shown to be effective at capturing token-level semantic and syntactic regularities in language, while topic models can form interpretable representations over documents. In this w…
Topic ModelsWord EmbeddingsGraph-based Syntactic Word Embeddings
We propose a simple and efficient framework to learn syntactic embeddings based on information derived from constituency parse trees. Using biased random walk methods, our embeddings not only encode syntactic information…
POSPOS TaggingWord EmbeddingsRGAT: A Deeper Look into Syntactic Dependency Information for Coreference Resolution
Although syntactic information is beneficial for many NLP tasks, combining it with contextual information between words to solve the coreference resolution problem needs to be further explored. In this paper, we propose …
coreference-resolutionCoreference ResolutionGraph AttentionMulti-grained Label Refinement Network with Dependency Structures for Joint Intent Detection and Slot Filling
Slot filling and intent detection are two fundamental tasks in the field of natural language understanding. Due to the strong correlation between these two tasks, previous studies make efforts on modeling them with multi…
Graph AttentionIntent DetectionMulti-Task LearningNatural Language Understanding+3