A good space: Lexical predictors in word space evaluation
Vector space models benefit from using an outside corpus to train the model. It is, however, unclear what constitutes a good training corpus. We have investigated the effect on summary quality when using various language resources to train a vector space based extraction summarizer. This is done by evaluating the performance of the summarizer utilizing vector spaces built from corpora from different genres, partitioned from the Swedish SUC-corpus. The corpora are also characterized using a variety of lexical measures commonly used in readability studies. The performance of the summarizer is measured by comparing automatically produced summaries to human created gold standard summaries using the ROUGE F-score. Our results show that the genre of the training corpus does not have a significant effect on summary quality. However, evaluating the variance in the F-score between the genres based on lexical measures as independent variables in a linear regression model, shows that vector spaces created from texts with high syntactic complexity, high word variation, short sentences and few long words produce better summaries.
Code (0)
등록된 구현이 없습니다.
Tasks
Text CategorizationWord Sense DisambiguationSimilar Papers 제목 키워드 기반
Tailoring Word Embeddings for Bilexical Predictions: An Experimental Comparison
We investigate the problem of inducing word embeddings that are tailored for a particular bilexical relation. Our learning algorithm takes an existing lexical vector space and compresses it such that the resulting word e…
RelationWord EmbeddingsAn experimental and computational study of an Estonian single-person word naming
This study investigates lexical processing in Estonian. A large-scale single-subject experiment is reported that combines the word naming task with eye-tracking. Five response variables (first fixation duration, total fi…
Word Sense Filtering Improves Embedding-Based Lexical Substitution
The role of word sense disambiguation in lexical substitution has been questioned due to the high performance of vector space models which propose good substitutes without explicitly accounting for sense. We show that a …
ClusteringEntity Extraction using GANPart-Of-Speech TaggingSemantic Textual Similarity+3WordNet Embeddings
Semantic networks and semantic spaces have been two prominent approaches to represent lexical semantics. While a unified account of the lexical meaning relies on one being able to convert between these representations, i…
Representation LearningSemantic SimilaritySemantic Textual SimilarityWord EmbeddingsTwo experiments for embedding Wordnet hierarchy into vector spaces
In this paper, we investigate mapping of the WORDNET hyponymy relation to feature vectors. Our aim is to model lexical knowledge in such a way that it can be used as input in generic machine-learning models, such as phra…
Vocal Bursts Valence Prediction