paper-with-me

Papers

A new keyphrases extraction method based on suffix tree data structure for arabic documents clustering

2014-01-22 · Issam Sahmoudi, Hanane Froud, Abdelmonaime Lachkar

Document Clustering is a branch of a larger area of scientific study known as data mining .which is an unsupervised classification using to find a structure in a collection of unlabeled data. The useful information in the documents can be accompanied by a large amount of noise words when using Full Text Representation, and therefore will affect negatively the result of the clustering process. So it is with great need to eliminate the noise words and keeping just the useful information in order to enhance the quality of the clustering results. This problem occurs with different degree for any language such as English, European, Hindi, Chinese, and Arabic Language. To overcome this problem, in this paper, we propose a new and efficient Keyphrases extraction method based on the Suffix Tree data structure (KpST), the extracted Keyphrases are then used in the clustering process instead of Full Text Representation. The proposed method for Keyphrases extraction is language independent and therefore it may be applied to any language. In this investigation, we are interested to deal with the Arabic language which is one of the most complex languages. To evaluate our method, we conduct an experimental study on Arabic Documents using the most popular Clustering approach of Hierarchical algorithms: Agglomerative Hierarchical algorithm with seven linkage techniques and a variety of distance functions and similarity measures to perform Arabic Document Clustering task. The obtained results show that our method for extracting Keyphrases increases the quality of the clustering results. We propose also to study the effect of using the stemming for the testing dataset to cluster it with the same documents clustering techniques and similarity/distance measures.

📄 PDF Abstract BibTeX arXiv:1401.5644

Code (0)

등록된 구현이 없습니다.

Tasks

Clustering

Similar Papers 제목 키워드 기반

Keyphrase Extraction with Dynamic Graph Convolutional Networks and Diversified Inference

2020-10-24 · Haoyu Zhang, Dingkun Long, Guangwei Xu, Pengjun Xie 외

Keyphrase extraction (KE) aims to summarize a set of phrases that accurately express a concept or a topic covered in a given document. Recently, Sequence-to-Sequence (Seq2Seq) based generative framework is widely used in…

DecoderKeyphrase ExtractionRepresentation Learning

Suffix Trees as Language Models

2012-05-01 · LREC 2012 5 · Casey Redd Kennington, Martin Kay, Annemarie Friedrich

Suffix trees are data structures that can be used to index a corpus. In this paper, we explore how some properties of suffix trees naturally provide the functionality of an n-gram language model with variable n. We expla…

Information RetrievalLanguage ModelingLanguage ModellingMachine Translation+2

A Hybrid Approach to Extract Keyphrases from Medical Documents

2013-03-06 · Kamal Sarkar

Keyphrases are the phrases, consisting of one or more words, representing the important concepts in the articles. Keyphrases are useful for a variety of tasks such as text summarization, automatic indexing, clustering/cl…

ArticlesClusteringKeyphrase ExtractionText Summarization

Extracting Discriminative Keyphrases with Learned Semantic Hierarchies

2016-12-01 · COLING 2016 12 · Yunli Wang, Yong Jin, Xiaodan Zhu, Cyril Goutte

The goal of keyphrase extraction is to automatically identify the most salient phrases from documents. The technique has a wide range of applications such as rendering a quick glimpse of a document, or extracting key con…

Keyphrase ExtractionSpecificity

ELSKE: Efficient Large-Scale Keyphrase Extraction

2021-02-10 · Johannes Knittel, Steffen Koch, Thomas Ertl

Keyphrase extraction methods can provide insights into large collections of documents such as social media posts. Existing methods, however, are less suited for the real-time analysis of streaming data, because they are …

Information RetrievalKeyphrase ExtractionKeyword ExtractionMulti-Document Summarization+1