Improve Document Embedding for Text Categorization Through Deep Siamese Neural Network
Due to the increasing amount of data on the internet, finding a highly-informative, low-dimensional representation for text is one of the main challenges for efficient natural language processing tasks including text classification. This representation should capture the semantic information of the text while retaining their relevance level for document classification. This approach maps the documents with similar topics to a similar space in vector space representation. To obtain representation for large text, we propose the utilization of deep Siamese neural networks. To embed document relevance in topics in the distributed representation, we use a Siamese neural network to jointly learn document representations. Our Siamese network consists of two sub-network of multi-layer perceptron. We examine our representation for the text categorization task on BBC news dataset. The results show that the proposed representations outperform the conventional and state-of-the-art representations in the text classification task on this dataset.
Code (0)
등록된 구현이 없습니다.
Tasks
ClassificationDocument ClassificationDocument EmbeddingGeneral ClassificationText Categorizationtext-classificationText ClassificationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Improving Document Classification with Multi-Sense Embeddings
Efficient representation of text documents is an important building block in many NLP tasks. Research on long text categorization has shown that simple weighted averaging of word vectors for sentence representation often…
ClassificationClusteringDocument ClassificationGeneral Classification+3Supervised and Unsupervised Categorization of an Imbalanced Italian Crime News Dataset
The automatic categorization of crime news is useful to create statistics on the type of crimes occurring in a certain area. This assignment can be treated as a text categorization problem. Several studies have shown tha…
ArticlesKeyphrase ExtractionLemmatizationText Categorization+1Arabic Text Categorization Algorithm using Vector Evaluation Method
Text categorization is the process of grouping documents into categories based on their contents. This process is important to make information retrieval easier, and it became more important due to the huge textual infor…
General ClassificationInformation RetrievalRetrievalText CategorizationSemantic Sensitive TF-IDF to Determine Word Relevance in Documents
Keyword extraction has received an increasing attention as an important research topic which can lead to have advancements in diverse applications such as document context categorization, text indexing and document class…
Document ClassificationKeyword ExtractionWord EmbeddingsLarge Margin Taxonomy Embedding for Document Categorization
Applications of multi-class classification, such as document categorization, often appear in cost-sensitive settings. Recent work has significantly improved the state of the art by moving beyond ``flat'' classification t…
ClassificationGeneral ClassificationMulti-class Classification