Evaluating Hierarchical Document Categorisation
Hierarchical document categorisation is a special case of multi-label document categorisation, where there is a taxonomic hierarchy among the labels. While various approaches have been proposed for hierarchical document categorisation, there is no standard benchmark dataset, resulting in different methods being evaluated independently and there being no empirical consensus on what methods perform best. In this work, we examine different combinations of neural text encoders and hierarchical methods in an end-to-end framework, and evaluate over three datasets. We find that the performance of hierarchical document categorisation is determined not only by how the hierarchical information is modelled, but also the structure of the label hierarchy and class distribution.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
JRC EuroVoc Indexer JEX - A freely available multi-label categorisation tool
EuroVoc (2012) is a highly multilingual thesaurus consisting of over 6,700 hierarchically organised subject domains used by European Institutions and many authorities in Member States of the European Union (EU) for the c…
ClassificationClusteringGeneral ClassificationMulti-Label Classification+3Categorisation of Bulgarian Legislative Documents
The paper presents the categorisation of Bulgarian MARCELL corpus in toplevel EuroVoc domains. The Bulgarian MARCELL corpus is part of a recently developed multilingual corpus representing the national legislation in sev…
Term ExtractionA Modular System for Rule-based Text Categorisation
We introduce a modular rule-based approach to text categorisation which is more flexible and less time consuming to build than a standard rule-based system because it works with a hierarchical structure and allows for re…
BIG-bench Machine LearningSearching for Discriminative Words in Multidimensional Continuous Feature Space
Word feature vectors have been proven to improve many NLP tasks. With recent advances in unsupervised learning of these feature vectors, it became possible to train it with much more data, which also resulted in better q…
Part-Of-Speech TaggingDocParser: Hierarchical Structure Parsing of Document Renderings
Translating renderings (e. g. PDFs, scans) into hierarchical document structures is extensively demanded in the daily routines of many real-world applications. However, a holistic, principled approach to inferring the co…