Large-Scale Multi-Label Text Classification on EU Legislation

2019-06-05 · ACL 2019 7 · Ilias Chalkidis, Manos Fergadiotis, Prodromos Malakasiotis, Ion Androutsopoulos

We consider Large-Scale Multi-Label Text Classification (LMTC) in the legal domain. We release a new dataset of 57k legislative documents from EURLEX, annotated with ~4.3k EUROVOC labels, which is suitable for LMTC, few- and zero-shot learning. Experimenting with several neural classifiers, we show that BIGRUs with label-wise attention perform better than other current state of the art methods. Domain-specific WORD2VEC and context-sensitive ELMO embeddings further improve performance. We also find that considering only particular zones of the documents is sufficient. This allows us to bypass BERT's maximum text length limit and fine-tune BERT, obtaining the best results in all but zero-shot learning cases.

📄 PDF Abstract BibTeX arXiv:1906.02192

Code (1)

iliaschalkidis/lmtc-eurlex57k 공식 구현 tf

Tasks

Classification General Classification Multi Label Text Classification Multi-Label Text Classification text-classification Text Classification Zero-Shot Learning

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.

Sigmoid Activation 설명 없음

Tanh Activation 설명 없음

Weight Decay 설명 없음

Residual Connection 설명 없음

Adam 설명 없음

Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…

Attention 설명 없음

Hierarchical Taxonomy-Aware and Attentional Graph Capsule RCNNs for Large-Scale Multi-Label Text Classification

2019-06-09 · Hao Peng, Jian-Xin Li, Qiran Gong, Senzhang Wang 외

CNNs, RNNs, GCNs, and CapsNets have shown significant insights in representation learning and are widely used in various text mining tasks such as large-scale multi-label text classification. However, most existing deep …

Classification General Classification Multi Label Text Classification Multi-Label Text Classification+3

GUDN: A novel guide network with label reinforcement strategy for extreme multi-label text classification

2022-01-10 · Qing Wang, Jia Zhu, Hongji Shu, Kwame Omono Asamoah 외

In natural language processing, extreme multi-label text classification is an emerging but essential task. The problem of extreme multi-label text classification (XMTC) is to recall some of the most relevant labels for a…

4k Multi Label Text Classification Multi-Label Text Classification text-classification+1

Large-scale Multi-label Text Classification - Revisiting Neural Networks

2013-12-19 · Jinseok Nam, Jungi Kim, Eneldo Loza Mencía, Iryna Gurevych 외

Neural networks have recently been proposed for multi-label classification because they are able to capture and model label dependencies in the output layer. In this work, we investigate limitations of BP-MLL, a neural n…

Classification General Classification Multi-Label Classification MUlTI-LABEL-ClASSIFICATION+4

Multi-pretraining for Large-scale Text Classification

2020-11-01 · Findings of the Association for Computational Linguistics 2020 · Kang-Min Kim, Bumsu Hyeon, Yeachan Kim, Jun-Hyung Park 외

Deep neural network-based pretraining methods have achieved impressive results in many natural language processing tasks including text classification. However, their applicability to large-scale text classification with…

Classification text-classification Text Classification

LEDGAR: A Large-Scale Multi-label Corpus for Text Classification of Legal Provisions in Contracts

2020-05-01 · LREC 2020 5 · Don Tuggener, Pius von D{\"a}niken, Thomas Peetz, Mark Cieliebak

We present LEDGAR, a multilabel corpus of legal provisions in contracts. The corpus was crawled and scraped from the public domain (SEC filings) and is, to the best of our knowledge, the first freely available corpus of …

General Classification text-classification Text Classification