Classifying long legal documents using short random chunks
Classifying legal documents is a challenge, besides their specialized vocabulary, sometimes they can be very long. This means that feeding full documents to a Transformers-based models for classification might be impossible, expensive or slow. Thus, we present a legal document classifier based on DeBERTa V3 and a LSTM, that uses as input a collection of 48 randomly-selected short chunks (max 128 tokens). Besides, we present its deployment pipeline using Temporal, a durable execution solution, which allow us to have a reliable and robust processing workflow. The best model had a weighted F-score of 0.898, while the pipeline running on CPU had a processing median time of 498 seconds per 100 files.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Effectively Leveraging BERT for Legal Document Classification
Bidirectional Encoder Representations from Transformers (BERT) has achieved state-of-the-art performances on several text classification tasks, such as GLUE and sentiment analysis. Recent work in the legal domain started…
Binary ClassificationClassificationDocument ClassificationSentiment Analysis+2LegalCore: A Dataset for Legal Documents Event Coreference Resolution
Recognizing events and their coreferential mentions in a document is essential for understanding semantic meanings of text. The existing research on event coreference resolution is mostly limited to news articles. In thi…
Articlescoreference-resolutionCoreference ResolutionEvent Coreference Resolution+1Fine-grained Intent Classification in the Legal Domain
A law practitioner has to go through a lot of long legal case proceedings. To understand the motivation behind the actions of different parties/individuals in a legal case, it is essential that the parts of the document …
Classificationintent-classificationIntent ClassificationLawformer: A Pre-trained Language Model for Chinese Legal Long Documents
Legal artificial intelligence (LegalAI) aims to benefit legal systems with the technology of artificial intelligence, especially natural language processing (NLP). Recently, inspired by the success of pre-trained languag…
Language ModelingLanguage ModellingQuestion AnsweringReading Comprehension+1Empirical Comparisons of CNN with Other Learning Algorithms for Text Classification in Legal Document Review
Research has shown that Convolutional Neural Networks (CNN) can be effectively applied to text classification as part of a predictive coding protocol. That said, most research to date has been conducted on data sets with…
BIG-bench Machine LearningClassificationGeneral Classificationtext-classification+1