paper-with-me

Papers

LegalPro-BERT: Classification of Legal Provisions by fine-tuning BERT Large Language Model

2024-04-15 · Amit Tewari

A contract is a type of legal document commonly used in organizations. Contract review is an integral and repetitive process to avoid business risk and liability. Contract analysis requires the identification and classification of key provisions and paragraphs within an agreement. Identification and validation of contract clauses can be a time-consuming and challenging task demanding the services of trained and expensive lawyers, paralegals or other legal assistants. Classification of legal provisions in contracts using artificial intelligence and natural language processing is complex due to the requirement of domain-specialized legal language for model training and the scarcity of sufficient labeled data in the legal domain. Using general-purpose models is not effective in this context due to the use of specialized legal vocabulary in contracts which may not be recognized by a general model. To address this problem, we propose the use of a pre-trained large language model which is subsequently calibrated on legal taxonomy. We propose LegalPro-BERT, a BERT transformer architecture model that we fine- tune to efficiently handle classification task for legal provisions. We conducted experiments to measure and compare metrics with current benchmark results. We found that LegalPro-BERT outperforms the previous benchmark used for comparison in this research.

📄 PDF Abstract BibTeX arXiv:2404.10097

Code (0)

등록된 구현이 없습니다.

Tasks

Language Modeling

Similar Papers 제목 키워드 기반

LEDGAR: A Large-Scale Multi-label Corpus for Text Classification of Legal Provisions in Contracts

2020-05-01 · LREC 2020 5 · Don Tuggener, Pius von D{\"a}niken, Thomas Peetz, Mark Cieliebak

We present LEDGAR, a multilabel corpus of legal provisions in contracts. The corpus was crawled and scraped from the public domain (SEC filings) and is, to the best of our knowledge, the first freely available corpus of …

General Classificationtext-classificationText Classification

EURO-5K: When Does Domain Pretraining Matter? Benchmarking Transformers for EU Reporting Obligation Extraction

2026-06-02 · Marios Koniaris, Vasileios Kotronis, Eugenia Giannini, Panayiotis Tsanakas arxiv

Extracting reporting obligations from EU legislation is critical for assessing and reducing regulatory reporting burden. However, distinguishing reporting requirements from structurally similar provisions requires specia…

Domain Adaptation

Enhancing Legal Compliance and Regulation Analysis with Large Language Models

2024-04-26 · Shabnam Hassani

This research explores the application of Large Language Models (LLMs) for automating the extraction of requirement-related legal content in the food safety domain and checking legal compliance of regulatory artifacts. W…

KoBLEX: Open Legal Question Answering with Multi-hop Reasoning

2025-09-01 · Jihyung Lee, Daehui Kim, Seonjeong Hwang, Hyounghun Kim 외 arxiv

Large Language Models (LLM) have achieved remarkable performances in general domains and are now extending into the expert domain of law. Several benchmarks have been proposed to evaluate LLMs' legal capabilities. Howeve…

Question AnsweringLegal Reasoning

CLaw: Benchmarking Chinese Legal Knowledge in Large Language Models - A Fine-grained Corpus and Reasoning Analysis

2025-09-25 · Xinzhe Xu, Liang Zhao, Hongshen Xu, Chen Chen arxiv

Large Language Models (LLMs) are increasingly tasked with analyzing legal texts and citing relevant statutes, yet their reliability is often compromised by general pre-training that ingests legal texts without specialize…

Legal Reasoning