BERT Goes to Law School: Quantifying the Competitive Advantage of Access to Large Legal Corpora in Contract Understanding
Fine-tuning language models, such as BERT, on domain specific corpora has proven to be valuable in domains like scientific papers and biomedical text. In this paper, we show that fine-tuning BERT on legal documents similarly provides valuable improvements on NLP tasks in the legal domain. Demonstrating this outcome is significant for analyzing commercial agreements, because obtaining large legal corpora is challenging due to their confidential nature. As such, we show that having access to large legal corpora is a competitive advantage for commercial applications, and academic research on analyzing contracts.
Code (0)
등록된 구현이 없습니다.
Methods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Ensemble BERT: A student social network text sentiment classification model based on ensemble learning and BERT architecture
The mental health assessment of middle school students has always been one of the focuses in the field of education. This paper introduces a new ensemble learning network based on BERT, employing the concept of enhancing…
Ensemble LearningSentiment AnalysisSentiment ClassificationAnswering Chinese Elementary School Social Study Multiple Choice Questions
We present a novel approach to answer the Chinese elementary school Social Study Multiple Choice questions. Although BERT has demonstrated excellent performance on Reading Comprehension tasks, it is found not good at han…
Multiple-choiceNegationReading ComprehensionExploring Competitive and Collusive Behaviors in Algorithmic Pricing with Deep Reinforcement Learning
Nowadays, a significant share of the business-to-consumer sector is based on online platforms like Amazon and Alibaba and uses AI for pricing strategies. This has sparked debate on whether pricing algorithms may tacitly …
Deep Reinforcement LearningQ-LearningReinforcement Learning (RL)Absentee and Economic Impact of Low-Level Fine Particulate Matter and Ozone Exposure in K-12 Students
High air pollution levels are associated with school absences. However, low level pollution impact on individual school absences are under-studied. We modelled PM2.5 and ozone concentrations at 36 schools from July 2015 …
"Favoring my playmate seems fair": Inhibitory control and theory of mind in preschoolers' self-disadvantaging behaviors
The purpose of this study was to investigate the relationship between preschoolers' cognitive abilities and their fairness-related allocation behaviors in a dilemma of equity-efficiency conflict. Four- to 6-year-olds in …
Fairness