LexRel: Benchmarking Legal Relation Extraction for Chinese Civil Cases
Legal relations serve as an important analytical framework for dispute resolution in civil cases. However, legal relations in Chinese civil cases remain underexplored in the field of legal AI, largely due to the absence of comprehensive schemas. In this work, we first introduce a comprehensive schema for legal relations in civil cases, which contains a hierarchical taxonomy and definitions of arguments. Based on this schema, we formulate a legal relation extraction task and present LexRel, an expert-annotated benchmark for legal relation extraction in the Chinese civil law domain. We use LexRel to evaluate state-of-the-art large language models (LLMs) on legal relation extraction, showing that current LLMs exhibit significant limitations in accurately identifying civil legal relations. Furthermore, we demonstrate that explicitly incorporating information about legal relations leads to promising performance gains on other downstream legal AI tasks.
Code (0)
등록된 구현이 없습니다.
Tasks
Relation ExtractionSimilar Papers 제목 키워드 기반
Joint Entity and Relation Extraction for Legal Documents with Legal Feature Enhancement
In recent years, the plentiful information contained in Chinese legal documents has attracted a great deal of attention because of the large-scale release of the judgment documents on China Judgments Online. It is in gre…
Joint Entity and Relation ExtractionMulti-Task Learningnamed-entity-recognitionNamed Entity Recognition+4Hierarchical Chinese Legal event extraction via Pedal Attention Mechanism
Event extraction plays an important role in legal applications, including case push and auxiliary judgment. However, traditional event structure cannot express the connections between arguments, which are extremely impor…
Event DetectionEvent ExtractionLawBench: Benchmarking Legal Knowledge of Large Language Models
Large language models (LLMs) have demonstrated strong capabilities in various aspects. However, when applying them to the highly specialized, safe-critical legal domain, it is unclear how much legal knowledge they posses…
ArticlesBenchmarkingMemorizationMulti-Label Classification+1Knowledge Augmented Entity and Relation Extraction for Legal Documents with Hypergraph Neural Network
With the continuous progress of digitization in Chinese judicial institutions, a substantial amount of electronic legal document information has been accumulated. To unlock its potential value, entity and relation extrac…
Information ExtractionRelation ExtractionLegal-DC: Benchmarking Retrieval-Augmented Generation for Legal Documents
Retrieval-Augmented Generation (RAG) has emerged as a promising technology for legal document consultation, yet its application in Chinese legal scenarios faces two key limitations: existing benchmarks lack specialized s…