Inside CORE-KG: Evaluating Structured Prompting and Coreference Resolution for Knowledge Graphs
Human smuggling networks are increasingly adaptive and difficult to analyze. Legal case documents offer critical insights but are often unstructured, lexically dense, and filled with ambiguous or shifting references, which pose significant challenges for automated knowledge graph (KG) construction. While recent LLM-based approaches improve over static templates, they still generate noisy, fragmented graphs with duplicate nodes due to the absence of guided extraction and coreference resolution. The recently proposed CORE-KG framework addresses these limitations by integrating a type-aware coreference module and domain-guided structured prompts, significantly reducing node duplication and legal noise. In this work, we present a systematic ablation study of CORE-KG to quantify the individual contributions of its two key components. Our results show that removing coreference resolution results in a 28.25% increase in node duplication and a 4.32% increase in noisy nodes, while removing structured prompts leads to a 4.29% increase in node duplication and a 73.33% increase in noisy nodes. These findings offer empirical insights for designing robust LLM-based pipelines for extracting structured representations from complex legal texts.
Code (0)
등록된 구현이 없습니다.
Tasks
Coreference ResolutionKnowledge GraphsSimilar Papers 제목 키워드 기반
Are Large Language Models Robust Coreference Resolvers?
Recent work on extending coreference resolution across domains and languages relies on annotated data in both the target domain and language. At the same time, pre-trained large language models (LMs) have been reported t…
coreference-resolutionCoreference ResolutionDomain AdaptationFew-Shot Learning+2BioCoref: Benchmarking Biomedical Coreference Resolution with LLMs
Coreference resolution in biomedical texts presents unique challenges due to complex domain-specific terminology, high ambiguity in mention forms, and long-distance dependencies between coreferring expressions. In this w…
Coreference ResolutionPrompt EngineeringLexical Features in Coreference Resolution: To be Used With Caution
Lexical features are a major source of information in state-of-the-art coreference resolvers. Lexical features implicitly model some of the linguistic phenomena at a fine granularity level. They are especially useful for…
coreference-resolutionCoreference ResolutionScaling Hierarchical Coreference with Homomorphic Compression
Locality sensitive hashing schemes such as \simhash provide compact representations of multisets from which similarity can be estimated. However, in certain applications, we need to estimate the similarity of dynamically…
How Good is a Recommender in Machine-Assisted Cross Document Event Coreference Resolution Annotation?
Annotating cross document event coreference links is a tedious task that requires annotators to have near-oracle knowledge of a document collection. The heavy cognitive load of this task decreases overall annotation qual…
coreference-resolutionCoreference ResolutionEvent Coreference Resolution