Does constituency analysis enhance domain-specific pre-trained BERT models for relation extraction?
Recently many studies have been conducted on the topic of relation extraction. The DrugProt track at BioCreative VII provides a manually-annotated corpus for the purpose of the development and evaluation of relation extraction systems, in which interactions between chemicals and genes are studied. We describe the ensemble system that we used for our submission, which combines predictions of fine-tuned bioBERT, sciBERT and const-bioBERT models by majority voting. We specifically tested the contribution of syntactic information to relation extraction with BERT. We observed that adding constituentbased syntactic information to BERT improved precision, but decreased recall, since relations rarely seen in the train set were less likely to be predicted by BERT models in which the syntactic information is infused. Our code is available online [https://github.com/Maple177/drugprot-relation-extraction].
Code (0)
등록된 구현이 없습니다.
Tasks
DrugProtRelationRelation ExtractionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
LLM-enhanced Self-training for Cross-domain Constituency Parsing
Self-training has proven to be an effective approach for cross-domain tasks, and in this study, we explore its application to cross-domain constituency parsing. Traditional self-training methods rely on limited and poten…
Constituency ParsingLanguage ModelingLanguage ModellingLarge Language ModelChallenges to Open-Domain Constituency Parsing
Neural constituency parsers have reached practical performance on news-domain benchmarks. However, their generalization ability to other domains remains weak. Existing findings on cross-domain constituency parsing are on…
Constituency ParsingCPTAM: Constituency Parse Tree Aggregation Method
Diverse Natural Language Processing tasks employ constituency parsing to understand the syntactic structure of a sentence according to a phrase structure grammar. Many state-of-the-art constituency parsers are proposed, …
Constituency ParsingSentenceRepresenting and Parsing Korean Constituency Structure at Different Levels of Granularity
Korean constituency parsing raises a representational challenge because the terminal units of a phrase-structure tree do not straightforwardly correspond to simple surface words. Korean eojeols are morphologically comple…
Constituency ParsingGrammar as a Foreign Language
Syntactic constituency parsing is a fundamental problem in natural language processing and has been the subject of intensive research and engineering for decades. As a result, the most accurate parsers are domain specifi…
Constituency ParsingCPU