paper-with-me

Papers

PGA-SciRE: Harnessing LLM on Data Augmentation for Enhancing Scientific Relation Extraction

2024-05-30 · Yang Zhou, Shimin Shan, Hongkui Wei, Zhehuan Zhao, Wenshuo Feng

Relation Extraction (RE) aims at recognizing the relation between pairs of entities mentioned in a text. Advances in LLMs have had a tremendous impact on NLP. In this work, we propose a textual data augmentation framework called PGA for improving the performance of models for RE in the scientific domain. The framework introduces two ways of data augmentation, utilizing a LLM to obtain pseudo-samples with the same sentence meaning but with different representations and forms by paraphrasing the original training set samples. As well as instructing LLM to generate sentences that implicitly contain information about the corresponding labels based on the relation and entity of the original training set samples. These two kinds of pseudo-samples participate in the training of the RE model together with the original dataset, respectively. The PGA framework in the experiment improves the F1 scores of the three mainstream models for RE within the scientific domain. Also, using a LLM to obtain samples can effectively reduce the cost of manually labeling data.

📄 PDF Abstract BibTeX arXiv:2405.20787

Code (0)

등록된 구현이 없습니다.

Tasks

Data AugmentationRelationRelation ExtractionSentence

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Similar Papers 제목 키워드 기반

Scientifically-Interpretable Reasoning Network (ScIReN): Uncovering the Black-Box of Nature

2025-06-16 · Joshua Fan, Haodi Xu, Feng Tao, Md Nasim 외

Neural networks are a powerful tool for learning patterns from data. However, they do not respect known scientific laws, nor can they reveal novel scientific insights due to their black-box nature. In contrast, scientifi…

scientific discovery

A Context-based Framework for Modeling the Role and Function of On-line Resource Citations in Scientific Literature

2019-11-01 · IJCNLP 2019 11 · He Zhao, Zhunchen Luo, Chong Feng, Anqing Zheng 외

We introduce a new task of modeling the role and function for on-line resource citations in scientific literature. By categorizing the on-line resources and analyzing the purpose of resource citations in scientific texts…

General ClassificationRecommendation Systems

Demystifying Scientific Problem-Solving in LLMs by Probing Knowledge and Reasoning

2025-08-26 · Alan Li, Yixin Liu, Arpan Sarkar, Doug Downey 외 arxiv

Scientific problem solving poses unique challenges for LLMs, requiring both deep domain knowledge and the ability to apply such knowledge through complex reasoning. While automated scientific reasoners hold great promise…

SciResearcher: Scaling Deep Research Agents for Frontier Scientific Reasoning

2026-05-02 · Tianshi Zheng, Rui Wang, Xiyun Li, Kelvin Kiu Wai Tam 외 arxiv

Frontier scientific reasoning is rapidly emerging as a key foundation for advancing AI agents in automated scientific discovery. Deep research agents offer a promising approach to this challenge. These models develop rob…

Reinforcement Learning

SciReasoner: Laying the Scientific Reasoning Ground Across Disciplines

2025-09-25 · Yizhou Wang, Chen Tang, Han Deng, Jiabei Xiao 외 arxiv

We present a scientific reasoning foundation model that aligns natural language with heterogeneous scientific representations. The model is pretrained on a 206B-token corpus spanning scientific text, pure sequences, and …

Reinforcement LearningDomain Generalization