LOCA: Logical Chain Augmentation for Scientific Corpus Cleaning
While Large Language Models (LLMs) excel in general domains, their reliability often falls short in scientific problem-solving. The advancement of scientific AI depends on large-scale, high-quality corpora. However, existing scientific question-answering (QA) datasets suffer from high error rates, frequently resulting from logical leaps and implicit reasoning within the answers. To address this issue, we introduce LOCA (Logical Chain Augmentation), a novel framework for automatically cleaning scientific corpora, implemented through an augment-and-review loop. At its core, LOCA enhances raw answers by completing missing logical steps and explicitly separating the underlying scientific principle from its subsequent derivation. By applying LOCA to challenging scientific corpora, we demonstrate that it can automatically filter noisy datasets, typically reducing the error rate from as high as 20\% to below 2\%. LOCA provides a scalable and effective methodology for creating high-quality scientific corpora, paving the way for more reliable training and evaluation of scientific AI.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
RAISE: Enhancing Scientific Reasoning in LLMs via Step-by-Step Retrieval
Scientific reasoning requires not only long-chain reasoning processes, but also knowledge of domain-specific terminologies and adaptation to updated findings. To deal with these challenges for scientific reasoning, we in…
Problem DecompositionRetrievalTDMSci: A Specialized Corpus for Scientific Literature Entity Tagging of Tasks Datasets and Metrics
Tasks, Datasets and Evaluation Metrics are important concepts for understanding experimental scientific papers. However, most previous work on information extraction for scientific literature mainly focuses on the abstra…
Data AugmentationCorpus Augmentation by Sentence Segmentation for Low-Resource Neural Machine Translation
Neural Machine Translation (NMT) has been proven to achieve impressive results. The NMT system translation results depend strongly on the size and quality of parallel corpora. Nevertheless, for many language pairs, no ri…
Low Resource Neural Machine TranslationLow-Resource Neural Machine TranslationMachine TranslationNMT+3Transfer Learning for Scientific Data Chain Extraction in Small Chemical Corpus with BERT-CRF Model
Computational chemistry develops fast in recent years due to the rapid growth and breakthroughs in AI. Thanks for the progress in natural language processing, researchers can extract more fine-grained knowledge in public…
Computational chemistryEntity Extraction using GANNERTransfer LearningModeling Changing Scientific Concepts with Complex Networks: A Case Study on the Chemical Revolution
While context embeddings produced by LLMs can be used to estimate conceptual change, these representations are often not interpretable nor time-aware. Moreover, bias augmentation in historical data poses a non-trivial ri…