paper-with-me

홈 › Papers

Large Language Models as Evaluators for Scientific Synthesis

2024-07-03 · Julia Evans, Jennifer D'Souza, Sören Auer

Our study explores how well the state-of-the-art Large Language Models (LLMs), like GPT-4 and Mistral, can assess the quality of scientific summaries or, more fittingly, scientific syntheses, comparing their evaluations to those of human annotators. We used a dataset of 100 research questions and their syntheses made by GPT-4 from abstracts of five related papers, checked against human quality ratings. The study evaluates both the closed-source GPT-4 and the open-source Mistral model's ability to rate these summaries and provide reasons for their judgments. Preliminary results show that LLMs can offer logical explanations that somewhat match the quality ratings, yet a deeper statistical analysis shows a weak correlation between LLM and human ratings, suggesting the potential and current limitations of LLMs in scientific synthesis evaluation.

📄 PDF Abstract BibTeX arXiv:2407.02977

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Multi-Head Attention 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…

Similar Papers 제목 키워드 기반

LARC: Towards Human-level Constrained Retrosynthesis Planning through an Agentic Framework

2025-08-16 · Frazier N. Baker, Daniel Adu-Ampratwum, Reza Averly, Botao Yu 외 arxiv

Large language model (LLM) agent evaluators leverage specialized tools to ground the rational decision-making of LLMs, making them well-suited to aid in scientific discoveries, such as constrained retrosynthesis planning…

Science-T2I: Addressing Scientific Illusions in Image Synthesis

2025-04-17 · CVPR 2025 1 · Jialuo Li, Wenhao Chai, Xingyu Fu, Haiyang Xu 외

We present a novel approach to integrating scientific knowledge into generative models, enhancing their realism and consistency in image synthesis. First, we introduce Science-T2I, an expert-annotated adversarial dataset…

Image Generation

GPT vs Human for Scientific Reviews: A Dual Source Review on Applications of ChatGPT in Science

2023-12-05 · Chenxi Wu, Alan John Varghese, Vivek Oommen, George Em Karniadakis

The new polymath Large Language Models (LLMs) can speed-up greatly scientific reviews, possibly using more unbiased quantitative metrics, facilitating cross-disciplinary connections, and identifying emerging trends and r…

Language ModelingLanguage ModellingLarge Language Model

Awes, Laws, and Flaws From Today's LLM Research

2024-08-27 · Adrian de Wynter

We perform a critical examination of the scientific methodology behind contemporary large language model (LLM) research. For this we assess over 2,000 research works based on criteria typical of what is considered good r…

EthicsLanguage ModelingLanguage ModellingLarge Language Model

LLMs4Synthesis: Leveraging Large Language Models for Scientific Synthesis

2024-09-27 · Hamed Babaei Giglou, Jennifer D'Souza, Sören Auer

In response to the growing complexity and volume of scientific literature, this paper introduces the LLMs4Synthesis framework, designed to enhance the capabilities of Large Language Models (LLMs) in generating high-quali…