paper-with-me

홈 › Papers

Towards Efficient Large Language Models for Scientific Text: A Review

2024-08-20 · Huy Quoc To, Ming Liu, Guangyan Huang

Large language models (LLMs) have ushered in a new era for processing complex information in various fields, including science. The increasing amount of scientific literature allows these models to acquire and understand scientific knowledge effectively, thus improving their performance in a wide range of tasks. Due to the power of LLMs, they require extremely expensive computational resources, intense amounts of data, and training time. Therefore, in recent years, researchers have proposed various methodologies to make scientific LLMs more affordable. The most well-known approaches align in two directions. It can be either focusing on the size of the models or enhancing the quality of data. To date, a comprehensive review of these two families of methods has not yet been undertaken. In this paper, we (I) summarize the current advances in the emerging abilities of LLMs into more accessible AI solutions for science, and (II) investigate the challenges and opportunities of developing affordable solutions for scientific domains using LLMs.

📄 PDF Abstract BibTeX arXiv:2408.10729

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

ALIGN In the ALIGN method, visual and language representations are jointly trained from noisy image alt-text data. The image and text encoders are learned via contrastive loss…

Similar Papers 제목 키워드 기반

Pre-review to Peer review: Pitfalls of Automating Reviews using Large Language Models

2025-12-14 · Akhil Pandey Akella, Harish Varma Siravuri, Shaurya Rohatgi arxiv

Large Language Models are versatile general-task solvers, and their capabilities can truly assist people with scholarly peer review as \textit{pre-review} agents, if not as fully autonomous \textit{peer-review} agents. W…

What Can Natural Language Processing Do for Peer Review?

2024-05-10 · Ilia Kuznetsov, Osama Mohammed Afzal, Koen Dercksen, Nils Dycke 외

The number of scientific articles produced every year is growing rapidly. Providing quality control over them is crucial for scientists and, ultimately, for the public good. In modern science, this process is largely del…

Articles

Can We Automate Scientific Reviewing?

2021-01-30 · Weizhe Yuan, PengFei Liu, Graham Neubig

The rapid development of science and technology has been accompanied by an exponential growth in peer-reviewed scientific publications. At the same time, the review of each paper is a laborious process that must be carri…

Review Generation

Fine-Tuning Language Models for Scientific Writing Support

2023-06-19 · Justin Mücke, Daria Waldow, Luise Metzger, Philipp Schauz 외

We support scientific writers in determining whether a written sentence is scientific, to which section it belongs, and suggest paraphrasings to improve the sentence. Firstly, we propose a regression model trained on a c…

Sentence

Large Language Models for Full-Text Methods Assessment: A Case Study on Mediation Analysis

2025-10-12 · Wenqing Zhang, Trang Nguyen, Elizabeth A. Stuart, Yiqun T. Chen arxiv

Systematic reviews are crucial for synthesizing scientific evidence but remain labor-intensive, especially when extracting detailed methodological information. Large language models (LLMs) offer potential for automating …

Information Extraction