paper-with-me

홈 › Papers

Unleashing Scientific Reasoning for Bio-experimental Protocol Generation via Structured Component-based Reward Mechanism

2025-10-17 · Haoran Sun, Yankai Jiang, Zhenyu Tang, Yaning Pan, Shuang Gu, Zekai Lin, Lilong Wang, Wenjie Lou, Lei Liu, Lei Bai, Xiaosong Wang arxiv

The foundation of reproducible science lies in protocols that are precise, logically ordered, and executable. The autonomous generation of these protocols through natural language queries could greatly improve the efficiency of the reproduction process. However, current leading large language models (LLMs) often generate incomplete or inconsistent protocols, limiting their utility. To address this limitation, we first introduce SciRecipe, a large-scale dataset of over 12K structured protocols spanning 27 biological subfields and encompassing both comprehension and problem-solving tasks. To further improve protocol generation, we propose the "Sketch-and-Fill" paradigm, which separates analysis, structuring, and expression to ensure each step is explicit and verifiable. Complementing this, the structured component-based reward mechanism evaluates step granularity, action order, and semantic fidelity, aligning model optimization with experimental reliability. Building on these components, we develop Thoth, trained through a staged Knowledge-to-Action process that progresses from knowledge acquisition to operational reasoning and ultimately to robust, executable protocol generation. Across multiple benchmarks, Thoth consistently surpasses both proprietary and open-source LLMs, achieving significant improvements in step alignment, logical sequencing, and semantic accuracy. Our approach paves the way for reliable scientific assistants that bridge knowledge with experimental execution. All data, code, and models will be released publicly.

📄 PDF Abstract BibTeX arXiv:2510.15600

Code (0)

등록된 구현이 없습니다.

Tasks

Natural Language Queries

Similar Papers 제목 키워드 기반

BioProBench: Comprehensive Dataset and Benchmark in Biological Protocol Understanding and Reasoning

2025-05-11 · Yuyang Liu, Liuzhenghao Lv, Xiancheng Zhang, Li Yuan 외

Biological protocols are fundamental to reproducible and safe life science research. While LLMs excel on general tasks, their systematic evaluation on these highly specialized, accuracy-critical, and inherently procedura…

Question Answering

Draw with Thought: Unleashing Multimodal Reasoning for Scientific Diagram Generation

2025-04-13 · Zhiqing Cui, Jiahao Yuan, Hanqing Wang, Yanshu Li 외

Scientific diagrams are vital tools for communicating structured knowledge across disciplines. However, they are often published as static raster images, losing symbolic semantics and limiting reuse. While Multimodal Lar…

Code GenerationMultimodal Reasoningvalid

T2I-ReasonBench: Benchmarking Reasoning-Informed Text-to-Image Generation

2025-08-24 · Kaiyue Sun, Rongyao Fang, Chengqi Duan, Xian Liu 외 arxiv

We propose T2I-ReasonBench, a benchmark evaluating reasoning capabilities of text-to-image (T2I) models. It consists of four dimensions: Idiom Interpretation, Textual Image Design, Entity-Reasoning and Scientific-Reasoni…

Text-to-Image Generation

Sci-VBench: Evaluating Knowledge- and Reasoning-Intensive Video Generation in Science Domains

2026-08-10 · Diandian Zhang, Tingyu Song, Lin Fu, Zheyuan Yang 외 hf

We introduce Sci-VBench, a comprehensive benchmark for evaluating knowledge- and reasoning-intensive video generation across scientific domains. It contains 1,253 expert-annotated examples spanning 60 subjects across fou…

Video Generation

LayoutCoT: Unleashing the Deep Reasoning Potential of Large Language Models for Layout Generation

2025-04-15 · Hengyu Shi, Junhao Su, Huansheng Ning, Xiaoming Wei 외

Conditional layout generation aims to automatically generate visually appealing and semantically coherent layouts from user-defined constraints. While recent methods based on generative models have shown promising result…

In-Context LearningLayout GenerationRAGRetrieval+1