paper-with-me

홈 › Papers

Mechanisms of Matter: Language Inferential Benchmark on Physicochemical Hypothesis in Materials Synthesis

2025-09-29 · Yingming Pu, Tao Lin, Hongyu Chen arxiv

The capacity of Large Language Models (LLMs) to generate valid scientific hypotheses for materials synthesis remains largely unquantified, hindered by the absence of benchmarks probing physicochemical logics reasoning. To address this, we introduce MatterMech, a benchmark for evaluating LLM-generated hypotheses across eight nanomaterial synthesis domains. Our analysis reveals a critical disconnect: LLMs are proficient in abstract logic yet fail to ground their reasoning in fundamental physicochemical principles. We demonstrate that our proposed principle-aware prompting methodology substantially outperforms standard Chain-of-Thought, enhancing both hypothesis accuracy and computational efficiency. This work provides a methodological framework to advance LLMs toward reliable scientific hypothesis generation in materials science. The MatterMech benchmark and associated code is publicly available at \href{https://github.com/amair-lab/MatterMech}{GitHub}.

📄 PDF Abstract BibTeX arXiv:2509.25281

Code (0)

등록된 구현이 없습니다.

Tasks

Computational Efficiency

Similar Papers 제목 키워드 기반

Leveraging large language models for nano synthesis mechanism explanation: solid foundations or mere conjectures?

2024-07-12 · Yingming Pu, Liping Huang, Tao Lin, Hongyu Chen

With the rapid development of artificial intelligence (AI), large language models (LLMs) such as GPT-4 have garnered significant attention in the scientific community, demonstrating great potential in advancing scientifi…

Logical ReasoningMultiple-choiceProperty Predictionscientific discovery

Exploring Structures of Inferential Mechanisms through Simplistic Digital Circuits

2025-10-27 · Giovanni Sileno, Jean-Louis Dessalles arxiv

Cognitive studies and artificial intelligence have developed distinct models for various inferential mechanisms (categorization, induction, abduction, causal inference, contrast, merge, ...). Yet, both natural and artifi…

Causal Inference

Deciphering Fingerprints of 3D Molecular Surfaces for Accurate Epitope Prediction

2026-06-22 · Fang Wu, Weihao Xuan, Jure Leskovec, Yejin Choi 외 arxiv

Molecular surfaces encode the geometric and physicochemical patterns that determine antibody-antigen recognition, central to epitope prediction. However, existing methods rely on sequences or backbone structures and stru…

MolMetaLM: a Physicochemical Knowledge-Guided Molecular Meta Language Model

2024-11-23 · Yifan Wu, Min Zeng, Yang Li, Yang Zhang 외

Most current molecular language models transfer the masked language model or image-text generation model from natural language processing to molecular field. However, molecules are not solely characterized by atom/bond s…

Language ModelingLanguage ModellingProperty PredictionText Generation

Beyond Instruction Following: Evaluating Inferential Rule Following of Large Language Models

2024-07-11 · Wangtao Sun, Chenxiang Zhang, Xueyou Zhang, Xuanqing Yu 외

Although Large Language Models (LLMs) have demonstrated strong ability, they are further supposed to be controlled and guided by in real-world scenarios to be safe, accurate, and intelligent. This demands the possession …

Instruction Following