Boosting Scientific Concepts Understanding: Can Analogy from Teacher Models Empower Student Models?
Analogical reasoning plays a critical role in human cognition, enabling us to understand new concepts by associating them with familiar ones. Previous research in the AI community has mainly focused on identifying and generating analogies and then examining their quality under human evaluation, which overlooks the practical application of these analogies in real-world settings. Inspired by the human education process, in this paper, we propose to investigate how analogies created by teacher language models (LMs) can assist student LMs in understanding scientific concepts, thereby aligning more closely with practical scenarios. Our results suggest that free-form analogies can indeed aid LMs in understanding concepts. Additionally, analogies generated by student LMs can improve their own performance on scientific question answering, demonstrating their capability to use analogies for self-learning new knowledge. Resources are available at https://github.com/siyuyuan/SCUA.
Code (1)
Tasks
Question AnsweringSelf-LearningMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Scientific and Creative Analogies in Pretrained Language Models
This paper examines the encoding of analogy in large-scale pretrained language models, such as BERT and GPT-2. Existing analogy datasets typically focus on a limited set of analogical relations, with a high similarity of…
SciConNav: Knowledge navigation through contextual learning of extensive scientific research trajectories
New knowledge builds upon existing foundations, which means an interdependent relationship exists between knowledge, manifested in the historical development of the scientific system for hundreds of years. By leveraging …
AttributePrototype matching: children's preference for forming scientific concepts
Inspired by a sample lesson, this paper studies and discusses children's preferences in learning scientific concepts. In a "Dissolution" lesson, one of the students took the demonstration experiment of "carmine dissolves…
The Use of AI-Robotic Systems for Scientific Discovery
The process of developing theories and models and testing them with experiments is fundamental to the scientific method. Automating the entire scientific method then requires not only automation of the induction of theor…
Active LearningPhilosophyscientific discoveryHATS: Hindi Analogy Test Set for Evaluating Reasoning in Large Language Models
Analogies test a model's ability to infer implicit relationships between concepts, making them a key benchmark for evaluating reasoning capabilities. While large language models (LLMs) are widely evaluated for reasoning …
Multiple-choice