paper-with-me

홈 › Papers

Prompting Large Language Models With the Socratic Method

2023-02-17 · Edward Y. Chang

This paper presents a systematic approach to using the Socratic method in developing prompt templates that effectively interact with large language models, including GPT-3. Various methods are examined, and those that yield precise answers and justifications while fostering creativity and imagination to enhance creative writing are identified. Techniques such as {\em definition}, {\em elenchus}, {\em dialectic}, {\em maieutics}, {\em generalization}, and {\em counterfactual reasoning} are discussed for their application in engineering prompt templates and their connections to inductive, deductive, and abductive reasoning. Through examples, the effectiveness of these dialogue and reasoning methods is demonstrated. An interesting observation is made that when the task's goal and user intent are conveyed to GPT-3 via ChatGPT before the start of a dialogue, the large language model seems to connect to the external context expressed in the intent and perform more effectively.

📄 PDF Abstract BibTeX arXiv:2303.08769

Code (0)

등록된 구현이 없습니다.

Tasks

counterfactualCounterfactual ReasoningLanguage ModelingLanguage ModellingLarge Language Model

Methods 이 논문이 사용한 방법론

{Dispute@FaQ-s}How to file a dispute with Expedia? How to file a dispute with Expedia? To file a complaint against Expedia, first try contacting their customer service directly. You can reach them by phone at…
15 Ways to Contact How can i speak to someone at Delta Airlines 설명 없음
Multi-Head Attention 설명 없음
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Weight Decay 설명 없음
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Cosine Annealing Cosine Annealing is a type of learning rate schedule that has the effect of starting with a large learning rate that is relatively rapidly decreased to a minimum value before…

Similar Papers 제목 키워드 기반

The Art of SOCRATIC QUESTIONING: Recursive Thinking with Large Language Models

2023-05-24 · Jingyuan Qi, Zhiyang Xu, Ying Shen, Minqian Liu 외

Chain-of-Thought (CoT) prompting enables large language models to solve complex reasoning problems by generating intermediate steps. However, confined by its inherent single-pass and sequential generation process, CoT he…

Language ModellingMathMMLUQuestion Answering+1

Can Language Models Employ the Socratic Method? Experiments with Code Debugging

2023-10-04 · Erfan Al-Hossami, Razvan Bunescu, Justin Smith, Ryan Teehan

When employing the Socratic method of teaching, instructors guide students toward solving a problem on their own rather than providing the solution directly. While this strategy can substantially improve learning outcome…

Benchmarking

Improving Socratic Question Generation using Data Augmentation and Preference Optimization

2024-03-01 · Nischal Ashok Kumar, Andrew Lan

The Socratic method is a way of guiding students toward solving a problem independently without directly revealing the solution to the problem. Although this method has been shown to significantly improve student learnin…

Data AugmentationQuestion GenerationQuestion-Generation

Reflective Dialogue or Prompt Refinement? Effects of Tutor Scaffolding on Students' Independent LLM Use for Programming

2026-07-03 · Jerome Brender, Laila El-Hamamsy, Kim Uittenhove, Aitor Perez 외 arxiv

While Large Language Models (LLMs) can provide personalized support in learning, several studies have raised concerns regarding their use in education. Importantly, learning depends on how students engage with LLMs. This…

Boosting Large Language Models with Socratic Method for Conversational Mathematics Teaching

2024-07-24 · Yuyang Ding, Hanglei Hu, Jie zhou, Qin Chen 외

With the introduction of large language models (LLMs), automatic math reasoning has seen tremendous success. However, current methods primarily focus on providing solutions or using techniques like Chain-of-Thought to en…

Math