paper-with-me

홈 › Papers

Prompt-Engineering and Transformer-based Question Generation and Evaluation

2023-10-29 · Rubaba Amyeen

Question generation has numerous applications in the educational context. Question generation can prove helpful for students when reviewing content and testing themselves. Furthermore, a question generation model can aid teachers by lessening the burden of creating assessments and other practice material. This paper aims to find the best method to generate questions from textual data through a transformer model and prompt engineering. In this research, we finetuned a pretrained distilBERT model on the SQuAD question answering dataset to generate questions. In addition to training a transformer model, prompt engineering was applied to generate questions effectively using the LLaMA model. The generated questions were compared against the baseline questions in the SQuAD dataset to evaluate the effectiveness of four different prompts. All four prompts demonstrated over 60% similarity on average. Of the prompt-generated questions, 30% achieved a high similarity score greater than 70%.

📄 PDF Abstract BibTeX arXiv:2310.18867

Code (0)

등록된 구현이 없습니다.

Tasks

Prompt EngineeringQuestion AnsweringQuestion GenerationQuestion-Generation

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
WordPiece 설명 없음
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Refunds@Expedia|||How do I get a full refund from Expedia? “How do I get a full refund from Expedia? How do I get a full refund from Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Quick Help &…

Similar Papers 제목 키워드 기반

Provable optimal transport with transformers: The essence of depth and prompt engineering

2024-10-25 · Hadi Daneshmand

Can we establish provable performance guarantees for transformers? Establishing such theoretical guarantees is a milestone in developing trustworthy generative AI. In this paper, we take a step toward addressing this que…

Prompt Engineering

A RAG Approach for Generating Competency Questions in Ontology Engineering

2024-09-13 · Xueli Pan, Jacco van Ossenbruggen, Victor de Boer, Zhisheng Huang

Competency question (CQ) formulation is central to several ontology development and evaluation methodologies. Traditionally, the task of crafting these competency questions heavily relies on the effort of domain experts …

Knowledge GraphsRAGRetrieval-augmented Generation

MCQG-SRefine: Multiple Choice Question Generation and Evaluation with Iterative Self-Critique, Correction, and Comparison Feedback

2024-10-17 · Zonghai Yao, Aditya Parashar, Huixue Zhou, Won Seok Jang 외

Automatic question generation (QG) is essential for AI and NLP, particularly in intelligent tutoring, dialogue systems, and fact verification. Generating multiple-choice questions (MCQG) for professional exams, like the …

Fact VerificationHallucinationMultiple-choicePrompt Engineering+2

Prompt Coach: An Empirical Evaluation of an Agentic Tutor for Learning Prompt Engineering in Software Development

2026-07-07 · Rohit Mehra, Kapil Singi, Vikrant Kaulgud, Vibhu Saujanya Sharma 외 arxiv

Prompt engineering has emerged as a critical yet undertaught skill for software developers, one that traditional learning approaches are ill-equipped to support given its evolving, interactive, and context-dependent natu…

Prompt Engineering

Curiosity by Design: An LLM-based Coding Assistant Asking Clarification Questions

2025-07-28 · Harsh Darji, Thibaud Lutellier arxiv

Large Language Models (LLMs) are increasingly used as coding assistants. However, the ambiguity of the developer's prompt often leads to incorrect code generation, as current models struggle to infer user intent without …

Prompt EngineeringCode Generation