paper-with-me

Papers

A Systematic Survey of Prompt Engineering in Large Language Models: Techniques and Applications

2024-02-05 · Pranab Sahoo, Ayush Kumar Singh, Sriparna Saha, Vinija Jain, Samrat Mondal, Aman Chadha

Prompt engineering has emerged as an indispensable technique for extending the capabilities of large language models (LLMs) and vision-language models (VLMs). This approach leverages task-specific instructions, known as prompts, to enhance model efficacy without modifying the core model parameters. Rather than updating the model parameters, prompts allow seamless integration of pre-trained models into downstream tasks by eliciting desired model behaviors solely based on the given prompt. Prompts can be natural language instructions that provide context to guide the model or learned vector representations that activate relevant knowledge. This burgeoning field has enabled success across various applications, from question-answering to commonsense reasoning. However, there remains a lack of systematic organization and understanding of the diverse prompt engineering methods and techniques. This survey paper addresses the gap by providing a structured overview of recent advancements in prompt engineering, categorized by application area. For each prompting approach, we provide a summary detailing the prompting methodology, its applications, the models involved, and the datasets utilized. We also delve into the strengths and limitations of each approach and include a taxonomy diagram and table summarizing datasets, models, and critical points of each prompting technique. This systematic analysis enables a better understanding of this rapidly developing field and facilitates future research by illuminating open challenges and opportunities for prompt engineering.

📄 PDF Abstract BibTeX arXiv:2402.07927

Code (0)

등록된 구현이 없습니다.

Tasks

Prompt EngineeringQuestion Answering

Similar Papers 제목 키워드 기반

A Systematic Survey of Prompt Engineering on Vision-Language Foundation Models

2023-07-24 · Jindong Gu, Zhen Han, Shuo Chen, Ahmad Beirami 외

Prompt engineering is a technique that involves augmenting a large pre-trained model with task-specific hints, known as prompts, to adapt the model to new tasks. Prompts can be created manually as natural language instru…

Image GenerationImage-text matchingLanguage ModelingLanguage Modelling+5

A Systematic Survey of Automatic Prompt Optimization Techniques

2025-02-24 · Kiran Ramnath, Kang Zhou, Sheng Guan, Soumya Smruti Mishra 외

Since the advent of large language models (LLMs), prompt engineering has been a crucial step for eliciting desired responses for various Natural Language Processing (NLP) tasks. However, prompt engineering remains an imp…

Prompt EngineeringSurvey

The Prompt Report: A Systematic Survey of Prompting Techniques

2024-06-06 · Sander Schulhoff, Michael Ilie, Nishant Balepur, Konstantine Kahadze 외

Generative Artificial Intelligence (GenAI) systems are increasingly being deployed across diverse industries and research domains. Developers and end-users interact with these systems through the use of prompting and pro…

Prompt EngineeringSurvey

A Survey of Context Engineering for Large Language Models

2025-07-17 · Lingrui Mei, Jiayu Yao, Yuyao Ge, Yiwei Wang 외

The performance of Large Language Models (LLMs) is fundamentally determined by the contextual information provided during inference. This survey introduces Context Engineering, a formal discipline that transcends simple …

RAGRetrievalRetrieval-augmented GenerationSurvey

Prompt Programming for Cultural Bias and Alignment of Large Language Models

2026-03-17 · Maksim Eren, Eric Michalak, Brian Cook, Johnny Seales arxiv

Culture shapes reasoning, values, prioritization, and strategic decision-making, yet large language models (LLMs) often exhibit cultural biases that misalign with target populations. As LLMs are increasingly used for str…

Prompt Engineering