paper-with-me

Papers

A Survey of Prompt Engineering Methods in Large Language Models for Different NLP Tasks

2024-07-17 · Shubham Vatsal, Harsh Dubey

Large language models (LLMs) have shown remarkable performance on many different Natural Language Processing (NLP) tasks. Prompt engineering plays a key role in adding more to the already existing abilities of LLMs to achieve significant performance gains on various NLP tasks. Prompt engineering requires composing natural language instructions called prompts to elicit knowledge from LLMs in a structured way. Unlike previous state-of-the-art (SoTA) models, prompt engineering does not require extensive parameter re-training or fine-tuning based on the given NLP task and thus solely operates on the embedded knowledge of LLMs. Additionally, LLM enthusiasts can intelligently extract LLMs' knowledge through a basic natural language conversational exchange or prompt engineering, allowing more and more people even without deep mathematical machine learning background to experiment with LLMs. With prompt engineering gaining popularity in the last two years, researchers have come up with numerous engineering techniques around designing prompts to improve accuracy of information extraction from the LLMs. In this paper, we summarize different prompting techniques and club them together based on different NLP tasks that they have been used for. We further granularly highlight the performance of these prompting strategies on various datasets belonging to that NLP task, talk about the corresponding LLMs used, present a taxonomy diagram and discuss the possible SoTA for specific datasets. In total, we read and present a survey of 44 research papers which talk about 39 different prompting methods on 29 different NLP tasks of which most of them have been published in the last two years.

📄 PDF Abstract BibTeX arXiv:2407.12994

Code (0)

등록된 구현이 없습니다.

Tasks

Prompt Engineering

Similar Papers 제목 키워드 기반

A Systematic Survey of Prompt Engineering on Vision-Language Foundation Models

2023-07-24 · Jindong Gu, Zhen Han, Shuo Chen, Ahmad Beirami 외

Prompt engineering is a technique that involves augmenting a large pre-trained model with task-specific hints, known as prompts, to adapt the model to new tasks. Prompts can be created manually as natural language instru…

Image GenerationImage-text matchingLanguage ModelingLanguage Modelling+5

Prompt Design and Engineering: Introduction and Advanced Methods

2024-01-24 · Xavier Amatriain

Prompt design and engineering has rapidly become essential for maximizing the potential of large language models. In this paper, we introduce core concepts, advanced techniques like Chain-of-Thought and Reflection, and t…

Prompt EngineeringSurvey

A Systematic Survey of Prompt Engineering in Large Language Models: Techniques and Applications

2024-02-05 · Pranab Sahoo, Ayush Kumar Singh, Sriparna Saha, Vinija Jain 외

Prompt engineering has emerged as an indispensable technique for extending the capabilities of large language models (LLMs) and vision-language models (VLMs). This approach leverages task-specific instructions, known as …

Prompt EngineeringQuestion Answering

Towards Goal-oriented Prompt Engineering for Large Language Models: A Survey

2024-01-25 · Haochen Li, Jonathan Leung, Zhiqi Shen

Large Language Models (LLMs) have shown prominent performance in various downstream tasks and prompt engineering plays a pivotal role in optimizing LLMs' performance. This paper, not only as an overview of current prompt…

Language ModellingLarge Language ModelPrompt Engineering

Multilingual Prompt Engineering in Large Language Models: A Survey Across NLP Tasks

2025-05-16 · Shubham Vatsal, Harsh Dubey, Aditi Singh

Large language models (LLMs) have demonstrated impressive performance across a wide range of Natural Language Processing (NLP) tasks. However, ensuring their effectiveness across multiple languages presents unique challe…

Multilingual NLPPrompt Engineering