paper-with-me

Papers

A Survey on Prompting Techniques in LLMs

2023-11-28 · Prabin Bhandari

Autoregressive Large Language Models have transformed the landscape of Natural Language Processing. Pre-train and prompt paradigm has replaced the conventional approach of pre-training and fine-tuning for many downstream NLP tasks. This shift has been possible largely due to LLMs and innovative prompting techniques. LLMs have shown great promise for a variety of downstream tasks owing to their vast parameters and huge datasets that they are pre-trained on. However, in order to fully realize their potential, their outputs must be guided towards the desired outcomes. Prompting, in which a specific input or instruction is provided to guide the LLMs toward the intended output, has become a tool for achieving this goal. In this paper, we discuss the various prompting techniques that have been applied to fully harness the power of LLMs. We present a taxonomy of existing literature on prompting techniques and provide a concise survey based on this taxonomy. Further, we identify some open problems in the realm of prompting in autoregressive LLMs which could serve as a direction for future research.

📄 PDF Abstract BibTeX arXiv:2312.03740

Code (0)

등록된 구현이 없습니다.

Tasks

Survey

Similar Papers 제목 키워드 기반

The Prompt Report: A Systematic Survey of Prompting Techniques

2024-06-06 · Sander Schulhoff, Michael Ilie, Nishant Balepur, Konstantine Kahadze 외

Generative Artificial Intelligence (GenAI) systems are increasingly being deployed across diverse industries and research domains. Developers and end-users interact with these systems through the use of prompting and pro…

Prompt EngineeringSurvey

The Tyranny of Possibilities in the Design of Task-Oriented LLM Systems: A Scoping Survey

2023-12-29 · Dhruv Dhamani, Mary Lou Maher

This scoping survey focuses on our current understanding of the design space for task-oriented LLM systems and elaborates on definitions and relationships among the available design parameters. The paper begins by defini…

Survey

Multilingual Prompt Engineering in Large Language Models: A Survey Across NLP Tasks

2025-05-16 · Shubham Vatsal, Harsh Dubey, Aditi Singh

Large language models (LLMs) have demonstrated impressive performance across a wide range of Natural Language Processing (NLP) tasks. However, ensuring their effectiveness across multiple languages presents unique challe…

Multilingual NLPPrompt Engineering

Steps are all you need: Rethinking STEM Education with Prompt Engineering

2024-12-06 · Krishnasai Addala, Kabir Dev Paul Baghel, Chhavi Kirtani, Avinash Anand 외

Few shot and Chain-of-Thought prompting have shown promise when applied to Physics Question Answering Tasks, but are limited by the lack of mathematical ability inherent to LLMs, and are prone to hallucination. By utiliz…

AllHallucinationMixture-of-ExpertsPrompt Engineering+1

Generative Large Language Models in Automated Fact-Checking: A Survey

2024-07-02 · Ivan Vykopal, Matúš Pikuliak, Simon Ostermann, Marián Šimko

The dissemination of false information on online platforms presents a serious societal challenge. While manual fact-checking remains crucial, Large Language Models (LLMs) offer promising opportunities to support fact-che…

Fact CheckingSurvey