Selecting Better Samples from Pre-trained LLMs: A Case Study on Question Generation
Large Language Models (LLMs) have in recent years demonstrated impressive prowess in natural language generation. A common practice to improve generation diversity is to sample multiple outputs from the model. However, there lacks a simple and robust way of selecting the best output from these stochastic samples. As a case study framed in the context of question generation, we propose two prompt-based approaches to selecting high-quality questions from a set of LLM-generated candidates. Our method works under the constraints of 1) a black-box (non-modifiable) question generation model and 2) lack of access to human-annotated references -- both of which are realistic limitations for real-world deployment of LLMs. With automatic as well as human evaluations, we empirically demonstrate that our approach can effectively select questions of higher qualities than greedy generation.
Code (0)
등록된 구현이 없습니다.
Tasks
DiversityQuestion GenerationQuestion-GenerationText GenerationSimilar Papers 제목 키워드 기반
When Weak LLMs Speak with Confidence, Preference Alignment Gets Stronger
Preference alignment is an essential step in adapting large language models (LLMs) to human values, but existing approaches typically depend on costly human annotations or large-scale API-based models. We explore whether…
RECOST: External Knowledge Guided Data-efficient Instruction Tuning
In the current landscape of large language models (LLMs), the process of instruction tuning serves as an essential step. Considering the high computing power overhead, data-efficient instruction tuning was proposed to re…
DiversityRe-RankingImproving Causal Effect Estimation of Weighted RegressionBased Estimator using Neural Networks
Estimating causal effects from observational data informs us about which factors are important in an autonomous system, and enables us to take better decisions. This is important because it has applications in selecting …
regressionIn-Context Learning Demonstration Selection via Influence Analysis
Large Language Models (LLMs) have showcased their In-Context Learning (ICL) capabilities, enabling few-shot learning without the need for gradient updates. Despite its advantages, the effectiveness of ICL heavily depends…
Few-Shot LearningIn-Context LearningInvestigating Large Language Models for Code Vulnerability Detection: An Experimental Study
Code vulnerability detection (CVD) is essential for addressing and preventing system security issues, playing a crucial role in ensuring software security. Previous learning-based vulnerability detection methods rely on …
Vulnerability Detection