Why Does ChatGPT Fall Short in Providing Truthful Answers?
Recent advancements in large language models, such as ChatGPT, have demonstrated significant potential to impact various aspects of human life. However, ChatGPT still faces challenges in providing reliable and accurate answers to user questions. To better understand the model's particular weaknesses in providing truthful answers, we embark an in-depth exploration of open-domain question answering. Specifically, we undertake a detailed examination of ChatGPT's failures, categorized into: comprehension, factuality, specificity, and inference. We further pinpoint factuality as the most contributing failure and identify two critical abilities associated with factuality: knowledge memorization and knowledge recall. Through experiments focusing on factuality, we propose several potential enhancement strategies. Our findings suggest that augmenting the model with granular external knowledge and cues for knowledge recall can enhance the model's factuality in answering questions.
Code (0)
등록된 구현이 없습니다.
Tasks
MemorizationOpen-Domain Question AnsweringQuestion AnsweringSpecificitySimilar Papers 제목 키워드 기반
ChatGPT vs. Google: A Comparative Study of Search Performance and User Experience
The advent of ChatGPT, a large language model-powered chatbot, has prompted questions about its potential implications for traditional search engines. In this study, we investigate the differences in user behavior when e…
ChatbotFact CheckingLanguage ModellingLarge Language Model+2Can ChatGPT Understand Too? A Comparative Study on ChatGPT and Fine-tuned BERT
Recently, ChatGPT has attracted great attention, as it can generate fluent and high-quality responses to human inquiries. Several prior studies have shown that ChatGPT attains remarkable generation ability compared with …
Question AnsweringSentiment AnalysisTruthful Elicitation of Imprecise Forecasts
The quality of probabilistic forecasts is crucial for decision-making under uncertainty. While proper scoring rules incentivize truthful reporting of precise forecasts, they fall short when forecasters face epistemic unc…
Decision MakingDecision Making Under UncertaintyAssessing the Promise and Pitfalls of ChatGPT for Automated Code Generation
This paper presents a comprehensive evaluation of the code generation capabilities of ChatGPT, a prominent large language model, compared to human programmers. A novel dataset of 131 code-generation prompts across 5 cate…
Code GenerationLanguage ModelingLanguage ModellingLarge Language ModelEnhancing Language Model Factuality via Activation-Based Confidence Calibration and Guided Decoding
Calibrating language models (LMs) aligns their generation confidence with the actual likelihood of answer correctness, which can inform users about LMs' reliability and mitigate hallucinated content. However, prior calib…
Language ModelingLanguage ModellingTruthfulQA