paper-with-me

홈 › Papers

GPT-3.5, GPT-4, or BARD? Evaluating LLMs Reasoning Ability in Zero-Shot Setting and Performance Boosting Through Prompts

2023-05-21 · Jessica López Espejel, El Hassane Ettifouri, Mahaman Sanoussi Yahaya Alassan, El Mehdi Chouham, Walid Dahhane

Large Language Models (LLMs) have exhibited remarkable performance on various Natural Language Processing (NLP) tasks. However, there is a current hot debate regarding their reasoning capacity. In this paper, we examine the performance of GPT-3.5, GPT-4, and BARD models, by performing a thorough technical evaluation on different reasoning tasks across eleven distinct datasets. Our paper provides empirical evidence showcasing the superior performance of ChatGPT-4 in comparison to both ChatGPT-3.5 and BARD in zero-shot setting throughout almost all evaluated tasks. While the superiority of GPT-4 compared to GPT-3.5 might be explained by its larger size and NLP efficiency, this was not evident for BARD. We also demonstrate that the three models show limited proficiency in Inductive, Mathematical, and Multi-hop Reasoning Tasks. To bolster our findings, we present a detailed and comprehensive analysis of the results from these three models. Furthermore, we propose a set of engineered prompts that enhances the zero-shot setting performance of all three models.

📄 PDF Abstract BibTeX arXiv:2305.12477

Code (0)

등록된 구현이 없습니다.

Tasks

Zero-Shot Learning

Methods 이 논문이 사용한 방법론

15 Ways to Contact How can i speak to someone at Delta Airlines 설명 없음
Multi-Head Attention 설명 없음
Attention 설명 없음
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Position-Wise Feed-Forward Layer 설명 없음
Transformer A Transformer is a model architecture that eschews recurrence and instead relies entirely on an [attention…
Cosine Annealing Cosine Annealing is a type of learning rate schedule that has the effect of starting with a large learning rate that is relatively rapidly decreased to a minimum value before…

Similar Papers 제목 키워드 기반

Multimodal Analysis Of Google Bard And GPT-Vision: Experiments In Visual Reasoning

2023-08-17 · David Noever, Samantha Elizabeth Miller Noever

Addressing the gap in understanding visual comprehension in Large Language Models (LLMs), we designed a challenge-response study, subjecting Google Bard and GPT-Vision to 64 visual tasks, spanning categories like "Visual…

Common Sense ReasoningOptical Character RecognitionVisual Reasoning

How Robust is Google's Bard to Adversarial Image Attacks?

2023-09-21 · Yinpeng Dong, Huanran Chen, Jiawei Chen, Zhengwei Fang 외

Multimodal Large Language Models (MLLMs) that integrate text and other modalities (especially vision) have achieved unprecedented performance in various multimodal tasks. However, due to the unsolved adversarial robustne…

Adversarial RobustnessChatbotFace Detection

BARD: budget-aware reasoning distillation

2025-11-03 · Lujie Niu, Lei Shen, Yi Jiang, Caixia Yuan 외 arxiv

While long Chain-of-Thought (CoT) distillation effectively transfers reasoning capability to smaller language models, the reasoning process often remains redundant and computational budget uncontrollable, leading to inef…

Computational EfficiencyReinforcement Learning

TARJAMAT: Evaluation of Bard and ChatGPT on Machine Translation of Ten Arabic Varieties

2023-08-06 · Karima Kadaoui, Samar M. Magdy, Abdul Waheed, Md Tawkat Islam Khondaker 외

Despite the purported multilingual proficiency of instruction-finetuned large language models (LLMs) such as ChatGPT and Bard, the linguistic inclusivity of these models remains insufficiently explored. Considering this …

Dialogue GenerationMachine TranslationQuestion AnsweringTranslation

Evaluating Large Language Models on a Highly-specialized Topic, Radiation Oncology Physics

2023-04-01 · Jason Holmes, Zhengliang Liu, Lian Zhang, Yuzhen Ding 외

We present the first study to investigate Large Language Models (LLMs) in answering radiation oncology physics questions. Because popular exams like AP Physics, LSAT, and GRE have large test-taker populations and ample t…