paper-with-me

홈 › Papers

Can ChatGPT's Responses Boost Traditional Natural Language Processing?

2023-07-06 · Mostafa M. Amin, Erik Cambria, Björn W. Schuller

The employment of foundation models is steadily expanding, especially with the launch of ChatGPT and the release of other foundation models. These models have shown the potential of emerging capabilities to solve problems, without being particularly trained to solve. A previous work demonstrated these emerging capabilities in affective computing tasks; the performance quality was similar to traditional Natural Language Processing (NLP) techniques, but falling short of specialised trained models, like fine-tuning of the RoBERTa language model. In this work, we extend this by exploring if ChatGPT has novel knowledge that would enhance existing specialised models when they are fused together. We achieve this by investigating the utility of verbose responses from ChatGPT about solving a downstream task, in addition to studying the utility of fusing that with existing NLP methods. The study is conducted on three affective computing problems, namely sentiment analysis, suicide tendency detection, and big-five personality assessment. The results conclude that ChatGPT has indeed novel knowledge that can improve existing NLP techniques by way of fusion, be it early or late fusion.

📄 PDF Abstract BibTeX arXiv:2307.04648

Code (1)

mostafa-mahmoud/chat-gpt-fusion-evaluation 공식 구현

Tasks

Language ModelingLanguage ModellingSentiment Analysis

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Attention Dropout Attention Dropout is a type of dropout used in attention-based architectures, where elements are randomly dropped out of the…
Weight Decay 설명 없음
Adam 설명 없음
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…

Similar Papers 제목 키워드 기반

Using ChatGPT to Score Essays and Short-Form Constructed Responses

2024-08-18 · Mark D. Shermis

This study aimed to determine if ChatGPT's large language models could match the scoring accuracy of human and machine scores from the ASAP competition. The investigation focused on various prediction models, including l…

FairnessForm

How Prevalent is Gender Bias in ChatGPT? -- Exploring German and English ChatGPT Responses

2023-09-21 · Stefanie Urchs, Veronika Thurner, Matthias Aßenmacher, Christian Heumann 외

With the introduction of ChatGPT, OpenAI made large language models (LLM) accessible to users with limited IT expertise. However, users with no background in natural language processing (NLP) might lack a proper understa…

Data-Efficient Alignment of Large Language Models with Human Feedback Through Natural Language

2023-11-24 · Di Jin, Shikib Mehri, Devamanyu Hazarika, Aishwarya Padmakumar 외

Learning from human feedback is a prominent technique to align the output of large language models (LLMs) with human expectations. Reinforcement learning from human feedback (RLHF) leverages human preference signals that…

Is English the New Programming Language? How About Pseudo-code Engineering?

2024-04-08 · Gian Alexandre Michaelsen, Renato P. dos Santos

Background: The integration of artificial intelligence (AI) into daily life, particularly through chatbots utilizing natural language processing (NLP), presents both revolutionary potential and unique challenges. This in…

Language ModellingPrompt Engineering

Unlocking the Potential of ChatGPT: A Comprehensive Exploration of its Applications, Advantages, Limitations, and Future Directions in Natural Language Processing

2023-03-27 · Walid Hariri

Large language models have revolutionized the field of artificial intelligence and have been used in various applications. Among these models, ChatGPT (Chat Generative Pre-trained Transformer) has been developed by OpenA…

Medical DiagnosisPrompt Engineering