paper-with-me

홈 › Papers

A Critical Review of Large Language Models: Sensitivity, Bias, and the Path Toward Specialized AI

2023-07-28 · Arash Hajikhani, Carolyn Cole

This paper examines the comparative effectiveness of a specialized compiled language model and a general-purpose model like OpenAI's GPT-3.5 in detecting SDGs within text data. It presents a critical review of Large Language Models (LLMs), addressing challenges related to bias and sensitivity. The necessity of specialized training for precise, unbiased analysis is underlined. A case study using a company descriptions dataset offers insight into the differences between the GPT-3.5 and the specialized SDG detection model. While GPT-3.5 boasts broader coverage, it may identify SDGs with limited relevance to the companies' activities. In contrast, the specialized model zeroes in on highly pertinent SDGs. The importance of thoughtful model selection is emphasized, taking into account task requirements, cost, complexity, and transparency. Despite the versatility of LLMs, the use of specialized models is suggested for tasks demanding precision and accuracy. The study concludes by encouraging further research to find a balance between the capabilities of LLMs and the need for domain-specific expertise and interpretability.

📄 PDF Abstract BibTeX arXiv:2307.15425

Code (0)

등록된 구현이 없습니다.

Tasks

Language ModelingLanguage ModellingModel SelectionSensitivity

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Attention Dropout Attention Dropout is a type of dropout used in attention-based architectures, where elements are randomly dropped out of the…
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Multi-Head Attention 설명 없음
Residual Connection 설명 없음
Cosine Annealing Cosine Annealing is a type of learning rate schedule that has the effect of starting with a large learning rate that is relatively rapidly decreased to a minimum value before…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…

Similar Papers 제목 키워드 기반

Bias in Large Language Models: Origin, Evaluation, and Mitigation

2024-11-16 · Yufei Guo, Muzhe Guo, Juntao Su, Zhou Yang 외

Large Language Models (LLMs) have revolutionized natural language processing, but their susceptibility to biases poses significant challenges. This comprehensive review examines the landscape of bias in LLMs, from its or…

Bias Detection

Scaling Test-Time Robustness of Vision-Language Models via Self-Critical Inference Framework

2026-03-08 · Kaihua Tang, Jiaxin Qi, Jinli Ou, Yuhua Zheng 외 arxiv

The emergence of Large Language Models (LLMs) has driven rapid progress in multi-modal learning, particularly in the development of Large Vision-Language Models (LVLMs). However, existing LVLM training paradigms place ex…

Disparities in Peer Review Tone and the Role of Reviewer Anonymity

2025-07-19 · Maria Sahakyan, Bedoor AlShebli arxiv

The peer review process is often regarded as the gatekeeper of scientific integrity, yet increasing evidence suggests that it is not immune to bias. Although structural inequities in peer review have been widely debated,…

Aspect-Guided Multi-Level Perturbation Analysis of Large Language Models in Automated Peer Review

2025-02-18 · Jiatao Li, Yanheng Li, Xinyu Hu, Mingqi Gao 외

We propose an aspect-guided, multi-level perturbation framework to evaluate the robustness of Large Language Models (LLMs) in automated peer review. Our framework explores perturbations in three key components of the pee…

STOP! Benchmarking Large Language Models with Sensitivity Testing on Offensive Progressions

2024-09-20 · Robert Morabito, Sangmitra Madhusudan, Tyler McDonald, Ali Emami

Mitigating explicit and implicit biases in Large Language Models (LLMs) has become a critical focus in the field of natural language processing. However, many current methodologies evaluate scenarios in isolation, withou…

BenchmarkingSensitivity