paper-with-me

홈 › Papers

Understanding the Capabilities, Limitations, and Societal Impact of Large Language Models

2021-02-04 · Alex Tamkin, Miles Brundage, Jack Clark, Deep Ganguli

On October 14th, 2020, researchers from OpenAI, the Stanford Institute for Human-Centered Artificial Intelligence, and other universities convened to discuss open research questions surrounding GPT-3, the largest publicly-disclosed dense language model at the time. The meeting took place under Chatham House Rules. Discussants came from a variety of research backgrounds including computer science, linguistics, philosophy, political science, communications, cyber policy, and more. Broadly, the discussion centered around two main questions: 1) What are the technical capabilities and limitations of large language models? 2) What are the societal effects of widespread use of large language models? Here, we provide a detailed summary of the discussion organized by the two themes above.

📄 PDF Abstract BibTeX arXiv:2102.02503

Code (0)

등록된 구현이 없습니다.

Tasks

Language ModelingLanguage ModellingPhilosophy

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Cosine Annealing Cosine Annealing is a type of learning rate schedule that has the effect of starting with a large learning rate that is relatively rapidly decreased to a minimum value before…
Attention 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Refunds@Expedia|||How do I get a full refund from Expedia? “How do I get a full refund from Expedia? How do I get a full refund from Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Quick Help &…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Residual Connection 설명 없음

Similar Papers 제목 키워드 기반

Decoding Large-Language Models: A Systematic Overview of Socio-Technical Impacts, Constraints, and Emerging Questions

2024-09-25 · Zeyneb N. Kaya, Souvick Ghosh

There have been rapid advancements in the capabilities of large language models (LLMs) in recent years, greatly revolutionizing the field of natural language processing (NLP) and artificial intelligence (AI) to understan…

Societal Impacts Research Requires Benchmarks for Creative Composition Tasks

2025-04-09 · Judy Hanwen Shen, Carlos Guestrin

Foundation models that are capable of automating cognitive tasks represent a pivotal technological shift, yet their societal implications remain unclear. These systems promise exciting advances, yet they also risk floodi…

Language ModelingLanguage Modelling

SIDE: Socially Informed Drought Estimation Toward Understanding Societal Impact Dynamics of Environmental Crisis

2024-12-17 · Lanyu Shang, Bozhang Chen, Shiwei Liu, Yang Zhang 외

Drought has become a critical global threat with significant societal impact. Existing drought monitoring solutions primarily focus on assessing drought severity using quantitative measurements, overlooking the diverse s…

Cutting Through the Confusion and Hype: Understanding the True Potential of Generative AI

2024-10-22 · Ante Prodan, Jo-An Occhipinti, Rehez Ahlip, Goran Ujdur 외

This paper explores the nuanced landscape of generative AI (genAI), particularly focusing on neural network-based models like Large Language Models (LLMs). While genAI garners both optimistic enthusiasm and sceptical cri…

Generative Large Language Models in Automated Fact-Checking: A Survey

2024-07-02 · Ivan Vykopal, Matúš Pikuliak, Simon Ostermann, Marián Šimko

The dissemination of false information on online platforms presents a serious societal challenge. While manual fact-checking remains crucial, Large Language Models (LLMs) offer promising opportunities to support fact-che…

Fact CheckingSurvey