Papers Evaluating Information Essentiality
“Evaluating Information Essentiality” 태그가 달린 논문 2편 · 필터 해제
Training Compute-Optimal Large Language Models
2022-03-29
· Jordan Hoffmann, Sebastian Borgeaud, Arthur Mensch, Elena Buchatskaya 외
We investigate the optimal model size and number of tokens for training a transformer language model under a given compute budget. We find that current large language models are significantly undertrained, a consequence …
AnachronismsAnalogical SimilarityAnalytic EntailmentCausal Judgment+69Scaling Language Models: Methods, Analysis & Insights from Training Gopher
2021-12-08 · NA 2021 12
· Jack W. Rae, Sebastian Borgeaud, Trevor Cai, Katie Millican 외
Language modelling provides a step towards intelligent communication systems by harnessing large repositories of written human knowledge to better predict and understand the world. In this paper, we present an analysis o…
Abstract AlgebraAnachronismsAnalogical SimilarityAnalytic Entailment+143
1–2 / 2