Papers Discourse Marker Prediction
“Discourse Marker Prediction” 태그가 달린 논문 3편 · 필터 해제
RST Discourse Parsing with Second-Stage EDU-Level Pre-training
2022-05-01 · ACL 2022 5
· Nan Yu, Meishan Zhang, Guohong Fu, Min Zhang
Pre-trained language models (PLMs) have shown great potentials in natural language processing (NLP) including rhetorical structure theory (RST) discourse parsing.Current PLMs are obtained by sentence-level pre-training, …
Discourse Marker PredictionDiscourse ParsingSentenceTraining Compute-Optimal Large Language Models
2022-03-29
· Jordan Hoffmann, Sebastian Borgeaud, Arthur Mensch, Elena Buchatskaya 외
We investigate the optimal model size and number of tokens for training a transformer language model under a given compute budget. We find that current large language models are significantly undertrained, a consequence …
AnachronismsAnalogical SimilarityAnalytic EntailmentCausal Judgment+69Scaling Language Models: Methods, Analysis & Insights from Training Gopher
2021-12-08 · NA 2021 12
· Jack W. Rae, Sebastian Borgeaud, Trevor Cai, Katie Millican 외
Language modelling provides a step towards intelligent communication systems by harnessing large repositories of written human knowledge to better predict and understand the world. In this paper, we present an analysis o…
Abstract AlgebraAnachronismsAnalogical SimilarityAnalytic Entailment+143
1–3 / 3