paper-with-me

BLOOM

2000년 도입 · 논문 116편에서 사용

BLOOM is a decoder-only Transformer language model that was trained on the ROOTS corpus, a dataset comprising hundreds of sources in 46 natural and 13 programming languages (59 in total).

출처: BLOOM: A 176B-Parameter Open-Access Multilingual Language Model

소개 논문: BLOOM: A 176B-Parameter Open-Access Multilingual Language Model

Language Models · Natural Language Processing