LT@Helsinki at SemEval-2020 Task 12: Multilingual or language-specific BERT?

2020-08-03 · SEMEVAL 2020 · Marc Pàmies, Emily Öhman, Kaisla Kajava, Jörg Tiedemann

This paper presents the different models submitted by the LT@Helsinki team for the SemEval 2020 Shared Task 12. Our team participated in sub-tasks A and C; titled offensive language identification and offense target identification, respectively. In both cases we used the so-called Bidirectional Encoder Representation from Transformer (BERT), a model pre-trained by Google and fine-tuned by us on the OLID and SOLID datasets. The results show that offensive tweet classification is one of several language-based tasks where BERT can achieve state-of-the-art results.

📄 PDF Abstract BibTeX arXiv:2008.00805

Code (0)

등록된 구현이 없습니다.

Tasks

Language Identification

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.

Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…

Position-Wise Feed-Forward Layer 설명 없음

WordPiece 설명 없음

Linear Warmup With Linear Decay Linear Warmup With Linear Decay is a learning rate schedule in which we increase the learning rate linearly for $n$ updates and then linearly decay afterwards.

Refunds@Expedia|||How do I get a full refund from Expedia? “How do I get a full refund from Expedia? How do I get a full refund from Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Quick Help &…

Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…

Attention 설명 없음

Helsinki-NLP at SemEval-2022 Task 2: A Feature-Based Approach to Multilingual Idiomaticity Detection

2022-07-01 · SemEval (NAACL) 2022 7 · Sami Itkonen, Jörg Tiedemann, Mathias Creutz

This paper describes the University of Helsinki submission to the SemEval 2022 task on multilingual idiomaticity detection. Our system utilizes several models made available by HuggingFace, along with the baseline BERT m…

Feature Engineering Task 2

The Helsinki submission to the AmericasNLP shared task

2021-06-01 · NAACL (AmericasNLP) 2021 6 · Raúl Vázquez, Yves Scherrer, Sami Virpioja, Jörg Tiedemann

The University of Helsinki participated in the AmericasNLP shared task for all ten language pairs. Our multilingual NMT models reached the first rank on all language pairs in track 1, and first rank on nine out of ten la…

NMT

Comparing Multilingual NMT Models and Pivoting

2022-06-01 · EAMT 2022 6 · Celia Soler Uguet, Fred Bane, Anna Zaretskaya, Tània Blanch Miró

Following recent advancements in multilingual machine translation at scale, our team carried out tests to compare the performance of multilingual models (M2M from Facebook and multilingual models from Helsinki-NLP) with …

Machine Translation NMT Translation

The University of Helsinki submissions to the WMT18 news task

2018-10-01 · WS 2018 10 · Aless Raganato, ro, Yves Scherrer, Tommi Nieminen 외

This paper describes the University of Helsinki{'}s submissions to the WMT18 shared news translation task for English-Finnish and English-Estonian, in both directions. This year, our main submissions employ a novel neura…

Machine Translation Translation

SemEval 2023 Task 9: Multilingual Tweet Intimacy Analysis

2022-10-03 · Jiaxin Pei, Vítor Silva, Maarten Bos, Yozon Liu 외

We propose MINT, a new Multilingual INTimacy analysis dataset covering 13,372 tweets in 10 languages including English, French, Spanish, Italian, Portuguese, Korean, Dutch, Chinese, Hindi, and Arabic. We benchmarked a li…