Figure Eight at SemEval-2019 Task 3: Ensemble of Transfer Learning Methods for Contextual Emotion Detection

2019-06-01 · SEMEVAL 2019 6 · Joan Xiao

This paper describes our transfer learning-based approach to contextual emotion detection as part of SemEval-2019 Task 3. We experiment with transfer learning using pre-trained language models (ULMFiT, OpenAI GPT, and BERT) and fine-tune them on this task. We also train a deep learning model from scratch using pre-trained word embeddings and BiLSTM architecture with attention mechanism. The ensembled model achieves competitive result, ranking ninth out of 165 teams. The result reveals that ULMFiT performs best due to its superior fine-tuning techniques. We propose improvements for future work.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Transfer LearningWord Embeddings

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.

Cosine Annealing Cosine Annealing is a type of learning rate schedule that has the effect of starting with a large learning rate that is relatively rapidly decreased to a minimum value before…

Linear Warmup With Linear Decay Linear Warmup With Linear Decay is a learning rate schedule in which we increase the learning rate linearly for $n$ updates and then linearly decay afterwards.

WordPiece 설명 없음

BERT BERT, or Bidirectional Encoder Representations from Transformers, improves upon standard Transformers by removing the…

Sigmoid Activation 설명 없음

Tanh Activation 설명 없음

Weight Decay 설명 없음

KEIS@JUST at SemEval-2020 Task 12: Identifying Multilingual Offensive Tweets Using Weighted Ensemble and Fine-Tuned BERT

2020-05-15 · SEMEVAL 2020 · Saja Khaled Tawalbeh, Mahmoud Hammad, Mohammad AL-Smadi

This research presents our team KEIS@JUST participation at SemEval-2020 Task 12 which represents shared task on multilingual offensive language. We participated in all the provided languages for all subtasks except sub-t…

Data Augmentation Transfer Learning

ICT-NLP at SemEval-2026 Task 3: Less Is More -- Multilingual Encoder with Joint Training and Adaptive Ensemble for Dimensional Aspect Sentiment Regression

2026-05-11 · Liyuan Huang, Jiawei He, Wutao Shen, Lin Li 외 arxiv

This paper describes our system to SemEval-2026 Task 3 Track A Subtask 1 on Dimensional Aspect Sentiment Regression (DimASR). We propose a lightweight and resource-efficient system built entirely on multilingual pre-trai…

Cross-Lingual Transfer

TTUI at SemEval-2020 Task 11: Propaganda Detection with Transfer Learning and Ensembles

2020-12-01 · SEMEVAL 2020 · Moonsung Kim, Steven Bethard

In this paper, we describe our approaches and systems for the SemEval-2020 Task 11 on propaganda technique detection. We fine-tuned BERT and RoBERTa pre-trained models then merged them with an average ensemble. We conduc…

Propaganda detection Transfer Learning

taochen at SemEval-2022 Task 5: Multimodal Multitask Learning and Ensemble Learning

2022-07-01 · SemEval (NAACL) 2022 7 · Chen Tao, Jung-jae Kim

We present a multi-modal deep learning system for the Multimedia Automatic Misogyny Identification (MAMI) challenge, a SemEval task of identifying and classifying misogynistic messages in online memes. We adapt multi-tas…

Ensemble Learning Multi-Task Learning

aueb.twitter.sentiment at SemEval-2016 Task 4: A Weighted Ensemble of SVMs for Twitter Sentiment Analysis

2016-06-01 · SEMEVAL 2016 6 · Stavros Giorgis, Apostolos Rousas, John Pavlopoulos, Prodromos Malakasiotis 외

Sentiment Analysis Twitter Sentiment Analysis Word Embeddings