LT3 at SemEval-2020 Task 8: Multi-Modal Multi-Task Learning for Memotion Analysis
Internet memes have become a very popular mode of expression on social media networks today. Their multi-modal nature, caused by a mixture of text and image, makes them a very challenging research object for automatic analysis. In this paper, we describe our contribution to the SemEval-2020 Memotion Analysis Task. We propose a Multi-Modal Multi-Task learning system, which incorporates {``}memebeddings{''}, viz. joint text and vision features, to learn and optimize for all three Memotion subtasks simultaneously. The experimental results show that the proposed system constantly outperforms the competition{'}s baseline, and the system setup with continual learning (where tasks are trained sequentially) obtains the best classification F1-scores.
Code (0)
등록된 구현이 없습니다.
Tasks
Continual LearningMulti-Task LearningSimilar Papers 제목 키워드 기반
taochen at SemEval-2022 Task 5: Multimodal Multitask Learning and Ensemble Learning
We present a multi-modal deep learning system for the Multimedia Automatic Misogyny Identification (MAMI) challenge, a SemEval task of identifying and classifying misogynistic messages in online memes. We adapt multi-tas…
Ensemble LearningMulti-Task LearningIIITH at SemEval-2022 Task 5: A comparative study of deep learning models for identifying misogynous memes
This paper provides a comparison of different deep learning methods for identifying misogynous memes for SemEval-2022 Task 5: Multimedia Automatic Misogyny Identification. In this task, we experiment with architectures i…
Deep LearningMIPS at SemEval-2024 Task 3: Multimodal Emotion-Cause Pair Extraction in Conversations with Multimodal Language Models
This paper presents our winning submission to Subtask 2 of SemEval 2024 Task 3 on multimodal emotion cause analysis in conversations. We propose a novel Multimodal Emotion Recognition and Multimodal Emotion Cause Extract…
Emotion Cause ExtractionEmotion-Cause Pair ExtractionEmotion RecognitionMultimodal Emotion RecognitionLyS at SemEval-2024 Task 3: An Early Prototype for End-to-End Multimodal Emotion Linking as Graph-Based Parsing
This paper describes our participation in SemEval 2024 Task 3, which focused on Multimodal Emotion Cause Analysis in Conversations. We developed an early prototype for an end-to-end system that uses graph-based methods f…
DecoderDependency ParsingvalidLIIR at SemEval-2021 task 6: Detection of Persuasion Techniques In Texts and Images using CLIP features
We describe our approach for SemEval-2021 task 6 on detection of persuasion techniques in multimodal content (memes). Our system combines pretrained multimodal models (CLIP) and chained classifiers. Also, we propose to e…
Data Augmentation