TextAug: Test time Text Augmentation for Multimodal Person Re-identification
Multimodal Person Reidentification is gaining popularity in the research community due to its effectiveness compared to counter-part unimodal frameworks. However, the bottleneck for multimodal deep learning is the need for a large volume of multimodal training examples. Data augmentation techniques such as cropping, flipping, rotation, etc. are often employed in the image domain to improve the generalization of deep learning models. Augmenting in other modalities than images, such as text, is challenging and requires significant computational resources and external data sources. In this study, we investigate the effectiveness of two computer vision data augmentation techniques: cutout and cutmix, for text augmentation in multi-modal person re-identification. Our approach merges these two augmentation strategies into one strategy called CutMixOut which involves randomly removing words or sub-phrases from a sentence (Cutout) and blending parts of two or more sentences to create diverse examples (CutMix) with a certain probability assigned to each operation. This augmentation was implemented at inference time without any prior training. Our results demonstrate that the proposed technique is simple and effective in improving the performance on multiple multimodal person re-identification benchmarks.
Code (0)
등록된 구현이 없습니다.
Tasks
Data AugmentationMultimodal Deep LearningPerson Re-IdentificationSentenceText AugmentationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Image, Text, and Speech Data Augmentation using Multimodal LLMs for Deep Learning: A Survey
In the past five years, research has shifted from traditional Machine Learning (ML) and Deep Learning (DL) approaches to leveraging Large Language Models (LLMs) , including multimodality, for data augmentation to enhance…
Data AugmentationImage AugmentationText AugmentationInvestigation of English to Hindi Multimodal Neural Machine Translation using Transliteration-based Phrase Pairs Augmentation
Machine translation translates one natural language to another, a well-defined natural language processing task. Neural machine translation (NMT) is a widely accepted machine translation approach, but it requires a suffi…
Machine TranslationNMTTranslationTransliterationHybrid Multimodal Feature Extraction, Mining and Fusion for Sentiment Analysis
In this paper, we present our solutions for the Multimodal Sentiment Analysis Challenge (MuSe) 2022, which includes MuSe-Humor, MuSe-Reaction and MuSe-Stress Sub-challenges. The MuSe 2022 focuses on humor detection, emot…
Data AugmentationHumor DetectionMultimodal Sentiment AnalysisSentiment AnalysisEnglish to Bengali Multimodal Neural Machine Translation using Transliteration-based Phrase Pairs Augmentation
Automatic translation of one natural language to another is a popular task of natural language processing. Although the deep learning-based technique known as neural machine translation (NMT) is a widely accepted machine…
Machine TranslationNMTTranslationTransliterationLIIR at SemEval-2021 task 6: Detection of Persuasion Techniques In Texts and Images using CLIP features
We describe our approach for SemEval-2021 task 6 on detection of persuasion techniques in multimodal content (memes). Our system combines pretrained multimodal models (CLIP) and chained classifiers. Also, we propose to e…
Data Augmentation