paper-with-me

Papers

TextAug: Test time Text Augmentation for Multimodal Person Re-identification

2023-12-04 · Mulham Fawakherji, Eduard Vazquez, Pasquale Giampa, Binod Bhattarai

Multimodal Person Reidentification is gaining popularity in the research community due to its effectiveness compared to counter-part unimodal frameworks. However, the bottleneck for multimodal deep learning is the need for a large volume of multimodal training examples. Data augmentation techniques such as cropping, flipping, rotation, etc. are often employed in the image domain to improve the generalization of deep learning models. Augmenting in other modalities than images, such as text, is challenging and requires significant computational resources and external data sources. In this study, we investigate the effectiveness of two computer vision data augmentation techniques: cutout and cutmix, for text augmentation in multi-modal person re-identification. Our approach merges these two augmentation strategies into one strategy called CutMixOut which involves randomly removing words or sub-phrases from a sentence (Cutout) and blending parts of two or more sentences to create diverse examples (CutMix) with a certain probability assigned to each operation. This augmentation was implemented at inference time without any prior training. Our results demonstrate that the proposed technique is simple and effective in improving the performance on multiple multimodal person re-identification benchmarks.

📄 PDF Abstract BibTeX arXiv:2312.01605

Code (0)

등록된 구현이 없습니다.

Tasks

Data AugmentationMultimodal Deep LearningPerson Re-IdentificationSentenceText Augmentation

Methods 이 논문이 사용한 방법론

Cutout Cutout is an image augmentation and regularization technique that randomly masks out square regions of input during training. and can be used to improve the robustness and…

Similar Papers 제목 키워드 기반

Image, Text, and Speech Data Augmentation using Multimodal LLMs for Deep Learning: A Survey

2025-01-29 · Ranjan Sapkota, Shaina Raza, Maged Shoman, Achyut Paudel 외

In the past five years, research has shifted from traditional Machine Learning (ML) and Deep Learning (DL) approaches to leveraging Large Language Models (LLMs) , including multimodality, for data augmentation to enhance…

Data AugmentationImage AugmentationText Augmentation

Investigation of English to Hindi Multimodal Neural Machine Translation using Transliteration-based Phrase Pairs Augmentation

2022-10-01 · WAT 2022 10 · Sahinur Rahman Laskar, Rahul Singh, Md Faizal Karim, Riyanka Manna 외

Machine translation translates one natural language to another, a well-defined natural language processing task. Neural machine translation (NMT) is a widely accepted machine translation approach, but it requires a suffi…

Machine TranslationNMTTranslationTransliteration

Hybrid Multimodal Feature Extraction, Mining and Fusion for Sentiment Analysis

2022-08-05 · Jia Li, Ziyang Zhang, Junjie Lang, Yueqi Jiang 외

In this paper, we present our solutions for the Multimodal Sentiment Analysis Challenge (MuSe) 2022, which includes MuSe-Humor, MuSe-Reaction and MuSe-Stress Sub-challenges. The MuSe 2022 focuses on humor detection, emot…

Data AugmentationHumor DetectionMultimodal Sentiment AnalysisSentiment Analysis

English to Bengali Multimodal Neural Machine Translation using Transliteration-based Phrase Pairs Augmentation

2022-10-01 · WAT 2022 10 · Sahinur Rahman Laskar, Pankaj Dadure, Riyanka Manna, Partha Pakray 외

Automatic translation of one natural language to another is a popular task of natural language processing. Although the deep learning-based technique known as neural machine translation (NMT) is a widely accepted machine…

Machine TranslationNMTTranslationTransliteration

LIIR at SemEval-2021 task 6: Detection of Persuasion Techniques In Texts and Images using CLIP features

2021-05-31 · SEMEVAL 2021 · Erfan Ghadery, Damien Sileo, Marie-Francine Moens

We describe our approach for SemEval-2021 task 6 on detection of persuasion techniques in multimodal content (memes). Our system combines pretrained multimodal models (CLIP) and chained classifiers. Also, we propose to e…

Data Augmentation