paper-with-me

Papers

From text to multimodal: a survey of adversarial example generation in question answering systems

2023-12-26 · Gulsum Yigit, Mehmet Fatih Amasyali

Integrating adversarial machine learning with Question Answering (QA) systems has emerged as a critical area for understanding the vulnerabilities and robustness of these systems. This article aims to comprehensively review adversarial example-generation techniques in the QA field, including textual and multimodal contexts. We examine the techniques employed through systematic categorization, providing a comprehensive, structured review. Beginning with an overview of traditional QA models, we traverse the adversarial example generation by exploring rule-based perturbations and advanced generative models. We then extend our research to include multimodal QA systems, analyze them across various methods, and examine generative models, seq2seq architectures, and hybrid methodologies. Our research grows to different defense strategies, adversarial datasets, and evaluation metrics and illustrates the comprehensive literature on adversarial QA. Finally, the paper considers the future landscape of adversarial question generation, highlighting potential research directions that can advance textual and multimodal QA systems in the context of adversarial challenges.

📄 PDF Abstract BibTeX arXiv:2312.16156

Code (0)

등록된 구현이 없습니다.

Tasks

Question AnsweringQuestion GenerationQuestion-Generation

Methods 이 논문이 사용한 방법론

Sigmoid Activation 설명 없음
Tanh Activation 설명 없음
LSTM An LSTM is a type of recurrent neural network that addresses the vanishing gradient problem in vanilla…
Seq2Seq Seq2Seq, or Sequence To Sequence, is a model used in sequence prediction tasks, such as language modelling and machine translation. The idea is to use one…

Similar Papers 제목 키워드 기반

Adversarial Attacks in Multimodal Systems: A Practitioner's Survey

2025-05-06 · Shashank Kapoor, Sanjay Surendranath Girija, Lakshit Arora, Dipen Pradhan 외

The introduction of multimodal models is a huge step forward in Artificial Intelligence. A single model is trained to understand multiple modalities: text, image, video, and audio. Open-source multimodal models have made…

Adversarial AttackSurvey

Towards a Robust Deep Neural Network in Texts: A Survey

2019-02-12 · Wenqi Wang, Run Wang, Lina Wang, Zhibo Wang 외

Deep neural networks (DNNs) have achieved remarkable success in various tasks (e.g., image classification, speech recognition, and natural language processing (NLP)). However, researchers have demonstrated that DNN-based…

General Classificationimage-classificationImage Classificationspeech-recognition+2

A Survey on Bridging EEG Signals and Generative AI: From Image and Text to Beyond

2025-02-17 · Shreya Shukla, Jose Torres, Abhijit Mishra, Jacek Gwizdka 외

Integration of Brain-Computer Interfaces (BCIs) and Generative Artificial Intelligence (GenAI) has opened new frontiers in brain signal decoding, enabling assistive communication, neural representation learning, and mult…

Contrastive LearningEEGImage Generationmultimodal generation+3

Iterative Adversarial Attack on Image-guided Story Ending Generation

2023-05-16 · Youze Wang, WenBo Hu, Richang Hong

Multimodal learning involves developing models that can integrate information from various sources like images and texts. In this field, multimodal text generation is a crucial aspect that involves processing data from m…

Adversarial AttackAdversarial RobustnessAdversarial TextImage-guided Story Ending Generation+4

Adversarial Attacks on Multimodal Large Language Models: A Comprehensive Survey

2026-03-30 · Bhavuk Jain, Sercan Ö. Arık, Hardeo K. Thakur arxiv

Multimodal large language models (MLLMs) integrate information from multiple modalities such as text, images, audio, and video, enabling complex capabilities such as visual question answering and audio translation. While…

Visual Question Answering