LiT-4-RSVQA: Lightweight Transformer-based Visual Question Answering in Remote Sensing
Visual question answering (VQA) methods in remote sensing (RS) aim to answer natural language questions with respect to an RS image. Most of the existing methods require a large amount of computational resources, which limits their application in operational scenarios in RS. To address this issue, in this paper we present an effective lightweight transformer-based VQA in RS (LiT-4-RSVQA) architecture for efficient and accurate VQA in RS. Our architecture consists of: i) a lightweight text encoder module; ii) a lightweight image encoder module; iii) a fusion module; and iv) a classification module. The experimental results obtained on a VQA benchmark dataset demonstrate that our proposed LiT-4-RSVQA architecture provides accurate VQA results while significantly reducing the computational requirements on the executing hardware. Our code is publicly available at https://git.tu-berlin.de/rsim/lit4rsvqa.
Code (0)
등록된 구현이 없습니다.
Tasks
Question AnsweringVisual Question AnsweringVisual Question Answering (VQA)Similar Papers 제목 키워드 기반
Multilingual Augmentation for Robust Visual Question Answering in Remote Sensing Images
Aiming at answering questions based on the content of remotely sensed images, visual question answering for remote sensing data (RSVQA) has attracted much attention nowadays. However, previous works in RSVQA have focused…
Contrastive LearningQuestion AnsweringVisual Question AnsweringFrom Easy to Hard: Learning Language-guided Curriculum for Visual Question Answering on Remote Sensing Data
Visual question answering (VQA) for remote sensing scene has great potential in intelligent human-computer interaction system. Although VQA in computer vision has been widely researched, VQA for remote sensing data (RSVQ…
Question AnsweringVisual Question AnsweringVisual Question Answering (VQA)Multi-Modal Fusion Transformer for Visual Question Answering in Remote Sensing
With the new generation of satellite technologies, the archives of remote sensing (RS) images are growing very fast. To make the intrinsic information of each RS image easily accessible, visual question answering (VQA) h…
Question AnsweringRepresentation LearningVisual Question AnsweringVisual Question Answering (VQA)ParsVQA-Caps: A Benchmark for Visual Question Answering and Image Captioning in Persian
Despite recent advances in vision-and-language tasks, most progress is still focused on resource-rich languages such as English. Furthermore, widespread vision-and-language datasets directly adopt images representative o…
Image CaptioningQuestion AnsweringVisual Question AnsweringVisual Question Answering (VQA)Large Vision-Language Models for Remote Sensing Visual Question Answering
Remote Sensing Visual Question Answering (RSVQA) is a challenging task that involves interpreting complex satellite imagery to answer natural language questions. Traditional approaches often rely on separate visual featu…
Language ModelingLanguage ModellingQuestion AnsweringVisual Question Answering