paper-with-me

Papers

Large Vision-Language Models for Remote Sensing Visual Question Answering

2024-11-16 · Surasakdi Siripong, Apirak Chaiyapan, Thanakorn Phonchai

Remote Sensing Visual Question Answering (RSVQA) is a challenging task that involves interpreting complex satellite imagery to answer natural language questions. Traditional approaches often rely on separate visual feature extractors and language processing models, which can be computationally intensive and limited in their ability to handle open-ended questions. In this paper, we propose a novel method that leverages a generative Large Vision-Language Model (LVLM) to streamline the RSVQA process. Our approach consists of a two-step training strategy: domain-adaptive pretraining and prompt-based finetuning. This method enables the LVLM to generate natural language answers by conditioning on both visual and textual inputs, without the need for predefined answer categories. We evaluate our model on the RSVQAxBEN dataset, demonstrating superior performance compared to state-of-the-art baselines. Additionally, a human evaluation study shows that our method produces answers that are more accurate, relevant, and fluent. The results highlight the potential of generative LVLMs in advancing the field of remote sensing analysis.

📄 PDF Abstract BibTeX arXiv:2411.10857

Code (0)

등록된 구현이 없습니다.

Tasks

Language ModelingLanguage ModellingQuestion AnsweringVisual Question Answering

Similar Papers 제목 키워드 기반

FUSE-RSVLM: Feature Fusion Vision-Language Model for Remote Sensing

2025-12-30 · Yunkai Dang, Donghao Wang, Jiacheng Yang, Yifan Jiang 외 arxiv

Large vision-language models (VLMs) exhibit strong performance across various tasks. However, these VLMs encounter significant challenges when applied to the remote sensing domain due to the inherent differences between …

Image Captioning

VRSBench: A Versatile Vision-Language Benchmark Dataset for Remote Sensing Image Understanding

2024-06-18 · Xiang Li, Jian Ding, Mohamed Elhoseiny

We introduce a new benchmark designed to advance the development of general-purpose, large-scale vision-language models for remote sensing images. Although several vision-language datasets in remote sensing have been pro…

Image CaptioningQuestion AnsweringVisual GroundingVisual Question Answering

Remote Sensing Vision-Language Foundation Models without Annotations via Ground Remote Alignment

2023-12-12 · Utkarsh Mall, Cheng Perng Phoo, Meilin Kelsey Liu, Carl Vondrick 외

We introduce a method to train vision-language models for remote-sensing images without using any textual annotations. Our key insight is to use co-located internet imagery taken on the ground as an intermediary for conn…

image-classificationImage ClassificationLanguage ModelingLanguage Modelling+5

SkyNative: A Native Multimodal Framework for Remote Sensing Visual Evidence Reasoning

2026-05-18 · Xiao Yang, Ronghao Fu, Zhiwen Lin, Zhuoran Duan 외 arxiv

Remote sensing vision-language models commonly rely on pretrained visual encoders to convert images into semantic features before language-model reasoning. While effective for scene-level understanding, this pipeline may…

Spatial Reasoning

Aquila: A Hierarchically Aligned Visual-Language Model for Enhanced Remote Sensing Image Comprehension

2024-11-09 · Kaixuan Lu, Ruiqian Zhang, Xiao Huang, Yuxing Xie

Recently, large vision language models (VLMs) have made significant strides in visual language capabilities through visual instruction tuning, showing great promise in the field of remote sensing image interpretation. Ho…

Image ComprehensionLanguage ModelingLanguage ModellingLarge Language Model