Enhancing Flood Impact Analysis using Interactive Retrieval of Social Media Images
The analysis of natural disasters such as floods in a timely manner often suffers from limited data due to a coarse distribution of sensors or sensor failures. This limitation could be alleviated by leveraging information contained in images of the event posted on social media platforms, so-called "Volunteered Geographic Information (VGI)". To save the analyst from the need to inspect all images posted online manually, we propose to use content-based image retrieval with the possibility of relevance feedback for retrieving only relevant images of the event to be analyzed. To evaluate this approach, we introduce a new dataset of 3,710 flood images, annotated by domain experts regarding their relevance with respect to three tasks (determining the flooded area, inundation depth, water pollution). We compare several image features and relevance feedback methods on that dataset, mixed with 97,085 distractor images, and are able to improve the precision among the top 100 retrieval results from 55% with the baseline retrieval to 87% after 5 rounds of feedback.
Code (1)
Tasks
Content-Based Image RetrievalImage RetrievalRetrievalSimilar Papers 제목 키워드 기반
The ecological impact of flooding: a study of tree damage
The objective of this research was to identify factors affecting tree damage in the historical Minot flood of 2011. We hypothesized that tree height, identity, origin, and maximum water height affect in the severity of d…
Rethinking Urban Flood Risk Assessment By Adapting Health Domain Perspective
Inspired by ideas from health risk assessment, this paper presents a new perspective for flood risk assessment. The proposed perspective focuses on three pillars for examining flood risk: (1) inherent susceptibility, (2)…
CrisiSense-RAG: Crisis Sensing Multimodal Retrieval-Augmented Generation for Rapid Disaster Impact Assessment
Timely and spatially resolved disaster impact assessment is essential for effective emergency response. However, automated methods typically struggle with temporal asynchrony. Real-time human reports capture peak hazard …
FloodBrain: Flood Disaster Reporting by Web-based Retrieval Augmented Generation with an LLM
Fast disaster impact reporting is crucial in planning humanitarian assistance. Large Language Models (LLMs) are well known for their ability to write coherent text and fulfill a variety of tasks relevant to impact report…
HumanitarianQuestion AnsweringRetrievalRetrieval-augmented Generation+1ToolFlood: Beyond Selection -- Hiding Valid Tools from LLM Agents via Semantic Covering
Large Language Model (LLM) agents increasingly use external tools for complex tasks and rely on embedding-based retrieval to select a small top-k subset for reasoning. As these systems scale, the robustness of this retri…