Deep Learning Benchmarks and Datasets for Social Media Image Classification for Disaster Response
During a disaster event, images shared on social media helps crisis managers gain situational awareness and assess incurred damages, among other response tasks. Recent advances in computer vision and deep neural networks have enabled the development of models for real-time image classification for a number of tasks, including detecting crisis incidents, filtering irrelevant images, classifying images into specific humanitarian categories, and assessing the severity of damage. Despite several efforts, past works mainly suffer from limited resources (i.e., labeled images) available to train more robust deep learning models. In this study, we propose new datasets for disaster type detection, and informativeness classification, and damage severity assessment. Moreover, we relabel existing publicly available datasets for new tasks. We identify exact- and near-duplicates to form non-overlapping data splits, and finally consolidate them to create larger datasets. In our extensive experiments, we benchmark several state-of-the-art deep learning models and achieve promising results. We release our datasets and models publicly, aiming to provide proper baselines as well as to spur further research in the crisis informatics community.
Code (0)
등록된 구현이 없습니다.
Tasks
Disaster ResponseGeneral ClassificationHumanitarianimage-classificationImage ClassificationInformativenessSimilar Papers 제목 키워드 기반
Borrowing Human Senses: Comment-Aware Self-Training for Social Media Multimodal Classification
Social media is daily creating massive multimedia content with paired image and text, presenting the pressing need to automate the vision and language understanding for various multimodal classification tasks. Compared t…
ClassificationHate Speech DetectionRelation ClassificationSarcasm Detection+2Graph-Hist: Graph Classification from Latent Feature Histograms With Application to Bot Detection
Neural networks are increasingly used for graph classification in a variety of contexts. Social media is a critical application area in this space, however the characteristics of social media graphs differ from those see…
General ClassificationGraph ClassificationCrisisBench: Benchmarking Crisis-related Social Media Datasets for Humanitarian Information Processing
Time-critical analysis of social media streams is important for humanitarian organizations for planing rapid response during disasters. The \textit{crisis informatics} research community has developed several techniques …
BenchmarkingGeneral ClassificationHumanitarianInformativenessBenchmarking of Transformer-Based Pre-Trained Models on Social Media Text Classification Datasets
Free text data from social media is now widely used in natural language processing research, and one of the most common machine learning tasks performed on this data is classification. Generally speaking, performances of…
BenchmarkingClassificationtext-classificationText ClassificationSuper Characters: A Conversion from Sentiment Classification to Image Classification
We propose a method named Super Characters for sentiment classification. This method converts the sentiment classification problem into image classification problem by projecting texts into images and then applying CNN m…
ClassificationGeneral Classificationimage-classificationImage Classification+3