Location Prediction of Social Images via Generative Model
The vast amount of geo-tagged social images has attracted great attention in research of predicting location using the plentiful content of images, such as visual content and textual description. Most of the existing researches use the text-based or vision-based method to predict location. There still exists a problem: how to effectively exploit the correlation between different types of content as well as their geographical distributions for location prediction. In this paper, we propose to predict image location by learning the latent relation between geographical location and multiple types of image content. In particularly, we propose a geographical topic model GTMI (geographical topic model of social image) to integrate multiple types of image content as well as the geographical distributions, In GTMI, image topic is modeled on both text vocabulary and visual feature. Each region has its own distribution over topics and hence has its own language model and vision pattern. The location of a new image is estimated based on the joint probability of image content and similarity measure on topic distribution between images. Experiment results demonstrate the performance of location prediction based on GTMI.
Code (0)
등록된 구현이 없습니다.
Tasks
Language ModelingLanguage ModellingmodelPredictionSimilar Papers 제목 키워드 기반
Multi-modal Representation Learning for Social Post Location Inference
Inferring geographic locations via social posts is essential for many practical location-based applications such as product marketing, point-of-interest recommendation, and infector tracking for COVID-19. Unlike image-ba…
MarketingRepresentation LearningRetrievalAssessing the Geolocation Capabilities, Limitations and Societal Risks of Generative Vision-Language Models
Geo-localization is the task of identifying the location of an image using visual cues alone. It has beneficial applications, such as improving disaster response, enhancing navigation, and geography education. Recently, …
Leveraging Selective Prediction for Reliable Image Geolocation
Reliable image geolocation is crucial for several applications, ranging from social media geo-tagging to fake news detection. State-of-the-art geolocation methods surpass human performance on the task of geolocation esti…
Fake News DetectionPredictionPredicting Opioid Relapse Using Social Media Data
Opioid addiction is a severe public health threat in the U.S, causing massive deaths and many social problems. Accurate relapse prediction is of practical importance for recovering patients since relapse prediction promo…
Next Check-ins Prediction via History and Friendship on Location-Based Social Networks
With the thriving of location-based social networks, a large number of user check-in data have been accumulated. Tasks such as the prediction of the next check-in location can be addressed through the usage of LBSN data.…
Collaborative FilteringPrediction