paper-with-me

Papers

Evaluating Precise Geolocation Inference Capabilities of Vision Language Models

2025-02-20 · Neel Jay, Hieu Minh Nguyen, Trung Dung Hoang, Jacob Haimes

The prevalence of Vision-Language Models (VLMs) raises important questions about privacy in an era where visual information is increasingly available. While foundation VLMs demonstrate broad knowledge and learned capabilities, we specifically investigate their ability to infer geographic location from previously unseen image data. This paper introduces a benchmark dataset collected from Google Street View that represents its global distribution of coverage. Foundation models are evaluated on single-image geolocation inference, with many achieving median distance errors of <300 km. We further evaluate VLM "agents" with access to supplemental tools, observing up to a 30.6% decrease in distance error. Our findings establish that modern foundation VLMs can act as powerful image geolocation tools, without being specifically trained for this task. When coupled with increasing accessibility of these models, our findings have greater implications for online privacy. We discuss these risks, as well as future work in this area.

📄 PDF Abstract BibTeX arXiv:2502.14412

Code (1)

njspyx/location-inference 공식 구현

Similar Papers 제목 키워드 기반

Assessing the Geolocation Capabilities, Limitations and Societal Risks of Generative Vision-Language Models

2025-08-27 · Oliver Grainge, Sania Waheed, Jack Stilgoe, Michael Milford 외 arxiv

Geo-localization is the task of identifying the location of an image using visual cues alone. It has beneficial applications, such as improving disaster response, enhancing navigation, and geography education. Recently, …

Geolocation with Real Human Gameplay Data: A Large-Scale Dataset and Human-Like Reasoning Framework

2025-02-19 · Zirui Song, Jingpu Yang, Yuan Huang, Jonathan Tonglet 외

Geolocation, the task of identifying an image's location, requires complex reasoning and is crucial for navigation, monitoring, and cultural preservation. However, current methods often produce coarse, imprecise, and non…

Image-Based Geolocation Using Large Vision-Language Models

2024-08-18 · Yi Liu, Junchen Ding, Gelei Deng, Yuekang Li 외

Geolocation is now a vital aspect of modern life, offering numerous benefits but also presenting serious privacy concerns. The advent of large vision-language models (LVLMs) with advanced image-processing capabilities in…

Geocoding Without Geotags: A Text-based Approach for reddit

2018-10-07 · WS 2018 11 · Keith Harrigian

In this paper, we introduce the first geolocation inference approach for reddit, a social media platform where user pseudonymity has thus far made supervised demographic inference difficult to implement and validate. In …

GaGA: Towards Interactive Global Geolocation Assistant

2024-12-12 · Zhiyang Dou, Zipeng Wang, Xumeng Han, Guorong Li 외

Global geolocation, which seeks to predict the geographical location of images captured anywhere in the world, is one of the most challenging tasks in the field of computer vision. In this paper, we introduce an innovati…

World Knowledge