paper-with-me

홈 › Papers

GeoLocator: a location-integrated large multimodal model for inferring geo-privacy

2023-11-21 · Yifan Yang, Siqin Wang, Daoyang Li, Yixian Zhang, Shuju Sun, Junzhou He

Geographic privacy or geo-privacy refers to the keeping private of one's geographic location, especially the restriction of geographical data maintained by personal electronic devices. Geo-privacy is a crucial aspect of personal security; however, it often goes unnoticed in daily activities. With the surge in the use of Large Multimodal Models (LMMs), such as GPT-4, for Open Source Intelligence (OSINT), the potential risks associated with geo-privacy breaches have intensified. This study develops a location-integrated GPT-4 based model named GeoLocator and designs four-dimensional experiments to demonstrate its capability in inferring the locational information of input imageries and/or social media contents. Our experiments reveal that GeoLocator generates specific geographic details with high accuracy and consequently embeds the risk of the model users exposing geospatial information to the public unintentionally, highlighting the thread of online data sharing, information gathering technologies and LLMs on geo-privacy. We conclude with the broader implications of GeoLocator and our findings for individuals and the community at large, by emphasizing the urgency for enhanced awareness and protective measures against geo-privacy leakage in the era of advanced AI and widespread social media usage.

📄 PDF Abstract BibTeX arXiv:2311.13018

Code (0)

등록된 구현이 없습니다.

Tasks

Image Comprehension

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Residual Connection 설명 없음

Similar Papers 제목 키워드 기반

Granular Privacy Control for Geolocation with Vision Language Models

2024-07-06 · Ethan Mendes, Yang Chen, James Hays, Sauvik Das 외

Vision Language Models (VLMs) are rapidly advancing in their capability to answer information-seeking questions. As these models are widely deployed in consumer applications, they could lead to new privacy risks due to e…

Break Out the Silverware -- Semantic Understanding of Stored Household Items

2025-12-25 · Michaela Levi-Richter, Reuth Mirsky, Oren Glickman arxiv

``Bring me a plate.'' For domestic service robots, this simple command reveals a complex challenge: inferring where everyday items are stored, often out of sight in drawers, cabinets, or closets. Despite advances in visi…

Scene Understanding

Deep Multimodal Feature Encoding for Video Ordering

2020-04-05 · Vivek Sharma, Makarand Tapaswi, Rainer Stiefelhagen

True understanding of videos comes from a joint analysis of all its modalities: the video frames, the audio track, and any accompanying text such as closed captions. We present a way to learn a compact multimodal feature…

Action Recognition

IW-Bench: Evaluating Large Multimodal Models for Converting Image-to-Web

2024-09-14 · Hongcheng Guo, Wei zhang, JunHao Chen, Yaonan Gu 외

Recently advancements in large multimodal models have led to significant strides in image comprehension capabilities. Despite these advancements, there is a lack of the robust benchmark specifically for assessing the Ima…

Image Comprehension

Multimodal LLM Integrated Semantic Communications for 6G Immersive Experiences

2025-07-07 · Yusong Zhang, Yuxuan Sun, Lei Guo, Wei Chen 외 arxiv

6G networks promise revolutionary immersive communication experiences including augmented reality (AR), virtual reality (VR), and holographic communications. These applications demand high-dimensional multimodal data tra…

Visual Question AnsweringImage Generation