paper-with-me

홈 › Papers

Inspecting the Geographical Representativeness of Images from Text-to-Image Models

2023-05-18 · ICCV 2023 1 · Abhipsa Basu, R. Venkatesh Babu, Danish Pruthi

Recent progress in generative models has resulted in models that produce both realistic as well as relevant images for most textual inputs. These models are being used to generate millions of images everyday, and hold the potential to drastically impact areas such as generative art, digital marketing and data augmentation. Given their outsized impact, it is important to ensure that the generated content reflects the artifacts and surroundings across the globe, rather than over-representing certain parts of the world. In this paper, we measure the geographical representativeness of common nouns (e.g., a house) generated through DALL.E 2 and Stable Diffusion models using a crowdsourced study comprising 540 participants across 27 countries. For deliberately underspecified inputs without country names, the generated images most reflect the surroundings of the United States followed by India, and the top generations rarely reflect surroundings from all other countries (average score less than 3 out of 5). Specifying the country names in the input increases the representativeness by 1.44 points on average for DALL.E 2 and 0.75 for Stable Diffusion, however, the overall scores for many countries still remain low, highlighting the need for future models to be more geographically inclusive. Lastly, we examine the feasibility of quantifying the geographical representativeness of generated images without conducting user studies.

📄 PDF Abstract BibTeX arXiv:2305.11080

Code (0)

등록된 구현이 없습니다.

Tasks

Data AugmentationMarketing

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Where Do Images Come From? Analyzing Captions to Geographically Profile Datasets

2026-02-10 · Abhipsa Basu, Yugam Bahl, Kirti Bhagat, Preethi Seshadri 외 arxiv

Recent studies show that text-to-image models often fail to generate geographically representative images, raising concerns about the representativeness of their training data and motivating the question: which parts of …

Assessing News Thumbnail Representativeness: Counterfactual text can enhance the cross-modal matching ability

2024-02-17 · Yejun Yoon, Seunghyun Yoon, Kunwoo Park

This paper addresses the critical challenge of assessing the representativeness of news thumbnail images, which often serve as the first visual engagement for readers when an article is disseminated on social media. We f…

Contrastive Learningcounterfactual

Testing a Bayesian Measure of Representativeness Using a Large Image Database

2011-12-01 · NeurIPS 2011 12 · Joshua T. Abbott, Katherine A. Heller, Zoubin Ghahramani, Thomas L. Griffiths

How do people determine which elements of a set are most representative of that set? We extend an existing Bayesian measure of representativeness, which indicates the representativeness of a sample from a distribution, t…

BIG-bench Machine Learning

Location Prediction of Social Images via Generative Model

2015-05-15 · Zhang Xiaoming, Li Zhoujun, Wang Senzhang, Yang Yang 외

The vast amount of geo-tagged social images has attracted great attention in research of predicting location using the plentiful content of images, such as visual content and textual description. Most of the existing res…

Language ModelingLanguage ModellingmodelPrediction

Evaluation of Geographical Distortions in Language Models: A Crucial Step Towards Equitable Representations

2024-04-26 · Rémy Decoupes, Roberto Interdonato, Mathieu Roche, Maguelonne Teisseire 외

Language models now constitute essential tools for improving efficiency for many professional tasks such as writing, coding, or learning. For this reason, it is imperative to identify inherent biases. In the field of Nat…