paper-with-me

Papers

Image Representations Learned With Unsupervised Pre-Training Contain Human-like Biases

2020-10-28 · Ryan Steed, Aylin Caliskan

Recent advances in machine learning leverage massive datasets of unlabeled images from the web to learn general-purpose image representations for tasks from image classification to face recognition. But do unsupervised computer vision models automatically learn implicit patterns and embed social biases that could have harmful downstream effects? We develop a novel method for quantifying biased associations between representations of social concepts and attributes in images. We find that state-of-the-art unsupervised models trained on ImageNet, a popular benchmark image dataset curated from internet images, automatically learn racial, gender, and intersectional biases. We replicate 8 previously documented human biases from social psychology, from the innocuous, as with insects and flowers, to the potentially harmful, as with race and gender. Our results closely match three hypotheses about intersectional bias from social psychology. For the first time in unsupervised computer vision, we also quantify implicit human biases about weight, disabilities, and several ethnicities. When compared with statistical patterns in online image datasets, our findings suggest that machine learning models can automatically learn bias from the way people are stereotypically portrayed on the web.

📄 PDF Abstract BibTeX arXiv:2010.15052

Code (1)

ryansteed/ieat 공식 구현 tf

Tasks

BIG-bench Machine LearningFace Recognitionimage-classificationImage ClassificationUnsupervised Pre-training

Similar Papers 제목 키워드 기반

Word-Level Loss Extensions for Neural Temporal Relation Classification

2018-08-07 · COLING 2018 8 · Artuur Leeuwenberg, Marie-Francine Moens

Unsupervised pre-trained word embeddings are used effectively for many tasks in natural language processing to leverage unlabeled textual data. Often these embeddings are either used as initializations or as fixed word r…

ClassificationGeneral ClassificationRelationRelation Classification+4

SelfAugment: Automatic Augmentation Policies for Self-Supervised Learning

2020-09-16 · CVPR 2021 1 · Colorado J Reed, Sean Metzger, Aravind Srinivas, Trevor Darrell 외

A common practice in unsupervised representation learning is to use labeled data to evaluate the quality of the learned representations. This supervised evaluation is then used to guide critical aspects of the training p…

Data AugmentationRepresentation LearningSelf-Supervised Learning

Local Unsupervised Learning for Image Analysis

2019-08-14 · NeurIPS Workshop Neuro_AI 2019 12 · Leopold Grinberg, John Hopfield, Dmitry Krotov

Local Hebbian learning is believed to be inferior in performance to end-to-end training using a backpropagation algorithm. We question this popular belief by designing a local algorithm that can learn convolutional filte…

VirTex: Learning Visual Representations from Textual Annotations

2020-06-11 · CVPR 2021 1 · Karan Desai, Justin Johnson

The de-facto approach to many vision tasks is to start from pretrained visual representations, typically learned via supervised training on ImageNet. Recent methods have explored unsupervised pretraining to scale to vast…

General ClassificationImage Captioningimage-classificationImage Classification+4

Unsupervised Natural Image Patch Learning

2018-06-28 · Danon Dov, Averbuch-Elor Hadar, Fried Ohad, Cohen-Or Daniel

Learning a metric of natural image patches is an important tool for analyzing images. An efficient means is to train a deep network to map an image patch to a vector space, in which the Euclidean distance reflects patch …

Domain AdaptationMetric Learning