paper-with-me

홈 › Papers

Debiasing knowledge graph embeddings

2020-11-01 · EMNLP 2020 11 · Joseph Fisher, Arpit Mittal, Dave Palfrey, Christos Christodoulopoulos

It has been shown that knowledge graph embeddings encode potentially harmful social biases, such as the information that women are more likely to be nurses, and men more likely to be bankers. As graph embeddings begin to be used more widely in NLP pipelines, there is a need to develop training methods which remove such biases. Previous approaches to this problem both significantly increase the training time, by a factor of eight or more, and decrease the accuracy of the model substantially. We present a novel approach, in which all embeddings are trained to be neutral to sensitive attributes such as gender by default using an adversarial loss. We then add sensitive attributes back on in whitelisted cases. Training time only marginally increases over a baseline model, and the debiased embeddings perform almost as accurately in the triple prediction task as their non-debiased counterparts.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Knowledge Graph Embeddings

Similar Papers 제목 키워드 기반

Adversarial Learning for Debiasing Knowledge Graph Embeddings

2020-06-29 · Mario Arduini, Lorenzo Noci, Federico Pirovano, Ce Zhang 외

Knowledge Graphs (KG) are gaining increasing attention in both academia and industry. Despite their diverse benefits, recent research have identified social and cultural biases embedded in the representations learned fro…

AttributeKnowledge Graph EmbeddingsKnowledge GraphsLink Prediction

Towards Automatic Bias Detection in Knowledge Graphs

2021-09-19 · Findings (EMNLP) 2021 11 · Daphna Keidar, Mian Zhong, Ce Zhang, Yash Raj Shrestha 외

With the recent surge in social applications relying on knowledge graphs, the need for techniques to ensure fairness in KG based methods is becoming increasingly evident. Previous works have demonstrated that KGs are pro…

Bias DetectionFairnessKnowledge Graph EmbeddingsKnowledge Graphs

Toward Structure Fairness in Dynamic Graph Embedding: A Trend-aware Dual Debiasing Approach

2024-06-19 · Yicong Li, Yu Yang, Jiannong Cao, Shuaiqi Liu 외

Recent studies successfully learned static graph embeddings that are structurally fair by preventing the effectiveness disparity of high- and low-degree vertex groups in downstream graph mining tasks. However, achieving …

Dynamic graph embeddingFairnessGraph EmbeddingGraph Mining

BendVLM: Test-Time Debiasing of Vision-Language Embeddings

2024-11-07 · Walter Gerych, Haoran Zhang, Kimia Hamidieh, Eileen Pan 외

Vision-language model (VLM) embeddings have been shown to encode biases present in their training data, such as societal biases that prescribe negative characteristics to members of various racial and gender identities. …

AttributeImage GenerationLanguage ModelingLanguage Modelling

Causally Disentangled Contrastive Learning for Multilingual Speaker Embeddings

2026-02-01 · Mariëtte Olijslager, Seyed Sahand Mohammadi Ziabari, Ali Mohammed Mansoor Alsahag arxiv

Self-supervised speaker embeddings are widely used in speaker verification systems, but prior work has shown that they often encode sensitive demographic attributes, raising fairness and privacy concerns. This paper inve…

Contrastive LearningSpeaker Verification