paper-with-me

홈 › Papers

Removing Biases from Molecular Representations via Information Maximization

2023-12-01 · Chenyu Wang, Sharut Gupta, Caroline Uhler, Tommi Jaakkola

High-throughput drug screening -- using cell imaging or gene expression measurements as readouts of drug effect -- is a critical tool in biotechnology to assess and understand the relationship between the chemical structure and biological activity of a drug. Since large-scale screens have to be divided into multiple experiments, a key difficulty is dealing with batch effects, which can introduce systematic errors and non-biological associations in the data. We propose InfoCORE, an Information maximization approach for COnfounder REmoval, to effectively deal with batch effects and obtain refined molecular representations. InfoCORE establishes a variational lower bound on the conditional mutual information of the latent representations given a batch identifier. It adaptively reweighs samples to equalize their implied batch distribution. Extensive experiments on drug screening data reveal InfoCORE's superior performance in a multitude of tasks including molecular property prediction and molecule-phenotype retrieval. Additionally, we show results for how InfoCORE offers a versatile framework and resolves general distribution shifts and issues of data fairness by minimizing correlation with spurious features or removing sensitive attributes. The code is available at https://github.com/uhlerlab/InfoCORE.

📄 PDF Abstract BibTeX arXiv:2312.00718

Code (1)

uhlerlab/infocore 공식 구현 pytorch

Tasks

FairnessMolecular Property PredictionProperty PredictionRetrieval

Similar Papers 제목 키워드 기반

Shielded Representations: Protecting Sensitive Attributes Through Iterative Gradient-Based Projection

2023-05-17 · Shadi Iskander, Kira Radinsky, Yonatan Belinkov

Natural language processing models tend to learn and encode social biases present in the data. One popular approach for addressing such biases is to eliminate encoded information from the model's representations. However…

Attribute

Towards Debiasing Sentence Representations

2020-07-16 · ACL 2020 6 · Paul Pu Liang, Irene Mengze Li, Emily Zheng, Yao Chong Lim 외

As natural language processing methods are increasingly deployed in real-world scenarios such as healthcare, legal systems, and social science, it becomes necessary to recognize the role they potentially play in shaping …

Linguistic AcceptabilityNatural Language UnderstandingSentenceSentiment Analysis+1

MING: A Functional Approach to Learning Molecular Generative Models

2024-10-16 · Van Khoa Nguyen, Maciej Falkiewicz, Giangiacomo Mercatali, Alexandros Kalousis

Traditional molecule generation methods often rely on sequence or graph-based representations, which can limit their expressive power or require complex permutation-equivariant architectures. This paper introduces a nove…

Denoising

OSCaR: Orthogonal Subspace Correction and Rectification of Biases in Word Embeddings

2020-06-30 · EMNLP 2021 11 · Sunipa Dev, Tao Li, Jeff M. Phillips, Vivek Srikumar

Language representations are known to carry stereotypical biases and, as a result, lead to biased predictions in downstream tasks. While existing methods are effective at mitigating biases by linear projection, such meth…

Word Embeddings

Hierarchical VampPrior Variational Fair Auto-Encoder

2018-06-26 · Philip Botros, Jakub M. Tomczak

Decision making is a process that is extremely prone to different biases. In this paper we consider learning fair representations that aim at removing nuisance (sensitive) information from the decision process. For this …

Decision MakingFairness