paper-with-me

홈 › Papers

VECT-GAN: A variationally encoded generative model for overcoming data scarcity in pharmaceutical science

2025-01-15 · Youssef Abdalla, Marrisa Taub, Eleanor Hilton, Priya Akkaraju, Alexander Milanovic, Mine Orlu, Abdul W. Basit, Michael T Cook, Tapabrata Chakraborti, David Shorthouse

Data scarcity in pharmaceutical research has led to reliance on labour-intensive trial-and-error approaches for development rather than data-driven methods. While Machine Learning offers a solution, existing datasets are often small and noisy, limiting their utility. To address this, we developed a Variationally Encoded Conditional Tabular Generative Adversarial Network (VECT-GAN), a novel generative model specifically designed for augmenting small, noisy datasets. We introduce a pipeline where data is augmented before regression model development and demonstrate that this consistently and significantly improves performance over other state-of-the-art tabular generative models. We apply this pipeline across six pharmaceutical datasets, and highlight its real-world applicability by developing novel polymers with medically desirable mucoadhesive properties, which we made and experimentally characterised. Additionally, we pre-train the model on the ChEMBL database of drug-like molecules, leveraging knowledge distillation to enhance its generalisability, making it readily available for use on pharmaceutical datasets containing small molecules, an extremely common pharmaceutical task. We demonstrate the power of synthetic data for regularising small tabular datasets, highlighting its potential to become standard practice in pharmaceutical model development, and make our method, including VECT-GAN pre-trained on ChEMBL available as a pip package.

📄 PDF Abstract BibTeX arXiv:2501.08995

Code (1)

y-babdalla/vect_gan 공식 구현 pytorch

Tasks

Generative Adversarial NetworkKnowledge Distillation

Methods 이 논문이 사용한 방법론

Knowledge Distillation A very simple way to improve the performance of almost any machine learning algorithm is to train many different models on the same data and then to average their predictions.…

Similar Papers 제목 키워드 기반

Inference-Time Alignment for Diffusion Models via Variationally Stable Doob's Matching

2026-01-10 · Jinyuan Chang, Chenguang Duan, Yuling Jiao, Yi Xu 외 arxiv

Inference-time alignment for diffusion models aims to adapt a pre-trained reference diffusion model toward a target distribution without retraining the reference score network, thereby preserving the generative capacity …

Overcoming Mean-Field Approximations in Recurrent Gaussian Process Models

2019-06-13 · Alessandro Davide Ialongo, Mark van der Wilk, James Hensman, Carl Edward Rasmussen

We identify a new variational inference scheme for dynamical systems whose transition function is modelled by a Gaussian process. Inference in this setting has either employed computationally intensive MCMC methods, or r…

Variational Inference

Stochastic Mirror Descent in Variationally Coherent Optimization Problems

2017-12-01 · NeurIPS 2017 12 · Zhengyuan Zhou, Panayotis Mertikopoulos, Nicholas Bambos, Stephen Boyd 외

In this paper, we examine a class of non-convex stochastic optimization problems which we call variationally coherent, and which properly includes pseudo-/quasiconvex and star-convex optimization problems. To solve such …

Stochastic Optimization

Parameter-free Stochastic Optimization of Variationally Coherent Functions

2021-01-30 · Francesco Orabona, Dávid Pál

We design and analyze an algorithm for first-order stochastic optimization of a large class of functions on $\mathbb{R}^d$. In particular, we consider the \emph{variationally coherent} functions which can be convex or no…

Stochastic Optimization

Learning to Sample Better

2023-10-17 · Michael S. Albergo, Eric Vanden-Eijnden

These lecture notes provide an introduction to recent advances in generative modeling methods based on the dynamical transportation of measures, by means of which samples from a simple base measure are mapped to samples …