paper-with-me

Papers

Mitigating Exposure Bias in Score-Based Generation of Molecular Conformations

2024-09-21 · Sijia Wang, Chen Wang, Zhenhao Zhao, Jiqiang Zhang, Weiran Cai

Molecular conformation generation poses a significant challenge in the field of computational chemistry. Recently, Diffusion Probabilistic Models (DPMs) and Score-Based Generative Models (SGMs) are effectively used due to their capacity for generating accurate conformations far beyond conventional physics-based approaches. However, the discrepancy between training and inference rises a critical problem known as the exposure bias. While this issue has been extensively investigated in DPMs, the existence of exposure bias in SGMs and its effective measurement remain unsolved, which hinders the use of compensation methods for SGMs, including ConfGF and Torsional Diffusion as the representatives. In this work, we first propose a method for measuring exposure bias in SGMs used for molecular conformation generation, which confirms the significant existence of exposure bias in these models and measures its value. We design a new compensation algorithm Input Perturbation (IP), which is adapted from a method originally designed for DPMs only. Experimental results show that by introducing IP, SGM-based molecular conformation models can significantly improve both the accuracy and diversity of the generated conformations. Especially by using the IP-enhanced Torsional Diffusion model, we achieve new state-of-the-art performance on the GEOM-Drugs dataset and are on par on GEOM-QM9. We provide the code publicly at https://github.com/jia-975/torsionalDiff-ip.

📄 PDF Abstract BibTeX arXiv:2409.14014

Code (2)

jia-975/geodiff-ip 공식 구현 pytorch
jia-975/torsionaldiff-ip 공식 구현 pytorch

Tasks

Computational chemistry

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Mitigating Exposure Bias in Discriminator Guided Diffusion Models

2023-11-18 · Eleftherios Tsonis, Paraskevi Tzouveli, Athanasios Voulodimos

Diffusion Models have demonstrated remarkable performance in image generation. However, their demanding computational requirements for training have prompted ongoing efforts to enhance the quality of generated images thr…

Image Generation

Bridging the Gap between Learning and Inference for Diffusion-Based Molecule Generation

2024-11-08 · Peidong Liu, Wenbo Zhang, Xue Zhe, Jiancheng Lv 외

The efficacy of diffusion models in generating a spectrum of data modalities, including images, text, and videos, has spurred inquiries into their utility in molecular generation, yielding significant advancements in the…

Diversity

Mitigating the Exposure Bias in Sentence-Level Grapheme-to-Phoneme (G2P) Transduction

2023-08-16 · Eunseop Yoon, Hee Suk Yoon, Dhananjaya Gowda, SooHwan Eom 외

Text-to-Text Transfer Transformer (T5) has recently been considered for the Grapheme-to-Phoneme (G2P) transduction. As a follow-up, a tokenizer-free byte-level model based on T5 referred to as ByT5, recently gave promisi…

Sentence

ReflexFlow: Rethinking Learning Objective for Exposure Bias Alleviation in Flow Matching

2025-12-04 · Guanbo Huang, Jingjia Mao, Fanding Huang, Fengkai Liu 외 arxiv

Despite tremendous recent progress, Flow Matching methods still suffer from exposure bias due to discrepancies in training and inference. This paper investigates the root causes of exposure bias in Flow Matching, includi…

BRIDO: Bringing Democratic Order to Abstractive Summarization

2025-02-25 · Junhyun Lee, Harshith Goka, Hyeonmok Ko

Hallucination refers to the inaccurate, irrelevant, and inconsistent text generated from large language models (LLMs). While the LLMs have shown great promise in a variety of tasks, the issue of hallucination still remai…

Abstractive Text SummarizationContrastive LearningHallucinationText Summarization