paper-with-me

Papers

Bidirectional Generation of Structure and Properties Through a Single Molecular Foundation Model

2022-11-19 · Jinho Chang, Jong Chul Ye

The recent success of large foundation models in artificial intelligence has prompted the emergence of chemical pre-trained models. Despite the growing interest in large molecular pre-trained models that provide informative representations for downstream tasks, attempts for multimodal pre-training approaches on the molecule domain were limited. To address this, we present a novel multimodal molecular pre-trained model that incorporates the modalities of structure and biochemical properties, drawing inspiration from recent advances in multimodal learning techniques. Our proposed model pipeline of data handling and training objectives aligns the structure/property features in a common embedding space, which enables the model to regard bidirectional information between the molecules' structure and properties. These contributions emerge synergistic knowledge, allowing us to tackle both multimodal and unimodal downstream tasks through a single model. Through extensive experiments, we demonstrate that our model shows remarkable capabilities in solving various meaningful chemical challenges, including conditional molecule generation, property prediction, molecule classification, and reaction prediction.

📄 PDF Abstract BibTeX arXiv:2211.10590

Code (1)

jinhojsk515/SPMM 공식 구현 pytorch

Tasks

Molecular Property PredictionProperty Prediction

Similar Papers 제목 키워드 기반

Bidirectional Variational Autoencoders

2025-05-21 · Bart Kosko, Olaoluwa Adigun

We present the new bidirectional variational autoencoder (BVAE) network architecture. The BVAE uses a single neural network both to encode and decode instead of an encoder-decoder network pair. The network encodes in the…

DecoderImage Reconstruction

PixelBytes: Catching Unified Embedding for Multimodal Generation

2024-09-03 · Fabien Furfaro

This report introduces PixelBytes Embedding, a novel approach for unified multimodal representation learning. Our method captures diverse inputs in a single, cohesive representation, enabling emergent properties for mult…

Mambamultimodal generationRepresentation LearningState Space Models

Integrating protein sequence embeddings with structure via graph-based deep learning for the prediction of single-residue properties

2025-02-24 · Kevin Michalewicz, Mauricio Barahona, Barbara Bravi

Understanding the intertwined contributions of amino acid sequence and spatial structure is essential to explain protein behaviour. Here, we introduce INFUSSE (Integrated Network Framework Unifying Structure and Sequence…

Large Language Model

UniTemp: Unlocking Video Generation in Any Temporal Order via Bidirectional Distillation

2026-06-17 · Lin Zhang, Sicheng Mo, Zefan Cai, Jinhong Lin 외 arxiv

Autoregressive video diffusion models have emerged as a promising approach for long video generation, achieving strong performance in streaming settings. However, existing methods are restricted to forward temporal gener…

Story GenerationVideo Generation

BAD: Bidirectional Auto-regressive Diffusion for Text-to-Motion Generation

2024-09-17 · S. Rohollah Hosseyni, Ali Ahmad Rahmani, S. Jamal Seyedmohammadi, Sanaz Seyedin 외

Autoregressive models excel in modeling sequential dependencies by enforcing causal constraints, yet they struggle to capture complex bidirectional patterns due to their unidirectional nature. In contrast, mask-based mod…

Human motion predictionMotion ForecastingMotion GenerationMotion Synthesis