Multimodal Deep Neural Networks using Both Engineered and Learned Representations for Biodegradability Prediction

2018-08-13 · Garrett B. Goh, Khushmeen Sakloth, Charles Siegel, Abhinav Vishnu, Jim Pfaendtner

Deep learning algorithms excel at extracting patterns from raw data, and with large datasets, they have been very successful in computer vision and natural language applications. However, in other domains, large datasets on which to learn representations from may not exist. In this work, we develop a novel multimodal CNN-MLP neural network architecture that utilizes both domain-specific feature engineering as well as learned representations from raw data. We illustrate the effectiveness of such network designs in the chemical sciences, for predicting biodegradability. DeepBioD, a multimodal CNN-MLP network is more accurate than either standalone network designs, and achieves an error classification rate of 0.125 that is 27% lower than the current state-of-the-art. Thus, our work indicates that combining traditional feature engineering with representation learning can be effective, particularly in situations where labeled data is limited.

📄 PDF Abstract BibTeX arXiv:1808.04456

Code (0)

등록된 구현이 없습니다.

Tasks

Feature Engineering Representation Learning

INFODENS: An Open-source Framework for Learning Text Representations

2018-10-16 · Ahmad Taie, Raphael Rubino, Josef van Genabith

The advent of representation learning methods enabled large performance gains on various language tasks, alleviating the need for manual feature engineering. While engineered representations are usually based on some lin…

Feature Engineering General Classification Representation Learning text-classification+1

A Comparative Study of the Performance for Predicting Biodegradability Classification: The Quantitative Structure–Activity Relationship Model vs the Graph Convolutional Network

2022-01-14 · ACS Omega 2022 1 · Myeonghun Lee, Kyoungmin Min

The prediction and evaluation of the biodegradability of molecules with computational methods are becoming increasingly important. Among the various methods, quantitative structure–activity relationship (QSAR) models hav…

Prediction Specificity

Beyond Chemical Language: A Multimodal Approach to Enhance Molecular Property Prediction

2023-06-22 · Eduardo Soares, Emilio Vital Brazil, Karen Fiorela Aquino Gutierrez, Renato Cerqueira 외

We present a novel multimodal language model approach for predicting molecular properties by combining chemical language representation with physicochemical features. Our approach, MULTIMODAL-MOLFORMER, utilizes a causal…

feature selection Language Modeling Language Modelling Molecular Property Prediction+1

Meta Learning to Bridge Vision and Language Models for Multimodal Few-Shot Learning

2023-02-28 · Ivona Najdenkoska, XianTong Zhen, Marcel Worring

Multimodal few-shot learning is challenging due to the large domain gap between vision and language modalities. Existing methods are trying to communicate visual concepts as prompts to frozen language models, but rely on…

Few-Shot Learning Meta-Learning

Evaluating the Efficacy of Prompt-Engineered Large Multimodal Models Versus Fine-Tuned Vision Transformers in Image-Based Security Applications

2024-03-26 · Fouad Trad, Ali Chehab

The success of Large Language Models (LLMs) has led to a parallel rise in the development of Large Multimodal Models (LMMs), which have begun to transform a variety of applications. These sophisticated multimodal models …

Malware Classification Prompt Engineering