Multi-task Learning for Macromolecule Classification, Segmentation and Coarse Structural Recovery in Cryo-Tomography
Cellular Electron Cryo-Tomography (CECT) is a powerful 3D imaging tool for studying the native structure and organization of macromolecules inside single cells. For systematic recognition and recovery of macromolecular structures captured by CECT, methods for several important tasks such as subtomogram classification and semantic segmentation have been developed. However, the recognition and recovery of macromolecular structures are still very difficult due to high molecular structural diversity, crowding molecular environment, and the imaging limitations of CECT. In this paper, we propose a novel multi-task 3D convolutional neural network model for simultaneous classification, segmentation, and coarse structural recovery of macromolecules of interest in subtomograms. In our model, the learned image features of one task are shared and thereby mutually reinforce the learning of other tasks. Evaluated on realistically simulated and experimental CECT data, our multi-task learning model outperformed all single-task learning methods for classification and segmentation. In addition, we demonstrate that our model can generalize to discover, segment and recover novel structures that do not exist in the training data.
Code (0)
등록된 구현이 없습니다.
Tasks
ClassificationDiversityGeneral ClassificationMulti-Task LearningSegmentationSemantic SegmentationSimilar Papers 제목 키워드 기반
Chemistry-informed Macromolecule Graph Representation for Similarity Computation and Supervised Learning
Macromolecules are large, complex molecules composed of covalently bonded monomer units, existing in different stereochemical configurations and topologies. As a result of such chemical diversity, representing, comparing…
Decision MakingDiversityModel compression for faster structural separation of macromolecules captured by Cellular Electron Cryo-Tomography
Electron Cryo-Tomography (ECT) enables 3D visualization of macromolecule structure inside single cells. Macromolecule classification approaches based on convolutional neural networks (CNN) were developed to separate mill…
ClassificationGeneral ClassificationKnowledge DistillationModel CompressionA Mutual Bootstrapping Model for Automated Skin Lesion Segmentation and Classification
Automated skin lesion segmentation and classification are two most essential and related tasks in the computer-aided diagnosis of skin cancer. Despite their prevalence, deep learning models are usually designed for only …
ClassificationGeneral ClassificationLesion ClassificationLesion Segmentation+1Classification of Macromolecule Type Based on Sequences of Amino Acids Using Deep Learning
The classification of amino acids and their sequence analysis plays a vital role in life sciences and is a challenging task. This article uses and compares state-of-the-art deep learning models like convolution neural ne…
General ClassificationGLAMOUR: Graph Learning over Macromolecule Representations
The near-infinite chemical diversity of natural and artificial macromolecules arises from the vast range of possible component monomers, linkages, and polymers topologies. This enormous variety contributes to the ubiquit…
Decision MakingDiversityGraph Learning