paper-with-me

홈 › Papers

Multi-modal Deep Learning

2024-03-06 · Chen Yuhua

This article investigates deep learning methodologies for single-modality clinical data analysis, as a crucial precursor to multi-modal medical research. Building on Guo JingYuan's work, the study refines clinical data processing through Compact Convolutional Transformer (CCT), Patch Up, and the innovative CamCenterLoss technique, establishing a foundation for future multimodal investigations. The proposed methodology demonstrates improved prediction accuracy and at tentiveness to critically ill patients compared to Guo JingYuan's ResNet and StageNet approaches. Novelty that using image-pretrained vision transformer backbone to perform transfer learning time-series clinical data.The study highlights the potential of CCT, Patch Up, and novel CamCenterLoss in processing single modality clinical data within deep learning frameworks, paving the way for future multimodal medical research and promoting precision and personalized healthcare

📄 PDF Abstract BibTeX arXiv:2403.03385

Code (0)

등록된 구현이 없습니다.

Tasks

Deep LearningTime SeriesTransfer Learning

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Average Pooling 설명 없음
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Max Pooling Max Pooling is a pooling operation that calculates the maximum value for patches of a feature map, and uses it to create a downsampled (pooled) feature map. It is usually…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…

Similar Papers 제목 키워드 기반

Deep Metric Loss for Multimodal Learning

2023-08-21 · Sehwan Moon, Hyunju Lee

Multimodal learning often outperforms its unimodal counterparts by exploiting unimodal contributions and cross-modal interactions. However, focusing only on integrating multimodal features into a unified comprehensive re…

UniS-MMC: Multimodal Classification via Unimodality-supervised Multimodal Contrastive Learning

2023-05-16 · Heqing Zou, Meng Shen, Chen Chen, Yuchen Hu 외

Multimodal learning aims to imitate human beings to acquire complementary information from multiple modalities for various downstream tasks. However, traditional aggregation-based multimodal fusion methods ignore the int…

Contrastive LearningImage-text Classificationtext-classificationText Classification

Toward Robust Multimodal Learning using Multimodal Foundational Models

2024-01-20 · Xianbing Zhao, Soujanya Poria, Xuejiao Li, Yixin Chen 외

Existing multimodal sentiment analysis tasks are highly rely on the assumption that the training and test sets are complete multimodal data, while this assumption can be difficult to hold: the multimodal data are often i…

Multimodal Sentiment AnalysisSentiment Analysis

Meta-Learn Unimodal Signals with Weak Supervision for Multimodal Sentiment Analysis

2024-08-28 · Sijie Mai, Yu Zhao, Ying Zeng, Jianhua Yao 외

Multimodal sentiment analysis aims to effectively integrate information from various sources to infer sentiment, where in many cases there are no annotations for unimodal labels. Therefore, most works rely on multimodal …

DenoisingMultimodal Sentiment AnalysisSentiment Analysis

MILES: Modality-Informed Learning Rate Scheduler for Balancing Multimodal Learning

2025-10-20 · Alejandro Guerra-Manzanares, Farah E. Shamout arxiv

The aim of multimodal neural networks is to combine diverse data sources, referred to as modalities, to achieve enhanced performance compared to relying on a single modality. However, training of multimodal networks is t…