paper-with-me

Papers

Multi-modal Representation Learning for Cross-modal Prediction of Continuous Weather Patterns from Discrete Low-Dimensional Data

2024-01-30 · Alif Bin Abdul Qayyum, Xihaier Luo, Nathan M. Urban, Xiaoning Qian, Byung-Jun Yoon

World is looking for clean and renewable energy sources that do not pollute the environment, in an attempt to reduce greenhouse gas emissions that contribute to global warming. Wind energy has significant potential to not only reduce greenhouse emission, but also meet the ever increasing demand for energy. To enable the effective utilization of wind energy, addressing the following three challenges in wind data analysis is crucial. Firstly, improving data resolution in various climate conditions to ensure an ample supply of information for assessing potential energy resources. Secondly, implementing dimensionality reduction techniques for data collected from sensors/simulations to efficiently manage and store large datasets. Thirdly, extrapolating wind data from one spatial specification to another, particularly in cases where data acquisition may be impractical or costly. We propose a deep learning based approach to achieve multi-modal continuous resolution wind data prediction from discontinuous wind data, along with data dimensionality reduction.

📄 PDF Abstract BibTeX arXiv:2401.16936

Code (0)

등록된 구현이 없습니다.

Tasks

Dimensionality ReductionRepresentation Learning

Similar Papers 제목 키워드 기반

Multimodal Contrastive Learning via Uni-Modal Coding and Cross-Modal Prediction for Multimodal Sentiment Analysis

2022-10-26 · Ronghao Lin, Haifeng Hu

Multimodal representation learning is a challenging task in which previous work mostly focus on either uni-modality pre-training or cross-modality fusion. In fact, we regard modeling multimodal representation as building…

Contrastive LearningMultimodal Sentiment AnalysisRepresentation LearningSentiment Analysis

Learning Factorized Multimodal Representations

2018-06-16 · ICLR 2019 5 · Yao-Hung Hubert Tsai, Paul Pu Liang, Amir Zadeh, Louis-Philippe Morency 외

Learning multimodal representations is a fundamentally complex research problem due to the presence of multiple heterogeneous sources of information. Although the presence of multiple modalities provides additional valua…

Representation Learning

Adaptive Contrastive Learning on Multimodal Transformer for Review Helpfulness Predictions

2022-11-07 · Thong Nguyen, Xiaobao Wu, Anh-Tuan Luu, Cong-Duy Nguyen 외

Modern Review Helpfulness Prediction systems are dependent upon multiple modalities, typically texts and images. Unfortunately, those contemporary approaches pay scarce attention to polish representations of cross-modal …

Contrastive Learningmultimodal interaction

Probing, Fusion, and Trustworthiness: A Systematic Evaluation of Foundation Model Representations for Multimodal Cancer Analysis

2026-06-15 · Jingyu Hu, Giuseppe Tripodi, Reed Naidoo, Sarah F. McGough 외 arxiv

Foundation models (FMs) have emerged as powerful representation extractors for medical data, yet their generalizability to datasets under distribution shift remains underexplored. This work systematically evaluates FM-ba…

LeMoF: Level-guided Multimodal Fusion for Heterogeneous Clinical Data

2026-01-15 · Jongseok Kim, Seongae Kang, Jonghwan Shin, Yuhan Lee 외 arxiv

Multimodal clinical prediction is widely used to integrate heterogeneous data such as Electronic Health Records (EHR) and biosignals. However, existing methods tend to rely on static modality integration schemes and simp…