Learning Representations from Imperfect Time Series Data via Tensor Rank Regularization
There has been an increased interest in multimodal language processing including multimodal dialog, question answering, sentiment analysis, and speech recognition. However, naturally occurring multimodal data is often imperfect as a result of imperfect modalities, missing entries or noise corruption. To address these concerns, we present a regularization method based on tensor rank minimization. Our method is based on the observation that high-dimensional multimodal time series data often exhibit correlations across time and modalities which leads to low-rank tensor representations. However, the presence of noise or incomplete values breaks these correlations and results in tensor representations of higher rank. We design a model to learn such tensor representations and effectively regularize their rank. Experiments on multimodal language data show that our model achieves good results across various levels of imperfection.
Code (0)
등록된 구현이 없습니다.
Tasks
Question AnsweringSentiment Analysisspeech-recognitionSpeech RecognitionTime SeriesTime Series AnalysisSimilar Papers 제목 키워드 기반
Learning Gaussian Mixture Representations for Tensor Time Series Forecasting
Tensor time series (TTS) data, a generalization of one-dimensional time series on a high-dimensional space, is ubiquitous in real-world scenarios, especially in monitoring systems involving multi-source spatio-temporal d…
Representation LearningTime SeriesTime Series ForecastingDisentangled Mode-Specific Representations for Tensor Time Series via Contrastive Learning
Multi-mode tensor time series (TTS) can be found in many domains, such as search engines and environmental monitoring systems. Learning representations of a TTS benefits various applications, but it is also challenging s…
Representation LearningContrastive LearningTensor-Based Channel Estimation for RIS-Assisted Networks Operating Under Imperfections
Reconfigurable intelligent surface (RIS) is a candidate technology for future wireless networks. It enables to shape the wireless environment to reach massive connectivity and enhanced data rate. The promising gains of R…
Network of Tensor Time Series
Co-evolving time series appears in a multitude of applications such as environmental monitoring, financial analysis, and smart transportation. This paper aims to address the following challenges, including (C1) how to in…
Financial AnalysisTensor DecompositionTime SeriesTime Series AnalysisStructured Adaptive Tensor Prediction for Streaming Data
Matrix-valued time series arise in a wide range of applications, such as spatio-temporal data from medical imaging and geophysics. Existing methods are mainly designed for static settings and lack adaptability to streami…