paper-with-me

Papers

Task Embedding Temporal Convolution Networks for Transfer Learning Problems in Renewable Power Time-Series Forecast

2022-04-29 · Jens Schreiber, Stephan Vogt, Bernhard Sick

Task embeddings in multi-layer perceptrons for multi-task learning and inductive transfer learning in renewable power forecasts have recently been introduced. In many cases, this approach improves the forecast error and reduces the required training data. However, it does not take the seasonal influences in power forecasts within a day into account, i.e., the diurnal cycle. Therefore, we extended this idea to temporal convolutional networks to consider those seasonalities. We propose transforming the embedding space, which contains the latent similarities between tasks, through convolution and providing these results to the network's residual block. The proposed architecture significantly improves up to 25 percent for multi-task learning for power forecasts on the EuropeWindFarm and GermanSolarFarm dataset compared to the multi-layer perceptron approach. Based on the same data, we achieve a ten percent improvement for the wind datasets and more than 20 percent in most cases for the solar dataset for inductive transfer learning without catastrophic forgetting. Finally, we are the first proposing zero-shot learning for renewable power forecasts to provide predictions even if no training data is available.

📄 PDF Abstract BibTeX arXiv:2204.13908

Code (1)

scribbler00/task-TCN pytorch

Tasks

Multi-Task LearningTime SeriesTime Series AnalysisTransfer LearningZero-Shot Learning

Methods 이 논문이 사용한 방법론

Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…

Similar Papers 제목 키워드 기반

Learning audio representations via phase prediction

2019-10-25 · Félix de Chaumont Quitry, Marco Tagliasacchi, Dominik Roblek

We learn audio representations by solving a novel self-supervised learning task, which consists of predicting the phase of the short-time Fourier transform from its magnitude. A convolutional encoder is used to map the m…

DecoderPredictionSelf-Supervised Learning

Scalable Self-Supervised Representation Learning from Spatiotemporal Motion Trajectories for Multimodal Computer Vision

2022-10-07 · Swetava Ganguli, C. V. Krishnakumar Iyer, Vipul Pandey

Self-supervised representation learning techniques utilize large datasets without semantic annotations to learn meaningful, universal features that can be conveniently transferred to solve a wide variety of downstream su…

Representation LearningSemantic Segmentation

Exploiting Convolutional Neural Network for Risk Prediction with Medical Feature Embedding

2017-01-25 · Zhengping Che, Yu Cheng, Zhaonan Sun, Yan Liu

The widespread availability of electronic health records (EHRs) promises to usher in the era of personalized medicine. However, the problem of extracting useful clinical representations from longitudinal EHR data remains…

TaCE: Time-aware Convolutional Embedding Learning for Temporal Knowledge Graph Completion

2021-09-29 · Jin Luo, Hong Shen, YanFeng Hu, Chen Peng

Temporal knowledge graph completion (TKGC) is a challenging task to infer the missing component for quadruples. The key challenge lies at how to integrate time information into the embeddings of entities and relations. R…

Knowledge Graph CompletionKnowledge GraphsTemporal Knowledge Graph Completion

Improving Video Model Transfer With Dynamic Representation Learning

2022-01-01 · CVPR 2022 1 · Yi Li, Nuno Vasconcelos

Temporal modeling is an essential element in video understanding. While deep convolution-based architectures have been successful at solving large-scale video recognition datasets, recent work has pointed out that th…

Action ClassificationKnowledge DistillationmodelRepresentation Learning+3