paper-with-me

홈 › Papers

Using Time-Series Privileged Information for Provably Efficient Learning of Prediction Models

2021-10-28 · Rickard K. A. Karlsson, Martin Willbo, Zeshan Hussain, Rahul G. Krishnan, David Sontag, Fredrik D. Johansson

We study prediction of future outcomes with supervised models that use privileged information during learning. The privileged information comprises samples of time series observed between the baseline time of prediction and the future outcome; this information is only available at training time which differs from the traditional supervised learning. Our question is when using this privileged data leads to more sample-efficient learning of models that use only baseline data for predictions at test time. We give an algorithm for this setting and prove that when the time series are drawn from a non-stationary Gaussian-linear dynamical system of fixed horizon, learning with privileged information is more efficient than learning without it. On synthetic data, we test the limits of our algorithm and theory, both when our assumptions hold and when they are violated. On three diverse real-world datasets, we show that our approach is generally preferable to classical learning, particularly when data is scarce. Finally, we relate our estimator to a distillation approach both theoretically and empirically.

📄 PDF Abstract BibTeX arXiv:2110.14993

Code (1)

RickardKarl/LearningUsingPrivilegedTimeSeries 공식 구현

Tasks

Time SeriesTime Series Analysis

Methods 이 논문이 사용한 방법론

Test 설명 없음

Similar Papers 제목 키워드 기반

Improving Text-based Early Prediction by Distillation from Privileged Time-Series Text

2023-01-26 · Jinghui Liu, Daniel Capurro, Anthony Nguyen, Karin Verspoor

Modeling text-based time-series to make prediction about a future event or outcome is an important task with a wide range of applications. The standard approach is to train and test the model using the same input window,…

Knowledge DistillationPredictionTime SeriesTime Series Analysis+1

Efficient learning of nonlinear prediction models with time-series privileged information

2022-09-15 · Bastian Jung, Fredrik D Johansson

In domains where sample sizes are limited, efficient learning algorithms are critical. Learning using privileged information (LuPI) offers increased sample efficiency by allowing prediction models access to auxiliary inf…

PredictionRepresentation LearningTime SeriesTime Series Analysis

Privileged Knowledge Distillation for Online Action Detection

2020-11-18 · Peisen Zhao, Lingxi Xie, Ya zhang, Yanfeng Wang 외

Online Action Detection (OAD) in videos is proposed as a per-frame labeling task to address the real-time prediction tasks that can only obtain the previous and current video frames. This paper presents a novel learning-…

Action DetectionKnowledge DistillationOnline Action Detection

Overlooked Poses Actually Make Sense: Distilling Privileged Knowledge for Human Motion Prediction

2022-08-02 · Xiaoning Sun, Qiongjie Cui, Huaijiang Sun, Bin Li 외

Previous works on human motion prediction follow the pattern of building a mapping relation between the sequence observed and the one to be predicted. However, due to the inherent complexity of multivariate time series d…

Human motion predictionmotion predictionPredictionRelation+2

Object Localization based on Structural SVM using Privileged Information

2014-12-01 · NeurIPS 2014 12 · Jan Feyereisl, Suha Kwak, Jeany Son, Bohyung Han

We propose a structured prediction algorithm for object localization based on Support Vector Machines (SVMs) using privileged information. Privileged information provides useful high-level knowledge for image understandi…

ObjectObject LocalizationStructured Prediction