paper-with-me

Papers

Gaussian Process Classification with Privileged Information by Soft-to-Hard Labeling Transfer

2018-02-12 · Ryosuke Kamesawa, Issei Sato, Masashi Sugiyama

Learning using privileged information is an attractive problem setting that helps many learning scenarios in the real world. A state-of-the-art method of Gaussian process classification (GPC) with privileged information is GPC+, which incorporates privileged information into a noise term of the likelihood. A drawback of GPC+ is that it requires numerical quadrature to calculate the posterior distribution of the latent function, which is extremely time-consuming. To overcome this limitation, we propose a novel classification method with privileged information based on Gaussian processes, called "soft-label-transferred Gaussian process (SLT-GP)." Our basic idea is that we construct another learning task of predicting soft labels (continuous values) obtained from privileged information and we perform transfer learning from this task to the target task of predicting hard labels. We derive a PAC-Bayesian bound of our proposed method, which justifies optimizing hyperparameters by the empirical Bayes method. We also experimentally show the usefulness of our proposed method compared with GPC and GPC+.

📄 PDF Abstract BibTeX arXiv:1802.03877

Code (0)

등록된 구현이 없습니다.

Tasks

Gaussian ProcessesGeneral ClassificationTransfer Learning

Methods 이 논문이 사용한 방법론

Gaussian Process Gaussian Processes are non-parametric models for approximating functions. They rely upon a measure of similarity between points (the kernel function) to predict the value for…

Similar Papers 제목 키워드 기반

Mind the Nuisance: Gaussian Process Classification using Privileged Noise

2014-07-01 · NeurIPS 2014 12 · Daniel Hernández-Lobato, Viktoriia Sharmanska, Kristian Kersting, Christoph H. Lampert 외

The learning with privileged information setting has recently attracted a lot of attention within the machine learning community, as it allows the integration of additional knowledge into the training process of a classi…

ClassificationGeneral Classification

COLAM: Co-Learning of Deep Neural Networks and Soft Labels via Alternating Minimization

2020-04-26 · Xingjian Li, Haoyi Xiong, Haozhe An, Dejing Dou 외

Softening labels of training datasets with respect to data representations has been frequently used to improve the training of deep neural networks (DNNs). While such a practice has been studied as a way to leverage priv…

General Classification

One-Class SVM with Privileged Information and its Application to Malware Detection

2016-09-26 · Evgeny Burnaev, Dmitry Smolyakov

A number of important applied problems in engineering, finance and medicine can be formulated as a problem of anomaly detection. A classical approach to the problem is to describe a normal state using a one-class support…

Anomaly DetectionClassificationGeneral ClassificationMalware Classification+2

Learning Using Generated Privileged Information by Text-to-Image Diffusion Models

2023-09-26 · Rafael-Edy Menadil, Mariana-Iuliana Georgescu, Radu Tudor Ionescu

Learning Using Privileged Information is a particular type of knowledge distillation where the teacher model benefits from an additional data representation during training, called privileged information, improving the s…

ClassificationKnowledge Distillationtext-classificationText Classification

CNN Application in Detection of Privileged Documents in Legal Document Review

2021-02-09 · Rishi Chhatwal, Robert Keeling, Peter Gronvall, Nathaniel Huber-Fliflet 외

Protecting privileged communications and data from disclosure is paramount for legal teams. Legal advice, such as attorney-client communications or litigation strategy are typically exempt from disclosure in litigations …

text-classificationText Classification