paper-with-me

Papers

Probabilistic task modelling for meta-learning

2021-06-09 · Cuong C. Nguyen, Thanh-Toan Do, Gustavo Carneiro

We propose probabilistic task modelling -- a generative probabilistic model for collections of tasks used in meta-learning. The proposed model combines variational auto-encoding and latent Dirichlet allocation to model each task as a mixture of Gaussian distribution in an embedding space. Such modelling provides an explicit representation of a task through its task-theme mixture. We present an efficient approximation inference technique based on variational inference method for empirical Bayes parameter estimation. We perform empirical evaluations to validate the task uncertainty and task distance produced by the proposed method through correlation diagrams of the prediction accuracy on testing tasks. We also carry out experiments of task selection in meta-learning to demonstrate how the task relatedness inferred from the proposed model help to facilitate meta-learning algorithms.

📄 PDF Abstract BibTeX arXiv:2106.04802

Code (1)

cnguyen10/probabilistic_task_modelling 공식 구현 pytorch

Tasks

Meta-Learningparameter estimationVariational Inference

Methods 이 논문이 사용한 방법론

Variational Inference 설명 없음

Similar Papers 제목 키워드 기반

Probabilistic supervised learning

2018-01-02 · Frithjof Gressmann, Franz J. Király, Bilal Mateen, Harald Oberhauser

Predictive modelling and supervised learning are central to modern data science. With predictions from an ever-expanding number of supervised black-box strategies - e.g., kernel methods, random forests, deep learning aka…

BIG-bench Machine LearningDecision MakingPrediction

Density Matrices for Metaphor Understanding

2024-08-12 · Jay Owers, Ekaterina Shutova, Martha Lewis

In physics, density matrices are used to represent mixed states, i.e. probabilistic mixtures of pure states. This concept has previously been used to model lexical ambiguity. In this paper, we consider metaphor as a type…

Structural thermokinetic modelling

2013-09-01 · Wolfram Liebermeister

Translating metabolic networks into dynamic models is difficult if kinetic constants are unknown. Structural Kinetic Modelling (SKM) replaces reaction elasticities by independent random numbers. Here I propose a variant …

Probabilistic emotion and sentiment modelling of patient-reported experiences

2024-01-09 · Curtis Murray, Lewis Mitchell, Jonathan Tuke, Mark Mackay

This study introduces a novel methodology for modelling patient emotions from online patient experience narratives. We employed metadata network topic modelling to analyse patient-reported experiences from Care Opinion, …

Information RetrievalRecommendation SystemsRetrieval

Taylorformer: Probabilistic Modelling for Random Processes including Time Series

2023-05-30 · Omer Nivron, Raghul Parthipan, Damon J. Wischik

We propose the Taylorformer for random processes such as time series. Its two key components are: 1) the LocalTaylor wrapper which adapts Taylor approximations (used in dynamical systems) for use in neural network-based …

Gaussian ProcessesMeta-LearningTime Series