paper-with-me

홈 › Papers

Bayesian Model-Agnostic Meta-Learning with Matrix-Valued Kernels for Quality Estimation

2021-08-01 · ACL (RepL4NLP) 2021 8 · Abiola Obamuyide, Marina Fomicheva, Lucia Specia

Most current quality estimation (QE) models for machine translation are trained and evaluated in a fully supervised setting requiring significant quantities of labelled training data. However, obtaining labelled data can be both expensive and time-consuming. In addition, the test data that a deployed QE model would be exposed to may differ from its training data in significant ways. In particular, training samples are often labelled by one or a small set of annotators, whose perceptions of translation quality and needs may differ substantially from those of end-users, who will employ predictions in practice. Thus, it is desirable to be able to adapt QE models efficiently to new user data with limited supervision data. To address these challenges, we propose a Bayesian meta-learning approach for adapting QE models to the needs and preferences of each user with limited supervision. To enhance performance, we further propose an extension to a state-of-the-art Bayesian meta-learning approach which utilizes a matrix-valued kernel for Bayesian meta-learning of quality estimation. Experiments on data with varying number of users and language characteristics demonstrates that the proposed Bayesian meta-learning approach delivers improved predictive performance in both limited and full supervision settings.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Machine TranslationMeta-LearningTranslation

Similar Papers 제목 키워드 기반

Stein Variational Gradient Descent With Matrix-Valued Kernels

2019-10-28 · NeurIPS 2019 12 · Dilin Wang, Ziyang Tang, Chandrajit Bajaj, Qiang Liu

Stein variational gradient descent (SVGD) is a particle-based inference algorithm that leverages gradient information for efficient approximate inference. In this work, we enhance SVGD by leveraging preconditioning matri…

Bayesian Inference

Random Fourier Features for Operator-Valued Kernels

2016-05-09 · Romain Brault, Florence d'Alché-Buc, Markus Heinonen

Devoted to multi-task learning and structured output learning, operator-valued kernels provide a flexible tool to build vector-valued functions in the context of Reproducing Kernel Hilbert Spaces. To scale up these metho…

Multi-Task LearningTranslation

Operator-Valued Bochner Theorem, Fourier Feature Maps for Operator-Valued Kernels, and Vector-Valued Learning

2016-08-19 · Ha Quang Minh

This paper presents a framework for computing random operator-valued feature maps for operator-valued positive definite kernels. This is a generalization of the random Fourier features for scalar-valued kernels to the op…

Flexible Low-Rank Statistical Modeling with Side Information

2013-08-20 · William Fithian, Rahul Mazumder

We propose a general framework for reduced-rank modeling of matrix-valued data. By applying a generalized nuclear norm penalty we can directly model low-dimensional latent variables associated with rows and columns. Our …

Matrix CompletionMulti-Task Learning

Forecasting and Granger Modelling with Non-linear Dynamical Dependencies

2017-06-27 · Magda Gregorová, Alexandros Kalousis, Stéphane Marchand-Maillet

Traditional linear methods for forecasting multivariate time series are not able to satisfactorily model the non-linear dependencies that may exist in non-Gaussian series. We build on the theory of learning vector-valued…

Time SeriesTime Series Analysis