paper-with-me

홈 › Papers

Copying Machine Learning Classifiers

2019-03-05 · Irene Unceta, Jordi Nin, Oriol Pujol

We study model-agnostic copies of machine learning classifiers. We develop the theory behind the problem of copying, highlighting its differences with that of learning, and propose a framework to copy the functionality of any classifier using no prior knowledge of its parameters or training data distribution. We identify the different sources of loss and provide guidelines on how best to generate synthetic sets for the copying process. We further introduce a set of metrics to evaluate copies in practice. We validate our framework through extensive experiments using data from a series of well-known problems. We demonstrate the value of copies in use cases where desiderata such as interpretability, fairness or productivization constrains need to be addressed. Results show that copies can be exploited to enhance existing solutions and improve them adding new features and characteristics.

📄 PDF Abstract BibTeX arXiv:1903.01879

Code (0)

등록된 구현이 없습니다.

Tasks

BIG-bench Machine LearningFairness

Similar Papers 제목 키워드 기반

A Scalable and Efficient Iterative Method for Copying Machine Learning Classifiers

2023-02-06 · Nahuel Statuto, Irene Unceta, Jordi Nin, Oriol Pujol

Differential replication through copying refers to the process of replicating the decision behavior of a machine learning model using another model that possesses enhanced features and attributes. This process is relevan…

On the Copying Behaviors of Pre-Training for Neural Machine Translation

2021-07-17 · Findings (ACL) 2021 8 · Xuebo Liu, Longyue Wang, Derek F. Wong, Liang Ding 외

Previous studies have shown that initializing neural machine translation (NMT) models with the pre-trained language models (LM) can speed up the model training and boost the model performance. In this work, we identify a…

Machine TranslationNMTTranslation

Incorporating Copying Mechanism in Image Captioning for Learning Novel Objects

2017-08-17 · CVPR 2017 7 · Ting Yao, Yingwei Pan, Yehao Li, Tao Mei

Image captioning often requires a large set of training image-sentence pairs. In practice, however, acquiring sufficient training pairs is always expensive, making the recent captioning models limited in their ability to…

DecoderImage CaptioningObject RecognitionSentence

Context and Copying in Neural Machine Translation

2018-10-01 · EMNLP 2018 10 · Rebecca Knowles, Philipp Koehn

Neural machine translation systems with subword vocabularies are capable of translating or copying unknown words. In this work, we show that they learn to copy words based on both the context in which the words appear as…

Machine TranslationTranslation

A Non-Parametric Test to Detect Data-Copying in Generative Models

2020-04-12 · Casey Meehan, Kamalika Chaudhuri, Sanjoy Dasgupta

Detecting overfitting in generative models is an important challenge in machine learning. In this work, we formalize a form of overfitting that we call {\em{data-copying}} -- where the generative model memorizes and outp…

BIG-bench Machine Learning