paper-with-me

홈 › Papers

Improving Noise Robustness through Abstractions and its Impact on Machine Learning

2024-06-12 · Alfredo Ibias, Karol Capala, Varun Ravi Varma, Anna Drozdz, Jose Sousa

Noise is a fundamental problem in learning theory with huge effects in the application of Machine Learning (ML) methods, due to real world data tendency to be noisy. Additionally, introduction of malicious noise can make ML methods fail critically, as is the case with adversarial attacks. Thus, finding and developing alternatives to improve robustness to noise is a fundamental problem in ML. In this paper, we propose a method to deal with noise: mitigating its effect through the use of data abstractions. The goal is to reduce the effect of noise over the model's performance through the loss of information produced by the abstraction. However, this information loss comes with a cost: it can result in an accuracy reduction due to the missing information. First, we explored multiple methodologies to create abstractions, using the training dataset, for the specific case of numerical data and binary classification tasks. We also tested how these abstractions can affect robustness to noise with several experiments that explore the robustness of an Artificial Neural Network to noise when trained using raw data \emph{vs} when trained using abstracted data. The results clearly show that using abstractions is a viable approach for developing noise robust ML methods.

📄 PDF Abstract BibTeX arXiv:2406.08428

Code (0)

등록된 구현이 없습니다.

Tasks

Binary ClassificationLearning Theory

Similar Papers 제목 키워드 기반

On computable abstractions (a conceptual introduction)

2014-08-29 · Alejandro Sanchez Guinea

This paper introduces abstractions that are meaningful for computers and that can be built and used according to computers' own criteria, i.e., computable abstractions. It is analyzed how abstractions can be seen to serv…

Constructing Optimal Noise Channels for Enhanced Robustness in Quantum Machine Learning

2024-04-25 · David Winderl, Nicola Franco, Jeanette Miriam Lorenz

With the rapid advancement of Quantum Machine Learning (QML), the critical need to enhance security measures against adversarial attacks and protect QML models becomes increasingly evident. In this work, we outline the c…

Quantum Machine Learning

Abstraction in decision-makers with limited information processing capabilities

2013-12-16 · Tim Genewein, Daniel A. Braun

A distinctive property of human and animal intelligence is the ability to form abstractions by neglecting irrelevant information which allows to separate structure from noise. From an information theoretic point of view …

Decision Making

Improving Robustness of Machine Translation with Synthetic Noise

2019-02-25 · NAACL 2019 6 · Vaibhav Vaibhav, Sumeet Singh, Craig Stewart, Graham Neubig

Modern Machine Translation (MT) systems perform consistently well on clean, in-domain text. However most human generated text, particularly in the realm of social media, is full of typos, slang, dialect, idiolect and oth…

Machine TranslationTranslation

Ideal Abstractions for Decision-Focused Learning

2023-03-29 · Michael Poli, Stefano Massaroli, Stefano Ermon, Bryan Wilder 외

We present a methodology for formulating simplifying abstractions in machine learning systems by identifying and harnessing the utility structure of decisions. Machine learning tasks commonly involve high-dimensional out…

Decision MakingManagement