paper-with-me

홈 › Papers

When are Non-Parametric Methods Robust?

2020-03-13 · ICML 2020 1 · Robi Bhattacharjee, Kamalika Chaudhuri

A growing body of research has shown that many classifiers are susceptible to {\em{adversarial examples}} -- small strategic modifications to test inputs that lead to misclassification. In this work, we study general non-parametric methods, with a view towards understanding when they are robust to these modifications. We establish general conditions under which non-parametric methods are r-consistent -- in the sense that they converge to optimally robust and accurate classifiers in the large sample limit. Concretely, our results show that when data is well-separated, nearest neighbors and kernel classifiers are r-consistent, while histograms are not. For general data distributions, we prove that preprocessing by Adversarial Pruning (Yang et. al., 2019) -- that makes data well-separated -- followed by nearest neighbors or kernel classifiers also leads to r-consistency.

📄 PDF Abstract BibTeX arXiv:2003.06121

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

Pruning 설명 없음

Similar Papers 제목 키워드 기반

Variable selection with missing data in both covariates and outcomes: Imputation and machine learning

2021-04-06 · Liangyuan Hu, Jung-Yi Joyce Lin, Jiayi Ji

The missing data issue is ubiquitous in health studies. Variable selection in the presence of both missing covariates and outcomes is an important statistical research topic but has been less studied. Existing literature…

BIG-bench Machine LearningImputationregressionVariable Selection

"Merge Conflicts!" Exploring the Impacts of External Distractors to Parametric Knowledge Graphs

2023-09-15 · Cheng Qian, Xinran Zhao, Sherry Tongshuang Wu

Large language models (LLMs) acquire extensive knowledge during pre-training, known as their parametric knowledge. However, in order to remain up-to-date and align with human instructions, LLMs inevitably require externa…

HallucinationKnowledge Graphs

VQ-HPS: Human Pose and Shape Estimation in a Vector-Quantized Latent Space

2023-12-13 · Guénolé Fiche, Simon Leglaive, Xavier Alameda-Pineda, Antonio Agudo 외

Previous works on Human Pose and Shape Estimation (HPSE) from RGB images can be broadly categorized into two main groups: parametric and non-parametric approaches. Parametric techniques leverage a low-dimensional statist…

Nonparametric IPSS: Fast, flexible feature selection with false discovery control

2024-10-03 · Omar Melikechi, David B. Dunson, Jeffrey W. Miller

Feature selection is a critical task in machine learning and statistics. However, existing feature selection methods either (i) rely on parametric methods such as linear or generalized linear models, (ii) lack theoretica…

Feature Importancefeature selection

Bayesian nonparametric modeling for predicting dynamic dependencies in multiple object tracking

2020-04-22 · Bahman Moraffah, Antonia Papndreou-Suppopola

Some challenging problems in tracking multiple objects include the time-dependent cardinality, unordered measurements and object parameter labeling. In this paper, we employ Bayesian Bayesian nonparametric methods to add…

Multiple Object TrackingObjectObject Tracking