paper-with-me

홈 › Papers

Optimal Subsampling with Influence Functions

2018-12-01 · NeurIPS 2018 12 · Daniel Ting, Eric Brochu

Subsampling is a common and often effective method to deal with the computational challenges of large datasets. However, for most statistical models, there is no well-motivated approach for drawing a non-uniform subsample. We show that the concept of an asymptotically linear estimator and the associated influence function leads to asymptotically optimal sampling probabilities for a wide class of popular models. This is the only tight optimality result for subsampling we are aware of as other methods only provide probabilistic error bounds or optimal rates. Furthermore, for linear regression models, which have well-studied procedures for non-uniform subsampling, we empirically show our optimal influence function based method outperforms previous approaches even when using approximations to the optimal probabilities.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

regression

Methods 이 논문이 사용한 방법론

Linear Regression Linear Regression is a method for modelling a relationship between a dependent variable and independent variables. These models can be fit with numerous approaches. The most…

Similar Papers 제목 키워드 기반

Model-specific Data Subsampling with Influence Functions

2020-10-20 · Anant Raj, Cameron Musco, Lester Mackey, Nicolo Fusi

Model selection requires repeatedly evaluating models on a given dataset and measuring their relative performances. In modern applications of machine learning, the models being considered are increasingly more expensive …

BIG-bench Machine LearningmodelModel Selection

Hyperparameter Selection for Subsampling Bootstraps

2020-06-02 · Yingying Ma, Hansheng Wang

Massive data analysis becomes increasingly prevalent, subsampling methods like BLB (Bag of Little Bootstraps) serves as powerful tools for assessing the quality of estimators for massive data. However, the performance of…

CPU

Less Is Better: Unweighted Data Subsampling via Influence Function

2019-12-03 · Zifeng Wang, Hong Zhu, Zhenhua Dong, Xiuqiang He 외

In the time of Big Data, training complex models on large-scale data sets is challenging, making it appealing to reduce data volume for saving computation resources by subsampling. Most previous works in subsampling are …

General Classificationimage-classificationImage Classificationtext-classification+1

A Study of Efficient Light Field Subsampling and Reconstruction Strategies

2020-08-11 · Yang Chen, Martin Alain, Aljosa Smolic

Limited angular resolution is one of the main obstacles for practical applications of light fields. Although numerous approaches have been proposed to enhance angular resolution, view selection strategies have not been w…

Super-Resolution

Optimal Distributed Subsampling for Maximum Quasi-Likelihood Estimators with Massive Data

2020-05-21 · Jun Yu, HaiYing Wang, Mingyao Ai, Huiming Zhang

Nonuniform subsampling methods are effective to reduce computational burden and maintain estimation efficiency for massive data. Existing methods mostly focus on subsampling with replacement due to its high computational…

Computational Efficiency