paper-with-me

Papers

L2P: Learning to Place for Estimating Heavy-Tailed Distributed Outcomes

2019-08-13 · Xindi Wang, Onur Varol, Tina Eliassi-Rad

Many real-world prediction tasks have outcome variables that have characteristic heavy-tail distributions. Examples include copies of books sold, auction prices of art pieces, demand for commodities in warehouses, etc. By learning heavy-tailed distributions, "big and rare" instances (e.g., the best-sellers) will have accurate predictions. Most existing approaches are not dedicated to learning heavy-tailed distribution; thus, they heavily under-predict such instances. To tackle this problem, we introduce Learning to Place (L2P), which exploits the pairwise relationships between instances for learning. In its training phase, L2P learns a pairwise preference classifier: is instance A > instance B? In its placing phase, L2P obtains a prediction by placing the new instance among the known instances. Based on its placement, the new instance is then assigned a value for its outcome variable. Experiments on real data show that L2P outperforms competing approaches in terms of accuracy and ability to reproduce heavy-tailed outcome distribution. In addition, L2P provides an interpretable model by placing each predicted instance in relation to its comparable neighbors. Interpretable models are highly desirable when lives and treasure are at stake.

📄 PDF Abstract BibTeX arXiv:1908.04628

Code (1)

xindi-dumbledore/L2P 공식 구현

Similar Papers 제목 키워드 기반

SGD with Clipping is Secretly Estimating the Median Gradient

2024-02-20 · Fabian Schaipp, Guillaume Garrigos, Umut Simsekli, Robert Gower

There are several applications of stochastic optimization where one can benefit from a robust estimate of the gradient. For example, domains such as distributed learning with corrupted nodes, the presence of large outlie…

Stochastic Optimization

Improved Quantization Strategies for Managing Heavy-tailed Gradients in Distributed Learning

2024-02-02 · Guangfeng Yan, Tan Li, Yuanzhang Xiao, Hanxu Hou 외

Gradient compression has surfaced as a key technique to address the challenge of communication efficiency in distributed learning. In distributed deep learning, however, it is observed that gradient distributions are hea…

Quantization

Sparse Linear Regression when Noises and Covariates are Heavy-Tailed and Contaminated by Outliers

2024-08-02 · Takeyuki Sasai, Hironori Fujisawa

We investigate a problem estimating coefficients of linear regression under sparsity assumption when covariates and noises are sampled from heavy tailed distributions. Additionally, we consider the situation where not on…

regression

Estimating Rank-One Spikes from Heavy-Tailed Noise via Self-Avoiding Walks

2020-08-31 · NeurIPS 2020 12 · Jingqiu Ding, Samuel B. Hopkins, David Steurer

We study symmetric spiked matrix models with respect to a general class of noise distributions. Given a rank-1 deformation of a random noise matrix, whose entries are independently distributed with zero mean and unit var…

Distributed gradient methods under heavy-tailed communication noise

2025-05-30 · Manojlo Vukovic, Dusan Jakovetic, Dragana Bajovic, Soummya Kar

We consider a standard distributed optimization problem in which networked nodes collaboratively minimize the sum of their locally known convex costs. For this setting, we address for the first time the fundamental probl…

Distributed Optimization