paper-with-me

홈 › Papers

Winner-takes-all learners are geometry-aware conditional density estimators

2024-06-07 · Victor Letzelter, David Perera, Cédric Rommel, Mathieu Fontaine, Slim Essid, Gael Richard, Patrick Pérez

Winner-takes-all training is a simple learning paradigm, which handles ambiguous tasks by predicting a set of plausible hypotheses. Recently, a connection was established between Winner-takes-all training and centroidal Voronoi tessellations, showing that, once trained, hypotheses should quantize optimally the shape of the conditional distribution to predict. However, the best use of these hypotheses for uncertainty quantification is still an open question.In this work, we show how to leverage the appealing geometric properties of the Winner-takes-all learners for conditional density estimation, without modifying its original training scheme. We theoretically establish the advantages of our novel estimator both in terms of quantization and density estimation, and we demonstrate its competitiveness on synthetic and real-world datasets, including audio data.

📄 PDF Abstract BibTeX arXiv:2406.04706

Code (1)

Victorletzelter/VoronoiWTA 공식 구현 pytorch

Tasks

AllDensity EstimationQuantizationUncertainty Quantification

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Similar Papers 제목 키워드 기반

MolMiner: Towards Controllable, 3D-Aware, Fragment-Based Molecular Design

2024-11-10 · Raul Ortega-Ochoa, Tejs Vegge, Jes Frellsen

We introduce MolMiner, a fragment-based, geometry-aware, and order-agnostic autoregressive model for molecular design. MolMiner supports conditional generation of molecules over twelve properties, enabling flexible contr…

3D geometryBenchmarking

GDR-learners: Orthogonal Learning of Generative Models for Potential Outcomes

2025-09-26 · Valentyn Melnychuk, Stefan Feuerriegel arxiv

Various deep generative models have been proposed to estimate potential outcomes distributions from observational data. However, none of them have the favorable theoretical property of general Neyman-orthogonality and, a…

Stochastic Local Winner-Takes-All Networks Enable Profound Adversarial Robustness

2021-12-05 · Konstantinos P. Panousis, Sotirios Chatzis, Sergios Theodoridis

This work explores the potency of stochastic competition-based activations, namely Stochastic Local Winner-Takes-All (LWTA), against powerful (gradient-based) white-box and black-box adversarial attacks; we especially fo…

Adversarial AttackAdversarial DefenseAdversarial RobustnessAll+1

Geometry-Aware Instrumental Variable Regression

2024-05-19 · Heiner Kremer, Bernhard Schölkopf

Instrumental variable (IV) regression can be approached through its formulation in terms of conditional moment restrictions (CMR). Building on variants of the generalized method of moments, most CMR estimators are implic…

regression

A Winner-Takes-All Mechanism for Event Generation

2025-04-15 · Yongkang Huo, Fuvio Forni, Rodolphe Sepulchre

We present a novel framework for central pattern generator design that leverages the intrinsic rebound excitability of neurons in combination with winner-takes-all computation. Our approach unifies decision-making and rh…

AllDecision Making