paper-with-me

Papers

Rejection via Learning Density Ratios

2024-05-29 · Alexander Soen, Hisham Husain, Philip Schulz, Vu Nguyen

Classification with rejection emerges as a learning paradigm which allows models to abstain from making predictions. The predominant approach is to alter the supervised learning pipeline by augmenting typical loss functions, letting model rejection incur a lower loss than an incorrect prediction. Instead, we propose a different distributional perspective, where we seek to find an idealized data distribution which maximizes a pretrained model's performance. This can be formalized via the optimization of a loss's risk with a $\varphi$-divergence regularization term. Through this idealized distribution, a rejection decision can be made by utilizing the density ratio between this distribution and the data distribution. We focus on the setting where our $\varphi$-divergences are specified by the family of $\alpha$-divergence. Our framework is tested empirically over clean and noisy datasets.

📄 PDF Abstract BibTeX arXiv:2405.18686

Code (1)

alexandersoen/density-ratio-rejection 공식 구현 pytorch

Methods 이 논문이 사용한 방법론

Focus 설명 없음

Similar Papers 제목 키워드 기반

Binary classification based Monte Carlo simulation

2023-07-29 · Elouan Argouarc'h, François Desbouvries

Acceptance-rejection (AR), Independent Metropolis Hastings (IMH) or importance sampling (IS) Monte Carlo (MC) simulation algorithms all involve computing ratios of probability density functions (pdfs). On the other hand,…

Binary ClassificationClassification

A minimax near-optimal algorithm for adaptive rejection sampling

2018-10-22 · Juliette Achdou, Joseph C. Lam, Alexandra Carpentier, Gilles Blanchard

Rejection Sampling is a fundamental Monte-Carlo method. It is used to sample from distributions admitting a probability density function which can be evaluated exactly at any given point, albeit at a high computational c…

Multi-Personality Generation of LLMs at Decoding-time

2025-10-27 · Rongxin Chen, Yunfan Li, Yige Yuan, Bingbing Xu 외 arxiv

Multi-personality generation for LLMs, enabling simultaneous embodiment of multiple personalization attributes, is a fundamental challenge. Existing retraining-based approaches are costly and poorly scalable, while decod…

Anomaly Detection with Adaptive and Aggressive Rejection for Contaminated Training Data

2025-11-26 · Jungi Lee, Jungkwon Kim, Chi Zhang, Kwangsun Yoo 외 arxiv

Handling contaminated data poses a critical challenge in anomaly detection, as traditional models assume training on purely normal data. Conventional methods mitigate contamination by relying on fixed contamination ratio…

Anomaly Detection

Mode-Seeking Clustering and Density Ridge Estimation via Direct Estimation of Density-Derivative-Ratios

2017-07-06 · Hiroaki Sasaki, Takafumi Kanamori, Aapo Hyvärinen, Gang Niu 외

Modes and ridges of the probability density function behind observed data are useful geometric features. Mode-seeking clustering assigns cluster labels by associating data samples with the nearest modes, and estimation o…

ClusteringDensity Estimation