paper-with-me

홈 › Papers

Open-Set Likelihood Maximization for Few-Shot Learning

2023-01-20 · CVPR 2023 1 · Malik Boudiaf, Etienne Bennequin, Myriam Tami, Antoine Toubhans, Pablo Piantanida, Céline Hudelot, Ismail Ben Ayed

We tackle the Few-Shot Open-Set Recognition (FSOSR) problem, i.e. classifying instances among a set of classes for which we only have a few labeled samples, while simultaneously detecting instances that do not belong to any known class. We explore the popular transductive setting, which leverages the unlabelled query instances at inference. Motivated by the observation that existing transductive methods perform poorly in open-set scenarios, we propose a generalization of the maximum likelihood principle, in which latent scores down-weighing the influence of potential outliers are introduced alongside the usual parametric model. Our formulation embeds supervision constraints from the support set and additional penalties discouraging overconfident predictions on the query set. We proceed with a block-coordinate descent, with the latent scores and parametric model co-optimized alternately, thereby benefiting from each other. We call our resulting formulation \textit{Open-Set Likelihood Optimization} (OSLO). OSLO is interpretable and fully modular; it can be applied on top of any pre-trained model seamlessly. Through extensive experiments, we show that our method surpasses existing inductive and transductive methods on both aspects of open-set recognition, namely inlier classification and outlier detection.

📄 PDF Abstract BibTeX arXiv:2301.08390

Code (1)

ebennequin/few-shot-open-set 공식 구현 pytorch

Tasks

Few-Shot Image ClassificationFew-Shot LearningOpen Set LearningOutlier Detection

Similar Papers 제목 키워드 기반

Observational nonidentifiability, generalized likelihood and free energy

2020-02-18 · A. E. Allahverdyan

We study the parameter estimation problem in mixture models with observational nonidentifiability: the full model (also containing hidden variables) is identifiable, but the marginal (observed) model is not. Hence global…

parameter estimation

PartSLIP++: Enhancing Low-Shot 3D Part Segmentation via Multi-View Instance Segmentation and Maximum Likelihood Estimation

2023-12-05 · Yuchen Zhou, Jiayuan Gu, Xuanlin Li, Minghua Liu 외

Open-world 3D part segmentation is pivotal in diverse applications such as robotics and AR/VR. Traditional supervised methods often grapple with limited 3D data availability and struggle to generalize to unseen object ca…

3D Instance Segmentation3D Part SegmentationInstance SegmentationSegmentation+1

Analytical Probability Distributions and Exact Expectation-Maximization for Deep Generative Networks

2020-12-01 · NeurIPS 2020 12 · Randall Balestriero, Sebastien Paris, Richard Baraniuk

Deep Generative Networks (DGNs) with probabilistic modeling of their output and latent space are currently trained via Variational Autoencoders (VAEs). In the absence of a known analytical form for the posterior and like…

Anomaly DetectionImputationVariational Inference

Learning Arbitrary Sum-Product Network Leaves with Expectation-Maximization

2016-04-25 · Mattia Desana, Christoph Schnörr

Sum-Product Networks with complex probability distribution at the leaves have been shown to be powerful tractable-inference probabilistic models. However, while learning the internal parameters has been amply studied, le…

Density Estimation

A Matrix--free Likelihood Method for Exploratory Factor Analysis of High-dimensional Gaussian Data

2019-07-27 · Fan Dai, Somak Dutta, Ranjan Maitra

This paper proposes a novel profile likelihood method for estimating the covariance parameters in exploratory factor analysis of high-dimensional Gaussian datasets with fewer observations than number of variables. An imp…