paper-with-me

홈 › Papers

Neural Prior Estimation: Learning Class Priors from Latent Representations

2026-02-19 · Masoud Yavari, Payman Moallem arxiv

Logit adjustment corrects class imbalance using the empirical class prior. We study whether a comparable class-frequency signal can instead be learned from the network representation, without explicitly supplying class counts to the correction rule. We introduce the Neural Prior Estimator (NPE), which attaches one or more lightweight Prior Estimation Modules (PEMs) to the latent representation. Each PEM is trained with a one-way logistic objective on the ground-truth coordinate. The resulting frequency-dependent outputs are combined into an NPE estimate and used as a learned logit correction, forming NPE-LA. In a simplified scalar model, the optimum of the PEM objective is monotone in the class count and grows asymptotically as $\log N_c$, up to a slower $\log \log N_c$ term. Experiments on long-tailed CIFAR-10 and CIFAR-100 show that NPE-LA is competitive with standard logit adjustment and improves minority-class performance over CE and cRT in the reported settings. Experiments on STARE and ADE20K further show that the same idea can be used as a lightweight recalibration mechanism for dense prediction.

📄 PDF Abstract BibTeX arXiv:2602.17853

Code (0)

등록된 구현이 없습니다.

Tasks

Semantic Segmentation

Similar Papers 제목 키워드 기반

Meta-learning richer priors for VAEs

2021-11-22 · pproximateinference AABI Symposium 2022 2 · Marcello Massimo Negri, Vincent Fortuin, Jan Stuehmer

Variational auto-encoders have proven to capture complicated data distributions and useful latent representations, while advances in meta-learning have made it possible to extract prior knowledge from data. We incorporat…

Meta-Learning

Learning Group Actions In Disentangled Latent Image Representations

2025-12-03 · Farhana Hossain Swarnali, Miaomiao Zhang, Tonmoy Hossain arxiv

Modeling group actions on latent representations enables controllable transformations of high-dimensional image data. Prior works applying group-theoretic priors or modeling transformations typically operate in the high-…

Variational Autoencoder with Disentanglement Priors for Low-Resource Task-Specific Natural Language Generation

2022-02-27 · Zhuang Li, Lizhen Qu, Qiongkai Xu, Tongtong Wu 외

In this paper, we propose a variational autoencoder with disentanglement priors, VAE-DPRIOR, for task-specific natural language generation with none or a handful of task-specific labeled examples. In order to tackle comp…

Data AugmentationDisentanglementFew-Shot LearningRepresentation Learning+3

Decoupled Sparse Priors Guided Diffusion Compression Model for Point Clouds

2024-11-21 · Xiaoge Zhang, Zijie Wu, Mehwish Nasim, Mingtao Feng 외

Lossy compression methods rely on an autoencoder to transform a point cloud into latent points for storage, leaving the inherent redundancy of latent representations unexplored. To reduce redundancy in latent points, we …

Decoder

Distantly Supervised Relation Extraction with Sentence Reconstruction and Knowledge Base Priors

2021-04-16 · NAACL 2021 4 · Fenia Christopoulou, Makoto Miwa, Sophia Ananiadou

We propose a multi-task, probabilistic approach to facilitate distantly supervised relation extraction by bringing closer the representations of sentences that contain the same Knowledge Base pairs. To achieve this, we b…

Multi-Task LearningRelationRelation ExtractionSentence