paper-with-me

홈 › Papers

Quantification using Permutation-Invariant Networks based on Histograms

2024-03-22 · Olaya Pérez-Mon, Alejandro Moreo, Juan José del Coz, Pablo González

Quantification, also known as class prevalence estimation, is the supervised learning task in which a model is trained to predict the prevalence of each class in a given bag of examples. This paper investigates the application of deep neural networks to tasks of quantification in scenarios where it is possible to apply a symmetric supervised approach that eliminates the need for classification as an intermediary step, directly addressing the quantification problem. Additionally, it discusses existing permutation-invariant layers designed for set processing and assesses their suitability for quantification. In light of our analysis, we propose HistNetQ, a novel neural architecture that relies on a permutation-invariant representation based on histograms that is specially suited for quantification problems. Our experiments carried out in the only quantification competition held to date, show that HistNetQ outperforms other deep neural architectures devised for set processing, as well as the state-of-the-art quantification methods. Furthermore, HistNetQ offers two significant advantages over traditional quantification methods: i) it does not require the labels of the training examples but only the prevalence values of a collection of training bags, making it applicable to new scenarios; and ii) it is able to optimize any custom quantification-oriented loss function.

📄 PDF Abstract BibTeX arXiv:2403.15123

Code (1)

a2032/a2032 공식 구현 pytorch

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Similar Papers 제목 키워드 기반

Deep set based operator learning with uncertainty quantification

2025-09-30 · Lei Ma, Ling Guo, Hao Wu, Tao Zhou arxiv

Learning operators from data is central to scientific machine learning. While DeepONets are widely used for their ability to handle complex domains, they require fixed sensor numbers and locations, lack mechanisms for un…

Permutation invariant multi-output Gaussian Processes for drug combination prediction in cancer

2024-06-28 · Leiv Rønneberg, Vidhi Lalchand, Paul D. W. Kirk

Dose-response prediction in cancer is an active application field in machine learning. Using large libraries of \textit{in-vitro} drug sensitivity screens, the goal is to develop accurate predictive models that can be us…

Experimental DesignGaussian ProcessesPredictionUncertainty Quantification

Regularizing Towards Permutation Invariance in Recurrent Models

2020-10-25 · NeurIPS 2020 12 · Edo Cohen-Karlik, Avichai Ben David, Amir Globerson

In many machine learning problems the output should not depend on the order of the input. Such "permutation invariant" functions have been studied extensively recently. Here we argue that temporal architectures such as R…

Kernel Density Estimation for Multiclass Quantification

2023-12-31 · Alejandro Moreo, Pablo González, Juan José del Coz

Several disciplines, like the social sciences, epidemiology, sentiment analysis, or market research, are interested in knowing the distribution of the classes in a population rather than the individual labels of the memb…

Density EstimationEpidemiologyMulticlass QuantificationSentiment Analysis

Permutation invariant functions: statistical tests, density estimation, and computationally efficient embedding

2024-03-04 · Wee Chaimanowong, Ying Zhu

Permutation invariance is among the most common symmetry that can be exploited to simplify complex problems in machine learning (ML). There has been a tremendous surge of research activities in building permutation invar…

Density EstimationDimensionality Reduction