paper-with-me

홈 › Papers

Radial Prediction Layer

2019-05-27 · Christian Herta, Benjamin Voigt

For a broad variety of critical applications, it is essential to know how confident a classification prediction is. In this paper, we discuss the drawbacks of softmax to calculate class probabilities and to handle uncertainty in Bayesian neural networks. We introduce a new kind of prediction layer called radial prediction layer (RPL) to overcome these issues. In contrast to the softmax classification, RPL is based on the open-world assumption. Therefore, the class prediction probabilities are much more meaningful to assess the uncertainty concerning the novelty of the input. We show that neural networks with RPLs can be learned in the same way as neural networks using softmax. On a 2D toy data set (spiral data), we demonstrate the fundamental principles and advantages. On the real-world ImageNet data set, we show that the open-world properties are beneficially fulfilled. Additionally, we show that RPLs are less sensible to adversarial attacks on the MNIST data set. Due to its features, we expect RPL to be beneficial in a broad variety of applications, especially in critical environments, such as medicine or autonomous driving.

📄 PDF Abstract BibTeX arXiv:1905.11150

Code (1)

https://gitlab.com/peroyose/radial_prediction_layers 공식 구현 pytorch

Tasks

Autonomous DrivingGeneral ClassificationPrediction

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…

Similar Papers 제목 키워드 기반

Soft-Radial Projection for Constrained End-to-End Learning

2026-02-03 · Philipp J. Schneider, Daniel Kuhn arxiv

Integrating hard constraints into deep learning is essential for safety-critical systems. Yet existing constructive layers that project predictions onto constraint boundaries face a fundamental bottleneck: gradient satur…

Deep Radial Kernel Networks: Approximating Radially Symmetric Functions with Deep Networks

2017-03-09 · Brendan McCane, Lech Szymanski

We prove that a particular deep network architecture is more efficient at approximating radially symmetric functions than the best known 2 or 3 layer networks. We use this architecture to approximate Gaussian kernel SVMs…

A novel solution of deep learning for enhanced support vector machine for predicting the onset of type 2 diabetes

2022-08-05 · Marmik Shrestha, Omar Hisham Alsadoon, Abeer Alsadoon, Thair Al-Dala'in 외

Type 2 Diabetes is one of the most major and fatal diseases known to human beings, where thousands of people are subjected to the onset of Type 2 Diabetes every year. However, the diagnosis and prevention of Type 2 Diabe…

Vocal Bursts Type Prediction

Hybrid Machine Learning Model of Extreme Learning Machine Radial basis function for Breast Cancer Detection and Diagnosis; a Multilayer Fuzzy Expert System

2019-10-29 · Sanaz Mojrian, Gergo Pinter, Javad Hassannataj Joloudari, Imre Felde 외

Mammography is often used as the most common laboratory method for the detection of breast cancer, yet associated with the high cost and many side effects. Machine learning prediction as an alternative method has shown p…

Breast Cancer DetectionHybrid Machine LearningSpecificity

Neural Network Layers for Prediction of Positive Definite Elastic Stiffness Tensors

2022-03-25 · Charles F. Jekel, Kenneth E. Swartz, Daniel A. White, Daniel A. Tortorelli 외

Machine learning models can be used to predict physical quantities like homogenized elasticity stiffness tensors, which must always be symmetric positive definite (SPD) based on conservation arguments. Two datasets of ho…

BIG-bench Machine Learning