Fourier Transform Approach to Machine Learning III: Fourier Classification
We propose a Fourier-based learning algorithm for highly nonlinear multiclass classification. The algorithm is based on a smoothing technique to calculate the probability distribution of all classes. To obtain the probability distribution, the density distribution of each class is smoothed by a low-pass filter separately. The advantage of the Fourier representation is capturing the nonlinearities of the data distribution without defining any kernel function. Furthermore, contrary to the support vector machines, it makes a probabilistic explanation for the classification possible. Moreover, it can treat overlapped classes as well. Comparing to the logistic regression, it does not require feature engineering. In general, its computational performance is also very well for large data sets and in contrast to other algorithms, the typical overfitting problem does not happen at all. The capability of the algorithm is demonstrated for multiclass classification with overlapped classes and very high nonlinearity of the class distributions.
Code (0)
등록된 구현이 없습니다.
Tasks
BIG-bench Machine LearningClassificationFeature EngineeringGeneral ClassificationSimilar Papers 제목 키워드 기반
Three-Dimensional Fourier Scattering Transform and Classification of Hyperspectral Images
Recent developments in machine learning and signal processing have resulted in many new techniques that are able to effectively capture the intrinsic yet complex properties of hyperspectral imagery. Tasks ranging from an…
Anomaly DetectionClassificationGeneral ClassificationHyperspectral Image Classification+1Fourier Image Transformer
Transformer architectures show spectacular performance on NLP tasks and have recently also been used for tasks such as image completion or image classification. Here we propose to use a sequential image representation, w…
Computed Tomography (CT)Decoderimage-classificationImage Classification+1Learning Set Functions that are Sparse in Non-Orthogonal Fourier Bases
Many applications of machine learning on discrete domains, such as learning preference functions in recommender systems or auctions, can be reduced to estimating a set function that is sparse in the Fourier domain. In th…
Recommendation SystemsFourier Sensitivity and Regularization of Computer Vision Models
Recent work has empirically shown that deep neural networks latch on to the Fourier statistics of training data and show increased sensitivity to Fourier-basis directions in the input. Understanding and modifying this Fo…
SensitivityGrain Surface Classification via Machine Learning Methods
In this study, radar signals were analyzed to classify grain surface types by using machine learning methods. Radar backscatter signals were recorded using a vector network analyzer between 18-40 GHz. A total of 5681 mea…
BIG-bench Machine LearningClassificationGeneral Classification