FCM-RDpA: TSK Fuzzy Regression Model Construction Using Fuzzy C-Means Clustering, Regularization, DropRule, and Powerball AdaBelief
To effectively optimize Takagi-Sugeno-Kang (TSK) fuzzy systems for regression problems, a mini-batch gradient descent with regularization, DropRule, and AdaBound (MBGD-RDA) algorithm was recently proposed. This paper further proposes FCM-RDpA, which improves MBGD-RDA by replacing the grid partition approach in rule initialization by fuzzy c-means clustering, and AdaBound by Powerball AdaBelief, which integrates recently proposed Powerball gradient and AdaBelief to further expedite and stabilize parameter optimization. Extensive experiments on 22 regression datasets with various sizes and dimensionalities validated the superiority of FCM-RDpA over MBGD-RDA, especially when the feature dimensionality is higher. We also propose an additional approach, FCM-RDpAx, that further improves FCM-RDpA by using augmented features in both the antecedents and consequents of the rules.
Code (2)
Tasks
ClusteringregressionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Comparative of Genetic Fuzzy regression techniques for aeroacoustic phenomenons
This study investigates the application of Genetic Fuzzy Systems (GFS) to model the self-noise generated by airfoils, a key issue in aeroaccoustics with significant implications for aerospace, automotive and drone applic…
ClusteringregressionOn Coreset Constructions for the Fuzzy $K$-Means Problem
The fuzzy $K$-means problem is a popular generalization of the well-known $K$-means problem to soft clusterings. We present the first coresets for fuzzy $K$-means with size linear in the dimension, polynomial in the numb…
Interpretable Fuzzy Rule-Based Regression Extension for Ex-Fuzzy Library
Machine learning models achieve high predictive accuracy in regression tasks, but their deployment in safety-critical and regulated domains requires interpretability. While fuzzy rule-based systems offer transparent, lin…
Neuro-Fuzzy Random Vector Functional Link Neural Network for Classification and Regression Problems
The random vector functional link (RVFL) neural network has shown the potential to overcome traditional artificial neural networks’ limitations, such as substantial time consumption and the emergence of suboptimal soluti…
ClusteringDecision MakingNavigateFuzzy c-ordered-means clustering
Fuzzy clustering helps to find natural vague boundaries in data. The fuzzy c-means method is one of the most popular clustering methods based on minimization of a criterion function. However, one of the greatest disadva…
Clustering