Data Aggregation for Reducing Training Data in Symbolic Regression
The growing volume of data makes the use of computationally intense machine learning techniques such as symbolic regression with genetic programming more and more impractical. This work discusses methods to reduce the training data and thereby also the runtime of genetic programming. The data is aggregated in a preprocessing step before running the actual machine learning algorithm. K-means clustering and data binning is used for data aggregation and compared with random sampling as the simplest data reduction method. We analyze the achieved speed-up in training and the effects on the trained models test accuracy for every method on four real-world data sets. The performance of genetic programming is compared with random forests and linear regression. It is shown, that k-means and random sampling lead to very small loss in test accuracy when the data is reduced down to only 30% of the original data, while the speed-up is proportional to the size of the data set. Binning on the contrary, leads to models with very high test error.
Code (0)
등록된 구현이 없습니다.
Tasks
BIG-bench Machine LearningregressionSymbolic RegressionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Better Later Than Sooner: Neuro-Symbolic Knowledge Graph Construction via Ontology-grounded Post-extraction Correction
Question answering (QA) is a core challenge in AI, particularly for complex queries requiring multi-hop reasoning across documents, or symbolic operations like aggregation or exhaustive listing. Retrieval-augmented gener…
Question AnsweringKnowledge GraphsAn efficient aggregation method for the symbolic representation of temporal data
Symbolic representations are a useful tool for the dimension reduction of temporal data, allowing for the efficient storage of and information retrieval from time series. They can also enhance the training of machine lea…
Dimensionality ReductionInformation RetrievalRetrievalTime Series+1SymED: Adaptive and Online Symbolic Representation of Data on the Edge
The edge computing paradigm helps handle the Internet of Things (IoT) generated data in proximity to its source. Challenges occur in transferring, storing, and processing this rapidly growing amount of data on resource-c…
Anomaly DetectionData CompressionDynamic Time WarpingEdge-computingPredicting symbolic ODEs from multiple trajectories
We introduce MIO, a transformer-based model for inferring symbolic ordinary differential equations (ODEs) from multiple observed trajectories of a dynamical system. By combining multiple instance learning with transforme…
Multiple Instance LearningNeuro-symbolic Explainable Artificial Intelligence Twin for Zero-touch IoE in Wireless Network
Explainable artificial intelligence (XAI) twin systems will be a fundamental enabler of zero-touch network and service management (ZSM) for sixth-generation (6G) wireless networks. A reliable XAI twin system for ZSM requ…
Explainable artificial intelligenceExplainable Artificial Intelligence (XAI)Language ModellingManagement