paper-with-me

Papers

A MapReduce based distributed SVM algorithm for binary classification

2013-12-15 · Ferhat Özgür Çatak, Mehmet Erdal Balaban

Although Support Vector Machine (SVM) algorithm has a high generalization property to classify for unseen examples after training phase and it has small loss value, the algorithm is not suitable for real-life classification and regression problems. SVMs cannot solve hundreds of thousands examples in training dataset. In previous studies on distributed machine learning algorithms, SVM is trained over a costly and preconfigured computer environment. In this research, we present a MapReduce based distributed parallel SVM training algorithm for binary classification problems. This work shows how to distribute optimization problem over cloud computing systems with MapReduce technique. In the second step of this work, we used statistical learning theory to find the predictive hypothesis that minimize our empirical risks from hypothesis spaces that created with reduce function of MapReduce. The results of this research are important for training of big datasets for SVM algorithm based classification problems. We provided that iterative training of split dataset with MapReduce technique; accuracy of the classifier function will converge to global optimal classifier function's accuracy in finite iteration size. The algorithm performance was measured on samples from letter recognition and pen-based recognition of handwritten digits dataset.

📄 PDF Abstract BibTeX arXiv:1312.4108

Code (0)

등록된 구현이 없습니다.

Tasks

Binary ClassificationClassificationCloud ComputingGeneral ClassificationLearning Theory

Methods 이 논문이 사용한 방법론

SVM A Support Vector Machine, or SVM, is a non-parametric supervised learning model. For non-linear classification and regression, they utilise the kernel trick to map inputs…

Similar Papers 제목 키워드 기반

Polarization Measurement of High Dimensional Social Media Messages With Support Vector Machine Algorithm Using Mapreduce

2014-10-10 · Ferhat Özgür Çatak

In this article, we propose a new Support Vector Machine (SVM) training algorithm based on distributed MapReduce technique. In literature, there are a lots of research that shows us SVM has highest generalization propert…

ClassificationGeneral ClassificationSentiment Analysis

Parallel Genetic Algorithm to Solve Traveling Salesman Problem on MapReduce Framework using Hadoop Cluster

2014-01-24 · Harun Rasit Er, Nadia Erdogan

Traveling Salesman Problem (TSP) is one of the most common studied problems in combinatorial optimization. Given the list of cities and distances between them, the problem is to find the shortest tour possible which visi…

Combinatorial OptimizationTraveling Salesman Problem

Simple one-pass algorithm for penalized linear regression with cross-validation on MapReduce

2013-06-28 · Kun Yang

In this paper, we propose a one-pass algorithm on MapReduce for penalized linear regression \[f_\lambda(\alpha, \beta) = \|Y - \alpha\mathbf{1} - X\beta\|_2^2 + p_{\lambda}(\beta)\] where $\alpha$ is the intercept whic…

regression

Feature selection in high-dimensional dataset using MapReduce

2017-09-07 · Claudio Reggiani, Yann-Aël Le Borgne, Gianluca Bontempi

This paper describes a distributed MapReduce implementation of the minimum Redundancy Maximum Relevance algorithm, a popular feature selection method in bioinformatics and network inference problems. The proposed approac…

feature selectionVocal Bursts Intensity Prediction

RDD-Eclat: Approaches to Parallelize Eclat Algorithm on Spark RDD Framework

2019-12-13 · Pankaj Singh, Sudhakar Singh, P. K. Mishra, Rakhi Garg

Initially, a number of frequent itemset mining (FIM) algorithms have been designed on the Hadoop MapReduce, a distributed big data processing framework. But, due to heavy disk I/O, MapReduce is found to be inefficient fo…