6533b82efe1ef96bd12926b3
RESEARCH PRODUCT
Adjusted bat algorithm for tuning of support vector machine parameters
Dana SimianMilan TubaEva Tubasubject
0209 industrial biotechnologyWake-sleep algorithmActive learning (machine learning)Computer scienceStability (learning theory)Linear classifier02 engineering and technologySemi-supervised learningcomputer.software_genreCross-validationRelevance vector machineKernel (linear algebra)020901 industrial engineering & automationLeast squares support vector machine0202 electrical engineering electronic engineering information engineeringMetaheuristicBat algorithmStructured support vector machinebusiness.industrySupervised learningOnline machine learningParticle swarm optimizationPattern recognitionPerceptronGeneralization errorSupport vector machineKernel methodComputational learning theoryMargin classifierHyperparameter optimization020201 artificial intelligence & image processingData miningArtificial intelligenceHyper-heuristicbusinesscomputerdescription
Support vector machines are powerful and often used technique of supervised learning applied to classification. Quality of the constructed classifier can be improved by appropriate selection of the learning parameters. These parameters are often tuned using grid search with relatively large step. This optimization process can be done computationally more efficiently and more precisely using stochastic search metaheuristics. In this paper we propose adjusted bat algorithm for support vector machines parameter optimization and show that compared to the grid search it leads to a better classifier. We tested our approach on standard set of benchmark data sets from UCI machine learning repository. Additionally, proposed algorithm was compared to other approaches from the literature where our algorithm obtained more accurate classifiers, with larger percent of correct classifications, especially in the more realistic cases where separate test sets were used instead of cross validation only.
year | journal | country | edition | language |
---|---|---|---|---|
2016-07-01 | 2016 IEEE Congress on Evolutionary Computation (CEC) |