Skip to main content
Log in

Decision function estimation using intelligent gravitational search algorithm

  • Original Article
  • Published:
International Journal of Machine Learning and Cybernetics Aims and scope Submit manuscript

Abstract

There are various kinds of supervised classification techniques such as Bayesian classifier, k nearest neighbor, neural network and rule based classifiers. A kind of supervised classifier, estimates the necessary decision hyperplanes for separating the feature space to distinct regions for recognizing unknown put patterns. In this paper a novel swarm intelligence based classifier is described for decision function estimation without requirement to priory knowledge. The utilized swarm intelligence technique is gravitational search algorithm (GSA) which has been recently reported. The proposed method is called intelligent GSA based classifier (IGSA-classifier). At first, a fuzzy system is designed for intelligently updating the effective parameters of GSA. Those are gravitational coefficient and the number of effective objects, two important parameters which play major roles on search process of GSA. Then the designed intelligent GSA is employed to construct a novel decision function estimation algorithm from feature space. Extensive experimental results on different benchmarks and a practical pattern recognition problem with nonlinear, overlapping class boundaries and different feature space dimensions are provided to show the capability of the proposed method. The comparative results show that the performance of the proposed classifier is comparable to or better than the performance of other swarm intelligence based and evolutionary classifiers.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4

Similar content being viewed by others

Notes

  1. This evolutionary classifier was inserted to comparative results based on one of the reviewers’ comments.

  2. These data sets are available from the site: http://archive.ics.uci.edu/ml/datasets

References

  1. Rashedi E, Nezamabadi-pour H, Saryazdi S (2009) GSA: a gravitational search algorithm. Inform Sci 179(13): 2232–2248

    Google Scholar 

  2. Storn R, Price K (1997) Differential evolution—a simple and efficient heuristic for global optimization over continuous spaces. J Glob Optim 11:341–359

    Article  MathSciNet  MATH  Google Scholar 

  3. Wang X-Z, He Y-L, Dong L-C, Zhao H-Y (2011) Particle swarm optimization for determining fuzzy measures from data. Inform Sci 181(19): 4230–4252

    Google Scholar 

  4. Wang X-Z, Dong C-R (2009) Improving generalization of fuzzy if-then rules by maximizing fuzzy entropy. IEEE Trans Fuzzy Syst 17(3):556–567

    Google Scholar 

  5. Lin C-M, Li M-C, Ting A-B, Lin M-H (2011) A robust self-learning PID control system design for nonlinear systems using a particle swarm optimization algorithm. Int J Mach Learn Cyber doi:10.1007/s13042-011-0021-4

  6. Mahapatra GS, Mandal TK, Samanta GP (2011) A production inventory model with fuzzy coefficients using parametric geometric programming approach. Int J Mach Learn Cyber 2(2):99–105

    Google Scholar 

  7. Zahiri SH (2010) Swarm intelligence and fuzzy systems, Nova publishers

  8. Huang VL, Suganthan PN, Liang JJ (2006) Comprehensive learning particle Swarm optimizer for solving multiobjective optimization problems. Int J Int Syst 21(2):209–226

    Article  MATH  Google Scholar 

  9. Zahiri SH, Seyedin SA (2007) Swarm intelligence based classifiers. Int J Franklin Inst 344(2):362–376

    Article  Google Scholar 

  10. Zahiri SH, Rajabi Mashhadi H, Seyedin SA (2005) Intelligent and robust genetic algorithm based classifier. Iran J Electr Electr Eng 1(3):1–9

    Google Scholar 

  11. Mary PM, Marimuthu S (2009) Minimum time swing up and stabilization of rotary inverted pendulum using pulse step control. Iran J Fuzzy Syst 6(3):1–15

    MATH  Google Scholar 

  12. Mehdizadeh E, Sadi-nezhad S, Tavakkoli-moghaddam R (2008) Optimization of fuzzy clustering criteria by a hybrid PSO and fuzzy c-mean clustering algorithm. Iran J Fuzzy Syst 5(1):1–14

    MathSciNet  MATH  Google Scholar 

  13. Moayedi F, Boostani R, Kazemi AR, Katebi S, Dashti E (2010) Subclass fuzzy-svm classifier an efficient method to enhance the mass detection in mammograms. Iran J Fuzzy Syst 7(1):15–31

    Google Scholar 

  14. Eiben AE, Hinterding R, Michalewicz Z (1999) Parameter control in evolutionary algorithms. IEEE Trans Evol Comput 3(2):124–141

    Article  Google Scholar 

  15. Shi Y, Eberhart R, Chen Y (1999) Implementation of evolutionary fuzzy systems. IEEE Trans Fuzzy Syst 7(2):109–119

    Article  Google Scholar 

  16. Stenes M, Robous H (2000) GA-fuzzy modeling and classification: complexity and performance. IEEE Trans Fuzzy Syst 8(5):509–522

    Article  Google Scholar 

  17. Zahiri SH, Zareie H, Agha-Ebrahimi MR (1996) Automatic target recognition using jet engine modulation on backscattered signals. In: Proceedings of 8th Iranian conference on electrical engineering, Isfahan, pp 296–303

  18. Zhao SZ, Liang JJ, Suganthan PN, Tasgetiren MF (2008) Dynamic multi-swarm particle swarm optimizer with local search for large scale global optimization. IEEE Congress on Evolutionary Computation, Hong Kong, pp 3845–3852

  19. Huang VL, Suganthan PN, Baskar S (2005) Multiobjective differential evolution with external archive. Technical Report Nanyang Technological University, Singapore

    Google Scholar 

  20. Tou JT, Gonzalez RC (1992) Pattern recognition principles, Coden Apmcc

  21. Qin AK, Suganthan PN (2005) Self-adaptive Differential Evolution Algorithm for Numerical Optimizatio. IEEE Congress on Evolutionary Computation, Scotland, pp 1785–1791

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Seyed-Hamid Zahiri.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Askari, H., Zahiri, SH. Decision function estimation using intelligent gravitational search algorithm. Int. J. Mach. Learn. & Cyber. 3, 163–172 (2012). https://doi.org/10.1007/s13042-011-0052-x

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s13042-011-0052-x

Keywords

Navigation