Skip to main content

Advertisement

SpringerLink
Log in

A kernel extreme learning machine algorithm based on improved particle swam optimization

  • Regular Research Paper
  • Published:
Memetic Computing Aims and scope Submit manuscript

Abstract

Kernel extreme learning machine (KELM) increases the robustness of extreme learning machine (ELM) by turning linearly non-separable data in a low dimensional space into a linearly separable one. However, the internal power parameters of ELM are initialized at random, causing the algorithm to be unstable. In this paper, we use the active operators particle swam optimization algorithm (APSO) to obtain an optimal set of initial parameters for KELM, thus creating an optimal KELM classifier named as APSO-KELM. Experiments on standard genetic datasets show that APSO-KELM has higher classification accuracy when being compared to the existing ELM, KELM, and these algorithms combining PSO/APSO with ELM/KELM, such as PSO-KELM, APSO-ELM, PSO-ELM, etc. Moreover, APSO-KELM has good stability and convergence, and is shown to be a reliable and effective classification algorithm.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5

Similar content being viewed by others

References

  1. He Z, Wen X, Liu H, Du J (2014) A comparative study of artificial neural network, adaptive neuro fuzzy inference system and support vector machine for forecasting river flow in the semiarid mountain region. J Hydrol 509:379–386

    Article  Google Scholar 

  2. Huang G, Zhu Q, Siew CK (2006) Extreme learning machine: theory and applications. Neurocomputing 70(1):489–501

    Article  Google Scholar 

  3. Huang G-B (2015) What are extreme learning machines? Filling the gap between Frank Rosenblatt’s dream and John von Neumann’s puzzle. Cognit Comput 7:263–278

    Article  Google Scholar 

  4. Huang G, Zhou H, Ding X, Zhang R (2012) Extreme learning machine for regression and multiclass classification. IEEE Trans Syst Man Cybern Part B Cybern. 42(2):513–529

    Article  Google Scholar 

  5. Chao M, Zhang Y, Li Z et al (2014) Hydraulic pump characteristic parameters online prediction based on kernel extreme learning machine. Comput Simul 05:351–354, 397

  6. Deng W, Zheng Q, Wang Z (2014) Cross-person activity recognition using reduced kernel extreme learning machine. Neural Netw 53(5):1–7

    Article  Google Scholar 

  7. Fu H, Vong C, Wong P et al (2016) Fast detection of impact location using kernel extreme learning machine. Neural Comput Appl 27:121–130

    Article  Google Scholar 

  8. Han F, Yao H, Ling Q (2012) An improved extreme learning machine based on particle swarm optimization. In: Proceedings of the International Conference on Intelligent Computing, pp 699–704

  9. Kennedy J, Eberhart R (1995) Particle swarm optimization. In: Proceeding of IEEE International Conference on Neural Networks, IEEE Press, Piscataway, pp 1942–1948

  10. Eberhart R, Kennedy J (1995) A new optimizer using particle swarm theory. Proceeding of the 6th International Symposium on Micro Machine and Human Science, IEEE Press, Piscataway, pp 39-43

  11. Zhang Y, Hu Q, Teng H (2008) Active target particle swarm optimization. Concurr Comput Pract Exp 20:29–40

    Article  Google Scholar 

  12. Lange K (2012) Karush–Kuhn–Tucker Theory. Optimization, vol 95. Springer, New York

    Google Scholar 

  13. He S, Wu Q, Wen J et al (2004) A particle swarm optimizer with passive congregation. Biosystems 78(78):135–147

    Article  Google Scholar 

  14. Shi Y, Eberhart RC (1998) A modified swarm optimizer. In: IEEE International Conference of Evolutionary Computation. IEEE Press, Anchorage, AIaska

  15. Trelea IC (2003) The particle swarm optimization algorithm: convergence analysis and parameter selection[J]. Inform Process Lett 85(6):317–325

    Article  MathSciNet  MATH  Google Scholar 

  16. Xu J, Xin Z (2005) An extended particle swarm optimizer. In: Proceedings of 19th IEEE International Parallel and Distributed Processing Symposium

  17. Zhang YN (2008) The improved particle swam optimization algorithms: APSO and DPSO. Journal of DaLian University of Technology

  18. Zhou D, Li G, Wang X (2014) Camera calibration for binocular vision based on PSO-ELM. J Guangxi Univ Natl Sci Edit 6:1285–1290

  19. Lu X, Lin Y, Luo J et al (2010) Classification Algorithm Combined GCM with CCM in Cancer Recognition. Inst Softw 21(11):2838–2851

    Article  Google Scholar 

Download references

Acknowledgments

This study was partly supported by National Natural Science Foundation of China (No. 61272315, No. 61303183, No. 61572164, and No. 61402417),State Administration of Work Safety (zhejiang-0006-2014AQ), Zhejiang Provincial Natural Science Foundation (No. Y1110342, No. LQ13F020014, and No. Y1080950), Zhejiang Provincial Science and Technology Department of International Cooperation Project (No. 2012C24030). Thanks to Dr. Chen Pan, China Jiliang University.

Author information

Authors and Affiliations

  1. College of Information Engineering, China Jiliang University, Hangzhou, 310018, China

    Huijuan Lu & Bangjun Du

  2. Ctrip Travel Network, Shanghai, 200335, China

    Jinyong Liu

  3. College of Informatics, Zhejiang Sci-Tech University, Hangzhou, 310018, China

    Haixia Xia

  4. Centre for Artificial Intelligence Research, Auckland University of Technology, Auckland, New Zealand

    Wai K. Yeap

Authors
  1. Huijuan Lu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Bangjun Du
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Jinyong Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Haixia Xia
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Wai K. Yeap
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Huijuan Lu.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Lu, H., Du, B., Liu, J. et al. A kernel extreme learning machine algorithm based on improved particle swam optimization. Memetic Comp. 9, 121–128 (2017). https://doi.org/10.1007/s12293-016-0182-5

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12293-016-0182-5

Keywords

Search

Navigation