Skip to main content
SpringerLink
Log in

Clustering and classification with inertia weight and elitism-based particle swarm optimization

  • Theoretical Advances
  • Published:
Pattern Analysis and Applications Aims and scope Submit manuscript

Abstract

Clustering and classification-based pattern recognition techniques are widely used in various domains. While many approaches exist to perform these tasks, it remains a difficult process to perform clustering and classification simultaneously for particular datasets. In this paper, a method based on k-nearest neighbor (KNN) is presented to classify the dataset with PSO optimized k-medoids clustering. Initial clustering with k-medoids algorithm divides the dataset into smaller and disjoint clusters featuring similarity within clusters and dissimilarity with members of other clusters. Particle swarm optimization (PSO) is an evolutionary algorithm mainly used to optimize the issues in several research areas including data analytics. The fitness function of the PSO approach mentioned in this paper is based on inertia weights that identify the particles with the best positions and velocities for optimization. Additionally, PSO uses a novel elitism concept that allows massive searching capability between the swarm of particles to achieve a better convergence rate. Because of this property, it can be applied throughout different machine learning fields. Moreover, the KNN classifier outperforms the classification task in terms of classifying the optimized particles with high accuracy. The performance of the proposed technique is evaluated by experimenting with datasets taken from open sources. The simulation results revealed that the performance of the proposed method is better than the existing methods in terms of effective clustering as well as accurate classification.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5

Similar content being viewed by others

References

  1. Aburomman AA, Reaz MBI (2016) A novel SVM-kNN-PSO ensemble method for intrusion detection system. Appl Soft Comput 38:360–372

    Article  Google Scholar 

  2. Alswaitti M, Albughdadi M, Isa NAM (2018) Density-based particle swarm optimization algorithm for data clustering. Expert Syst Appl 91:170–186

    Article  Google Scholar 

  3. Amorèse D, Bossu R, Mazet-Roux G (2015) Automatic clustering of macroseismic intensity data points from internet questionnaires: Efficiency of the partitioning around medoids (PAM). Seismol Res Lett 86(4):1171–1177

    Article  Google Scholar 

  4. Arumugam M, Raes J, Pelletier E, Le Paslier D, Yamada T, Mende DR, Fernandes GR, Tap J, Bruls T, Batto JM, Bertalan M (2011) Enterotypes of the human gut microbiome. Nature 473(7346):174–180

    Article  Google Scholar 

  5. Bishop CM (2006) Pattern recognition and machine learning. Springer

  6. Boro D, Bhattacharyya DK (2015) Particle swarm optimisation-based KNN for improving KNN and ensemble classification performance. Int J Innovative Comput Appl 6(3–4):145–162

    Article  Google Scholar 

  7. Cover T, Hart P (1967) Nearest neighbor pattern classification. IEEE Trans Inf Theory 13(1):21–27

    Article  Google Scholar 

  8. De Falco I, Della Cioppa A, Tarantino E (2005) Evaluation of particle swarm optimization effectiveness in classification. In: International Workshop on Fuzzy Logic and Applications, vol 3849. Springer, pp 164–171

  9. Del Ser J, Villar E, Osaba E (2019) Swarm Intelligence-Recent Advances. New Perspectives and Applications

  10. Duda H, Hart P, David G (2001) Stork, pattern classification. Wiley

  11. Eberhat R, Kennedy J (1995) A new optimizer using particle swarm theory. In Sixth international symposium on micro machine and human science

  12. Gallego AJ, Calvo-Zaragoza J, Valero-Mas JJ, Rico-Juan JR (2018) Clustering-based k-nearest neighbor classification for large-scale data with neural codes representation. Pattern Recogn 74:531–543

    Article  Google Scholar 

  13. Guan C, Yuen KKF, Coenen F (2019) Particle swarm optimized density-based clustering and classification: supervised and unsupervised learning approaches. Swarm Evol Comput 44:876–896

    Article  Google Scholar 

  14. Han J, Kamber M, Tung AK (2001) Spatial clustering methods in data mining. Geographic data mining and knowledge discovery, pp 188–217

  15. Huang KY (2011) A hybrid particle swarm optimization approach for clustering and classification of datasets. Knowl-Based Syst 24(3):420–426

    Article  Google Scholar 

  16. Hsu CW, Lin CJ (2002) A comparison of methods for multiclass support vector machines. IEEE Trans Neural Netw 13(2):415–425

    Article  Google Scholar 

  17. Islam MZ, Estivill-Castro V, Rahman MA, Bossomaier T (2018) Combining K-Means and a genetic algorithm through a novel arrangement of genetic operators for high quality clustering. Expert Syst Appl 91:402–417

    Article  Google Scholar 

  18. Kaufmann L, Rousseeuw PJ (1990) Finding groups in data: an introduction to cluster analysis. Wiley

  19. MacQueen J (1967) Some methods for classification and analysis of multivariate observations. In: Proceedings of the fifth Berkeley symposium on mathematical statistics and probability, vol 1, no 14, pp 281–297

  20. Mitchell TM (1997) Machine learning

  21. Montero P, Vilar JA (2014) TSclust: An R package for time series clustering. J Stat Softw 62(1):1–43

    Article  Google Scholar 

  22. Nayak SK, Rout PK, Jagadev AK, Patnaik S (2017) A modified differential evolution-based fuzzy multi-objective approach for clustering. Int J Manag Decis Mak 16(1):24–49

    Google Scholar 

  23. Ohnishi Y, Huber W, Tsumura A, Kang M, Xenopoulos P, Kurimoto K, Oleś AK, Araúzo-Bravo MJ, Saitou M, Hadjantonakis AK, Hiiragi T (2014) Cell-to-cell expression variability followed by signal reinforcement progressively segregates early mouse lineages. Nat Cell Biol 16(1):27–37

    Article  Google Scholar 

  24. Shi Y (2001) Particle swarm optimization: developments, applications and resources. In: Proceedings of the 2001 congress on evolutionary computation, vol 1. IEEE, pp 81–86

  25. Van den Bergh F, Engelbrecht AP (2004) A cooperative approach to particle swarm optimization. IEEE Trans Evol Comput 8(3):225–239

    Article  Google Scholar 

  26. Wu X, Zhu X, Wu GQ, Ding W (2013) Data mining with big data. IEEE Trans Knowl Data Eng 26(1):97–107

    Google Scholar 

  27. Xiong H, Qiu B, Liu J (2020) An improved multi-swarm particle swarm optimizer for optimizing the electric field distribution of multichannel transcranial magnetic stimulation. Artificial Intel Med 104:101790. https://doi.org/10.1016/j.artmed.2020.101790

    Article  Google Scholar 

  28. Yu D, Liu G, Guo M, Liu X (2018) An improved K-medoids algorithm based on step increasing and optimizing medoids. Expert Syst Appl 92:464–473

    Article  Google Scholar 

  29. Zeng N, Zhang H, Liu W, Liang J, Alsaadi FE (2017) A switching delayed PSO optimized extreme learning machine for short-term load forecasting. Neurocomputing 240:175–182

    Article  Google Scholar 

  30. Zhang X, Wang W, Li Y, Jiao LC (2012) PSO-based automatic relevance determination and feature selection system for hyperspectral image classification. Electron Lett 48(20):1263–1265

    Article  Google Scholar 

  31. Zhang Y, Liu X, Bao F, Chi J, Zhang C, Liu P (2020) Particle swarm optimization with adaptive learning strategy. Knowl-Based Syst 196:105789. https://doi.org/10.1016/j.knosys.2020.105789

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Research Scholar, Faculty of Computer Science and Engineering, Sathyabama Institute of Science and Technology, Chennai, India

    T. Mathi Murugan

  2. Department of Computer Science Engineering, Marian Engineering College, Trivandrum, Kerala, India

    E. Baburaj

Authors
  1. T. Mathi Murugan
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. E. Baburaj
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to T. Mathi Murugan.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Murugan, T.M., Baburaj, E. Clustering and classification with inertia weight and elitism-based particle swarm optimization. Pattern Anal Applic 24, 1605–1621 (2021). https://doi.org/10.1007/s10044-021-01010-x

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10044-021-01010-x

Keywords

Search

Navigation