Abstract
Clustering analysis is the major application area of data mining where particle swarm optimization (PSO) is being widely implemented due to its simplicity and efficiency. In this paper, we present a new variant of PSO algorithm well tailored to clustering analysis. The proposed algorithm encodes each particle as a bi-dimensional vector, where in the first dimension we look for the optimal number of clusters and in the second dimension, we look for the best centroid of each cluster. In this PSO clustering algorithm a new updating positions rule is proposed to deal with our clustering objective. The performance of the proposed algorithm is tested according to artificial datasets and real datasets. The achieved results present actually good performance and still promising in future perspective.
Similar content being viewed by others
References
Abraham A, Guo H, Liu H (2006) Swarm intelligence: foundations, perspectives and applications. Stud Comput Intell (SCI) 26:3–25
Moh’d Alia O, Mandava R, Aziz ME (2011) A hybrid harmony search algorithm for MRI brain segmentation. Evol Intell 4(1):31–49
Bandyopadhyay S, Maulik U (2002) Genetic clustering for automatic evolution of clusters and applications to image classification. Pattern Recogn 35(6):1197–1208
Berkhin P (2006) A survey of clustering data mining techniques. In: Kogan J, Nicholas C, Teboulle M (eds) Grouping multidimensional data. Springer, Heidelberg, pp 25–71
Bong CW, Lam HY (2011) Unsupervised image segmentation with adaptive archive-based evolutionary multiobjective clustering. In: The 4th International conference on Pattern Recognition and Machine Intelligence, LNCS 6744, pp 92–97
Campello RJGB, Hruschka ER, Alves VS (2009) On the efficiency of evolutionary fuzzy clustering. J Heuristics 15(1):43–75
Chou CH, Su MC, Lai E (2004) A new cluster validity measure and its application to image compression. Pattern Anal Appl 7(2):205–220
Clerc M (1999) The swarm and the Queen: towards a deterministic and adaptive particle swarm optimization. In Proceedings of the Congress on Evolutionary Computation, vol. 3, Washington, IEEE Press, pp 1951–1957
Das S, Abraham A, Konar A (2008) Automatic clustering using an improved differential evolution algorithm. IEEE Trans Syst Man Cybern Part A 38(1):218–237
Das S, Abraham A, Konar A (2009) Metaheuristic pattern clustering—an overview. Stud Comput Intell 178:1–62
Day WH, Edelsbrunner H (1984) Efficient algorithms for agglomerative hierarchical clustering methods. J Classif 1(1):1–24
Dunn JC (1974) Well separated clusters and optimal fuzzy partitions. J Cybern 4(1):95–104
Eberhart R, Shi Y (2000) Comparing inertia weights and constriction factors in particle swarm optimization. In: Proceedings of the IEEE Congress on Evolutionary Computation, pp 84–88
Eberhart R, Shi Y, Kennedy J (2001) Swarm intelligence. Morgan Kaufmann, San Francisco
Engelbrecht AP (2007) Computational intelligence: an introduction. John Willey & Sons Editions, New York
Esmin AAA, Coelho RA, Matwin S (2015) A review on particle swarm optimization algorithm and its variants to clustering high-dimensional data. Artif Intell Rev 44(1):23–45
Gupta M, Aggarwal CC, Han J, Sun Y (2011) Evolutionary clustering and analysis of bibliographic networks. In: The proceedings of the International conference on Advances in Social Networks Analysis and Mining, pp 63–70
Handl J, Knowles J (2007) An evolutionary approach to multiobjective clustering. IEEE Trans Evol Comput 11(1):56–76
Handl J, Meyer B (2007) Ant-based and swarm-based clustering. Swarm Intell 1:95–113
Hatamlou A, Abdullah S, Nezamabadi-pour H (2012) A combined approach for clustering based on K-means and gravitational search algorithms. Swarm Evol Comput 6:47–52
Hong T-P, Chen C-H, Wu Y-L, Tseng VS (2008) Fining active membership functions in fuzzy data mining. Data Min Found Pract Stud Comput Intell 118:179–196
Hruschka ER, Campello RJGB, Freitas AA, de Carvalho ACPLF (2009) A survey of evolutionary algorithms for clustering. IEEE Trans Syst Man Cybern Part C 39(2):133–155
Hasan MJA, Ramakrishnan S (2011) A survey: hybrid evolutionary algorithms for cluster analysis. Artif Intell Rev 36:179–204
Jain AK, Dubes RC (1988) Algorithms for clustering data. Prentice Hall, New Jersey
Jain AK, Murty MN, Flynn PJ (1999) Data clustering: a review. ACM Comput Surv 31(3):264–323
Jain AK (2010) Data clustering: 50 years beyond K-means. Pattern Recogn Lett 31:651–666
Kennedy J, Eberhart R (1995) Particle swarm optimization. In: The Proceedings of the fourth IEEE International Conference on Neural Networks, Australia, pp 1942–1948
Kriegel H-P, Kröger P, Zimek A (2009) Clustering high-dimensional data: a survey on subspace clustering, pattern-based clustering, and correlation clustering. ACM Trans Knowl Discov Data 3(1):1
Krömer P, Platos J, Snasel V (2012) Genetic algorithm for clustering accelerated by the CUDA platform. In: The Proceedings of the IEEE International Conference on Systems, Man, and Cybernetics, pp 1005–1010
Li Q, Shi Z, Shi J, Shi Z (2005) Swarm intelligence clustering algorithm based on attractor. In: Proceedings of the International Conference on Adaptive and Natural Computing Algorithms, pp 353–356
Liu B, Pan J, McKay B (2006) Incremental clustering based on swarm intelligence. In: Proceedings of the International Conference on Simulated Evolution and Learning, vol. 4247, Lecture Notes in Computer Science, pp 189–196
Ma PCH, Chan KCC, Yao X, Chiu DKY (2006) An evolutionary clustering algorithm for gene expression microarray data analysis. IEEE Trans Evol Comput 10(3):296–314
Merz P, Zell A (2002) Clustering gene expression profiles with memetic algorithms. In: The Proceedings of the 7th International Conference on Parallel Problem Solving from Nature (PPSN VII), pp 811–820
Merz CJ, Murphy PM (2007) UCI repository of machine learning databases. University of California, Irvine, California, USA. http://www.ics.uci.edu/~mlearn
Mitra S (2004) An evolutionary rough partitive clustering. Pattern Recogn Lett 25:1439–1449
Niu B, Duan Q, Tan L, Liu C, Liang P (2015) A population-based clustering technique using particle swarm optimization and K-means. Adv Swarm Comput Intell LNCS 9140:145–152
Omran MGH, Engelbrecht AP, Salman A (2005) Dynamic clustering using particle swarm optimization with application in unsupervised image classification. Trans Eng Comput Technol 9:199–204
Omran MGH, Al-Sharhan A (2007) Barebones particle swarm methods for unsupervised image classification. In: The Proceedings of IEEE Congress on Evolutionary Computation (CEC), Singapore, pp 3247–3252
Rokach L (2010) A survey of clustering algorithms. In: Maimon O, Rokac L (eds) Data mining and knowledge discovery handbook. Springer, New York, pp 269–298
Rui Xu, Wunsch D (2005) Survey of clustering algorithms. IEEE Trans Neural Netw 16(3):645–678
Senthilnath J, Omkar SN, Mani V (2011) Clustering using firefly algorithm: performance study. Swarm Evol Comput 1:164–171
Storn R, price K (1997) Differntial evolution—a simple and efficient heuristic for global optimization over continuous spaces. J Global Optim 11(4):341–359
Tang K-S, Man K-F, Liu Z-F, Kwong S (1998) Minimal fuzzy memberships and rules using hierarchical genetic algorithms. IEEE Trans Ind Electron 45(1):162–169
Veenhuis C, Köppen M (2006) Data swarm clustering. Swarm Intell Data Min Stud Comput Intell 34:221–241
Zhao Q, Bhowmick SS, Gruenwald Cleopatra L (2006) Evolutionary pattern-based clustering of web usage data. In the Proceeding of the 10th Pacific-Asia Conference, Advances in Knowledge Discovery and Data Mining, LNCS 3918, pp 323–333
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Ali, Y.M.B. Unsupervised Clustering Based an Adaptive Particle Swarm Optimization Algorithm. Neural Process Lett 44, 221–244 (2016). https://doi.org/10.1007/s11063-015-9477-7
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11063-015-9477-7