Skip to main content
SpringerLink
Log in

A review on particle swarm optimization algorithm and its variants to clustering high-dimensional data

  • Published:
Artificial Intelligence Review Aims and scope Submit manuscript

Abstract

Data clustering is one of the most popular techniques in data mining. It is a process of partitioning an unlabeled dataset into groups, where each group contains objects which are similar to each other with respect to a certain similarity measure and different from those of other groups. Clustering high-dimensional data is the cluster analysis of data which have anywhere from a few dozen to many thousands of dimensions. Such high-dimensional data spaces are often encountered in areas such as medicine, bioinformatics, biology, recommendation systems and the clustering of text documents. Many algorithms for large data sets have been proposed in the literature using different techniques. However, conventional algorithms have some shortcomings such as the slowness of their convergence and their sensitivity to initialization values. Particle Swarm Optimization (PSO) is a population-based globalized search algorithm that uses the principles of the social behavior of swarms. PSO produces better results in complicated and multi-peak problems. This paper presents a literature survey on the PSO algorithm and its variants to clustering high-dimensional data. An attempt is made to provide a guide for the researchers who are working in the area of PSO and high-dimensional data clustering.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2

Similar content being viewed by others

References

  • Abraham A, Das S, Konar A (2007) Kernel based automatic clustering using modified particle swarm optimization algorithm. In: Thierens D et al (eds) Proceedings of the 9th annual conference on genetic and evolutionary computation—GECCO’07 computation conference (GECCO 2007). ACM Press, pp 2–9, ISBN 978-1-59593-698-1

  • Aggarwal C, Han J, Wang J (2003) A frame work for clustering evolving data streams. In: VLDB ’03 proceedings of the 29th international conference on very large data bases, vol 29. pp 81–92

  • Agrawal R, Gehrke J, Gunopulos D, Raghavan P (1998) Automatic subspace clustering of high-dimensional data for data mining applications. In: Proceedings of the 1998 ACM SIGMOD international conference on management of data, pp 94–105

  • Aguirre AH, Munoz Zavala AE, Diharce EV, Botello Rionda S (2007) COPSO: constraints optimization via PSO algorithm. Communication technics, (CC/CIMAT), pp 1–30

  • Ahmadi A, Karray F, Kamel MS (2010) Flocking based approach for data clustering. Nat Comput 9(3):767–791

    Article  MATH  MathSciNet  Google Scholar 

  • Ahmadi A, Karray F, Kamel MS (2007) Multiple cooperating swarms for data clustering. In: Proceedings of the IEEE swarm intelligence symposium, pp 206–212

  • Alviar JB, Pena J, Hincapie R (2007) Subpopulation best rotation: a modification on PSO. Revista Facultad de Ingenieria No 40, pp 118–122

  • Binwahlan MS, Salim N, Suanmali L (2009) Swarm based text summarization. In: 2009 International association of computer science and information technology— Spring conference. IACSIT-SC 2009, pp 145–150

  • Brits R, Engelbrecht AP, Van den Bergh F (2005) Niche particle swarm optimization. Department of Computer Science, University of Pretoria, Technical report

  • Bruzzone L, Carlin L (2006) A multilevel context-based system for classification of very high spatial resolution images. IEEE Trans Geosci Remote Sens 44:2587–2600

    Article  Google Scholar 

  • Cai J, Zhang J, Zhao X (2010) A star spectrum outliers mining system based on PSO. J Mult Valued Logic Soft Comput 16(6):631–641

    Google Scholar 

  • Chan Y, Hall P (2010) Using evidence of mixed populations to select variables for clustering very high-dimensional data. J Am Stat Assoc 105(490):798–809

    Article  MathSciNet  Google Scholar 

  • Chang J-F, Chu SC, Roddick JF, Pan JS (2005) A parallel particle swarm optimization algorithm with communication strategies. J Inf Sci Eng 21(4):809–818

    Google Scholar 

  • Chen CY, Ye F (2004) Particle swarm optimization algorithm and its application to clustering analysis. In: Proceedings of the (2004) IEEE international conference on networking, sensing and control. Taipei, Taiwan, pp 789–794

  • Chuang L-Y, Hsiao C-J, Yang C-H (2011) Chaotic particle swarm optimization for data clustering. Expert Syst Appl 38(12):14555–14563

    Article  Google Scholar 

  • Chuanwen J, Bompard E (2005) A self-adaptive chaotic particle swarm algorithm for short term hydroelectric system scheduling in deregulated environment. Energy Convers Manag 46:2689–2696

    Article  Google Scholar 

  • Cui X, Beaver JM, Charles JS, Potok TE (2008) Dimensionality reduction particle swarm algorithm for high dimensional clustering. In: IEEE swarm intelligence symposium, SSIS 2008. IEEE, pp 1–6. doi:10.1109/SIS.2008.4668309

  • Cui X, Potok TE (2006) Document clustering analysis based on hybrid PSO+K-means algorithm. J Comput Sci 27–33. ISSN 1549-3636

  • Cui X, Potok TE, Palathingal P (2005) Document clustering using particle swarm optimization. In: Proceedings 2005 IEEE swarm intelligence symposium 2005. SIS 2005, pp 185–191

  • Das S, Abraham A, Konar A (2008) Automatic kernel clustering with a multi-elitist particle swarm optimization algorithm. Pattern Recognit Lett 29:688–699

    Article  Google Scholar 

  • Deerwester S, Dumais ST, Furnas GW, Landauer TK, Harshman R (1990) Indexing by latent semantic analysis. J Am Soc Inf Sci 41:391–407

    Article  Google Scholar 

  • Díaz JL, Herrera M, Izquierdo J, Montalvo I, Pérez R (2008) A particle swarm optimization derivative applied to cluster analysis. In: Proceedings of iEMSs 4th Biennial Meeting—Interantional congress on environmental modelling and software: integrating sciences and information technology for environmental assessment and decision making, iEMSs 2008, pp 1782–1790

  • Esmin AAA, Pereira DL, de Araujo F (2008) Study of different approach to clustering data by using the particle swarm optimization algorithm. In: IEEE world congress on computational intelligence, pp 1817–1822

  • Esmin AAA, Lambert-Torres G, Zambroni AC (2005) A hybrid particle swarm optimization applied to loss power minimization. IEEE Trans Power Syst 20(2):859–866

    Article  Google Scholar 

  • Esmin AAA, Lambert-Torres G (2012) Application of particle swarm optimization to optimal power systems. Int J Innov Comput Inf Control (IJICIC) 8(3 (A)):1705–1716

    Google Scholar 

  • Esmin AAA, Matwin S (2012) Data clustering using hybrid particle swarm optimization. In: 13th International Conference on Intelligent Data Engineering and Automated Learning (IDEAL 2012), Lecture Notes in Computer Science (Springer LNCS). Springer, Heidelberg, Vol 7435, pp 159–166

  • Esmin AAA, Matwin S (2013) HPSOM: a hybrid particle swarm optimization algorithm with genetic mutation. Int J Innov Comput Inf Control (IJICIC) 9(5):1919–1934

    Google Scholar 

  • Fan S-KS, Liang Y-C, Zahara E (2004) Hybrid simplex search and particle swarm optimization for the global optimization of multimodal functions. Eng Optim 36:401–418

    Article  Google Scholar 

  • Felix TSC, Kumar V, Mishra N (2007) A CMPSO algorithm based approach to solve the multi-plant supply chain problem. Swarm intelligence, focus on ant and particle swarm optimization, pp 447–474

  • Feng H-M, Chen C-Y, Ye F (2006) Adaptive hyper-fuzzy partition particle swarm optimization clustering algorithm. Cybern Syst Int J 37(5):463–479

    Article  MATH  Google Scholar 

  • Friedman JH, Tukey JW (1974) A projection pursuit algorithm for exploratory data analysis. IEEE Trans Comput Part C 23(9):881–890

    Article  MATH  Google Scholar 

  • Fun Y, Chen CY (2005) Alternative KPSO-clustering algorithm. J Sci Eng 8:165–174

    Google Scholar 

  • Gao H, Xu W (2011) Particle swarm algorithm with hybrid mutation strategy. Appl Soft Comput 11(8):5129–5142

    Article  Google Scholar 

  • Gheitanchi S, Ali FH, Stipidis E (2008) Trained particle swarm optimization for ad-hoc collaborative computing networks. In: Swarm intell, algorithms and applications symposium. ASIB, UK, vol 11. pp 7–12

  • Han J, Kamber M (2001) Data mining: concepts and techniques. Morgan Kaufmann, Los Altos

    Google Scholar 

  • Hasan JAM, Ramakrishnan S (2011) A survey: hybrid evolutionary algorithms for cluster analysis. Artif Intell Rev 36(3):179–204

    Article  Google Scholar 

  • He-Nian C, He B, Yan L, Li J, Ji W (2009) A text clustering method based on two-dimensional OTSU and PSO algorithm. Computer network and multimedia technology, 2009. CNMT 2009. International symposium on, pp 1–4. doi:10.1109/CNMT.2009.5374525

  • Herrera M, Izquierdo J, Montalvo I, García-Armengol J, Roig JV (2009) Identification of surgical practice patterns using evolutionary cluster analysis. Math Comput Model 50(5–6):705–712

    Article  MATH  Google Scholar 

  • Hiqushi N, Iba H (2003) Particle swarm optimization with gaussian mutation. In: IEEE conference swam intelligence symposium (SIS), pp 72–79

  • Ho S-Y, Lin H-S, Liauh WH, Ho S-J (2008) OPSO orthogonal particle swarm optimization and its application to task assignment problems. IEEE Trans Syst Man Cyber Part A 38(2):288–298

    Google Scholar 

  • Hongwen Y, Rui Ma (2006) Design a nevel neural network clustering algorithm based on PSO and application. In: Proceedings of the IEEE world congress intelligent control and automation (WCICA), vol 2. pp 6015–6018

  • Hua M, Pei J (2010) Clustering in applications with multiple data sources—a mutual subspace clustering approach. Neurocomputing 92:133–144

    Article  Google Scholar 

  • Hu X, Eberhart RC (2002) Multi objective optimization using dynamic neighborhood particle swarm optimization. In: Proceedings of the IEEE/CEC, pp 1677–1681

  • Hu J, Fang C, He B, Zhang C, Zhao D, Zhang Y (2008) A novel text clustering method based on DSOM-FS-FCM. In: International symposium on distributed computing and applications to business, engineering and science, pp 354–360

  • Janson S, Middendorf M (2004) A hierarchical particle swarm optimizer for dynamic optimization problems. In: Proceedings of the application of evolutionary, computing, vol 3005. pp 513–524

  • Jarbouia B, Cheikha M, Siarryb P, Rebaic A (2007) Combinatorial particle swarm optimization (CPSO) for partitioned clustering problem. J Appl Math Comput 192(2):337–345

    Article  Google Scholar 

  • Jie J, Zeng J, Han C (2006) Self-organization particle swarm optimization based on infirmation feedback. In: Advances in natural computing (part-I–II: second international conference, ICNC, Xi’an, China), pp 913–922

  • Junyan C, Huiying Z (2007) Research on application of clustering algorithm based on PSO for the web usage In: Proceedings of the IEEE international conference on wireless communications, networking and mobile computing, pp 3705–3708

  • Kao IW, Tsai CY, Wang YC (2007) An effective particle swarm optimization method for data clustering. In: IEEE international conference on industrial engineering and engineering management 2007. IEEM 2007, pp 548–552

  • Kao Y-T, Zahara E, Kao I-W (2007) A hybridized approach to data clustering. Expert Syst Appl 34:1754–1762. doi:10.1016/j.eswa.2007.01.028

    Article  Google Scholar 

  • Kao Y, Lee S-Y (2009) Combining K-means and particle swarm optimization for dynamic data clustering problems. In: IEEE international conference on intelligent computing and intelligent systems, 2009. ICIS 2009, pp 757–761

  • Kaski S (1998) Dimensionality reduction by random mapping: fast similarity computation for clustering. Anchorage, AK, USA, pp 413–418

  • Kaufman L, Rousseeauw PJ (1990) Finding gropus in data: an introduction to cluster analysis. Wiley, New York

    Book  Google Scholar 

  • Kennedy J, Eberhart RC, Shi Y (2001) Swarm intelligence. Morgan Kaufmann, Los Altos

    Google Scholar 

  • Kennedy J, Eberhart RC (1995) Particle swarm optimization. In: IEEE internal conference on neural networks. Perth, Australia, vol 4, pp 942–1948

  • Kennedy J, Eberhart RC (1997) A discrete binary version of the particle swarm algorithm. In: IEEE conferenceon systems, man, and cyber, vol 5. pp 4104–4108

  • Kim DW, Lee KY, Lee D, Lee KH (2005) A kernel-based subtractive clustering method. Pattern Recogn Lett 26(7):879–891

    Google Scholar 

  • Kiranyaz S, Ince T, Yildirim A (2010) Fractional particle swarm optimization in multidimensional search space. Systems Man Cybern Part B Cybern IEEE Trans on 40(2):298–319

    Article  Google Scholar 

  • Kiranyaz S, Ince T, Gabbouj M (2011) Stochastic approximation driven particle swarm optimization with simultaneous perturbation—who will guide the guide. Appl Soft Comput J 11(2):2334–2347

    Article  Google Scholar 

  • Kiranyaz S, Ince T, Gabbouj M (2010) Dynamic data clustering using stochastic approximation driven multi-dimensional particle swarm optimization. In: Chio C, Cagnoni S, Cotta C, Ebner M, Ekárt A (eds) Proceedings of the 2010 international conference on applications of evolutionary computation—volume part I (EvoApplicatons’10), vol I. Springer, Berlin, pp 336–343

  • Kiranyaz S, Ince T, Yildirim A, Gabbouj M (2009) Multi-dimensional particle swarm optimization for dynamic clustering. In: IEEE EUROCON 2009. EUROCON 2009, pp 1398–1405

  • Koh B-Il, Fregly B-J, George A-D, Haftka R-T (2005) Parallel asynchronous particles swarm for global biomechanical. Int J Number Methods Eng 67(4):578–595

    Article  Google Scholar 

  • Kriegel H-P, Kröger P, Zimek A (2009) Clustering high-dimensional data: A survey on subspace clustering, pattern-based clustering, and correlation clustering. ACM Trans Knowl Discov Data 3:1:1–1:58

    Google Scholar 

  • Krink T, Vesterstrom JS (2002) Particle swarm optimization with spatial particle extension. In: Proceedings of congress on evolutionary computation (CEC’02), vol 2, pp 1474–1479

  • Lam HT, Nikolaevna PN, Quan NTM (2007) The heuristic particle swarm optimization. In: Proceedings of the annual conference on gentic and evolutionary computation in ant colony optimization, swarm Intell, and artificial immune systems GECCO’07, p 174

  • Lee T-Y (2007) Optimal spinning reserve for a wind-thermal power system using EIPSO. IEEE/TPWRS 22(4):1612–1621

    Google Scholar 

  • Li HQ, Li L (2007) A novel hybrid particle swarm optimization algorithm combined with harmony search for high dimensional optimization problems. In: Proceedings of the IEEE/IPC, pp 94–97

  • Li T, Jun C, Lengjun Z (2009) Data stream clustering algorithm based on grid density. J Chin Comput Syst 30:1376–1382

    Article  Google Scholar 

  • Liang JJ, Qin AK, Baskar S (2006) Comprehensive learning particle swarm optimizer for global optimization of multimodal Functions. IEEE Trans Evol Comput 10(3)

  • Li T, Lai X, Wu M (2006a) An improved two-swarm based particle swarm optimization algorithm. In: Proceedings of IEEE/WCICA, vol 1. pp 3129–3133

  • Ling SH, Iu HHC, Chan KY, Lam HK, Yeung BCW, Leung FH (2008) Hybrid particle swarm optimization with wavelet mutation and its industrial applications. IEEE Trans Syst Man Cybern 743–763

  • Li W, Yushu L, Xinxin Z, Yuanqing X (2006b) Particle swarm optimization for fuzzy c-means clustering. In: Proceedings of the 6th world congress on, intelligent control and automation, vol 2. pp 6055–6058

  • Lotfi Shahreza M, Moazzami D, Moshiri B, Delavar MR (2011) Anomaly detection using a self-organizing map and particle swarm optimization. Sci Iran 18(6):1460

    Google Scholar 

  • Løvbjerg M, Rasmussen TK, Krink T (2001) Hybrid particle swarm optimiser with breeding and subpopulations. In: Proceedings of the genetic and evolutionary computation conference (GECCO-2001), pp 469–476

  • Lu Y, Wang S, Li S, Zhou C (2011) Particle swarm optimizer for variable weighting in clustering high-dimensional data. Mach Learn 82(1):43–70

    Article  MathSciNet  Google Scholar 

  • Luo K, Wang L (2009) Data streams clustering algorithm based on grid and particle swarm optimization. IFCSTA 2009 proceedings international forum on computer science-technology and applications, pp 93–96

  • Luo Y, Wang S (2009) Particle swarm optimizer for variable weighting in clustering high-dimensional data. In: Swarm intelligence symposium. IEEE, SIS ’09. pp 37–44

  • Lu Y, Wang S, Li S, Zhou C (2009) Text clustering via particle swarm optimization. In: IEEE swarm intelligence. Symposium. 2009, pp 45–51

  • Luxburg UV (2007) A tutorial on spectral clustering. Stat Comput 17(4):395–416

    Article  MathSciNet  Google Scholar 

  • Marinakis Y, Marinaki M, Matsatsinis N (2008) A hybrid clustering algorithm based on multi-swarm constriction PSO and GRASP. DaWaK, pp 186–195

  • Marinakis Y, Marinaki M, Matsatsinis N (2009) A hybrid bumble bees mating optimization—GRASP algorithm for clustering. In: Corchado HAIS et al (eds) LNCS, vol 5572/2009. Springer, Berlin, pp 549–556

  • Marinakis Y, Marinaki M, Matsatsinis N, (2007) A hybrid particle swarm optimization algorithm for cluster analysis. In: Song I-Y, Eder J, Nguyen TM (eds) DaWaK, (2007) LNCS, vol 4654/2007. Springer, Berlin, pp 241–250

  • Marini F, Walczak B (2011) Finding relevant clustering directions in high-dimensional data using particle swarm optimization. J Chemom 25(7):366–374

    Article  Google Scholar 

  • Maulik U, Bandyopadhyay S (2002) Genetic algorithm based data clustering techniques. Pattern Recognit 33:1455–1465

    Article  Google Scholar 

  • Meissner M, Schmuker M, Schneider G (2006) Optimized paricle swarm optimization (OPSO) and its application to artificial neural network training. BMC Bioinform 7:1–11

    Article  Google Scholar 

  • Miranda V, Fonseca N (2002) EPSO-evolutionary particle swarm optimization, a new algorithm with applications in power systems. In: Proceedings of the Asia Pacific IEEE/PES transmission and distribution conference and exhibition, vol 2. pp 745–750

  • Nelder JA, Mead R (1965) A simplex method for function minimization. Comput J 7:308–313

    Article  MATH  Google Scholar 

  • Niu Y, Shen L (2006) An adaptive multi-objective particle swarm optimization for color image fusion. Lecture notes in computer science, LNCS, pp 473–480

  • O’Callaghan L, Mishra N, Meyerson A, Guha S, Motwani R (2002) Streaming-data algorithms for high-quality clustering. Data engineering, 2002. In: Proceedings of 18th international conference pp 685–694. doi:10.1109/ICDE.2002.994785

  • Omran MG, Salman AA, Engelbrecht AP (2006) Dynamic clustering using particle swarm optimization with application in image segmentation. Pattern Anal Appl 2006:332–344

    Article  MathSciNet  Google Scholar 

  • Padma MP, Komorasamy G (2012) A modified algorithm for clustering based on particle swarm optimization and K-means. In: International conference on computer communication and informatics, ICCCI 2012, pp 1–5

  • Pampara G, Franken N, Engelbrecht AP (2005) Combining particle swarm optimizationwith anglemodulation to solve binary problems. IEEE Cong Evol Comput 1:89–96

    Google Scholar 

  • Pan W, Shen X (2007) Penalized model-based clustering with application to variable selection. J Mach Learn Res 8:1145–1164

    MATH  Google Scholar 

  • Pang-ning T, Michael S, Vipin K (2006) Introduction to data mining. Pearson Education, Upper Saddle River

    Google Scholar 

  • Pant M, Radha T, Singh VP (2007) A new particle swarm optimization with quadratic interpolation. In: International IEEE conference on computational intelligence and multimedia applications, vol 1, pp 55–60

  • Parsons L, Haque E, Liu H (2004) Subspace clustering for high dimensional data: a review. SIGKDD Explor Newsl 6(1):90–105

    Article  Google Scholar 

  • Paterlini S, Krink T (2006) Differential evolution and particle swarm optimization in partitional clustering. Comput Stat Data Anal 50(5):1220–1247

    Article  MATH  MathSciNet  Google Scholar 

  • Peng H, Wang C, Guan X (2010) Swarm intelligent optimization algorithm for text clustering. In: Proceedings—2010 3rd IEEE international conference on computer science and information technology. ICCSIT 2010, pp 200–203

  • Peram T, Veeramachaneni K, Mohan CK (2003) Fitness-distance-ratio based particle swarm optimization. In: Proceedings of the IEEE/SIS, pp 174–181

  • Qiang F, Xiaoyong Z (2006) Theory and application of project pursuit model. Science Press, Beijing

    Google Scholar 

  • Raftery AE, Dean N (2006) Variable selection for model-based clustering. J Am Stat Assoc 101(473): 168–178

    Article  MATH  MathSciNet  Google Scholar 

  • Rashid M, Baig AR (2010) PSOGP: a genetic programming based adaptable evolutionary hybrid particle swarm optimization. Int J Innov Comput Inf Control 6:287–296

    Google Scholar 

  • Riget J, Vesterstroem JS (2002) A diversity-guided particle swarms optimizer—the ARPSO. Technical report no. 2002–02. Department of Computer Science, University of Aarhus, EVALife

  • Sandeep R, Sanjay J, Rajesh K (2011) A review on particle swarm optimization algorithms and their applications to data clustering. J Artif Intell Rev 35(3):211–222. doi:10.1007/s10462-010-9191-9

    Article  Google Scholar 

  • Secrest BR, Lamont GB (2003) Visualizing particle swarm optimization-Gaussian particle swarm optimization. In: Proceedings of the swarm intelligence symposium (IEEE/SIS), pp 198–204

  • Sedighizadeh D, Masehian E (2009) An particle swarm optimization method, taxonomy and applications. In: Proceedings of the international journal of computer theory and engineering, vol 5, pp 486–502

  • Sedlaczek K, Eberhard P (2006) Using augmented lagrangian particle swarm optimization for constrained problems in engineering. J Struct Multidiscip Optim 32(4):277–286

    Article  Google Scholar 

  • Selim SZ, Alsultan K (1991) A simulated annealing algorithm for the clustering problem. Pattern Recognit 24(10):1003–1008

    Article  MathSciNet  Google Scholar 

  • Sharma A, Omlin CW (2009) Performance comparison of particle swarm optimization with traditional clustering algorithms used in self-organization map. Int J Inf Math Sci World Acad Sci Eng Technol 5(1):1–12

    Google Scholar 

  • Shen H-Y, Peng X-Q, Wang J-N, Hu Z-K (2005) A mountain clustering based on improved PSO algorithm. In: Wang L, Chen K, Ong YS (eds) ICNC 2005, LNCS, vol 3612/2005. Springer, Berlin, pp 477–481

  • Shen X, Wei K, Wu D, Tong Y, Li Y (2007) A dynamic adaptive dissipative particle swarm optimization with mutation operation. In: Proceedings of IEEE/ICCA, pp 586–589

  • Shi Y, Eberhart R (2001) Fuzzy adaptive particle swarm optimization. In: Proceedings of the IEEE/congress on, evolutionary computation, vol 1, pp 101–106

  • Shi Y, Eberhart RC (1998) Parameter selection in particle swarm optimization. Evolutionary programming, vol 1441 of Lecture Note in computers science. Springer, Berlin, pp 591–600

  • Shi-Wei L, Xiao-Dong Q (2010) Date clustering using principal component analysis and particle swarm optimization. In: Computer science and education (ICCSE), 2010 5th international conference on, pp 493–497, 24–27 Aug. 2010. doi:10.1109/ICCSE.2010.5593568

  • Silva A, Neves A, Costa E (2002) Chasing the swarm: a predator-prey approach to function optimisation. In: Proceedings of the Mendel 2002—8th international conference on soft computing, pp 103–110, Mendel 2002, Brno, Czech Republic

  • Spall JC (1992) Multivariate stochastic approximation using a simultaneous perturbation gradient approximation. IEEE Trans Autom Control 37:332–341

    Article  MATH  MathSciNet  Google Scholar 

  • Steinbach M, Ertöz L, Kumar V (2003) Challenges of clustering high dimensional data. In: New vistas statistical physics: applications in econophysics, bioinformatics, and pattern recognition. Springer

  • Sun C, Zhao H, Wang Y (2011) A comparative analysis of PSO, HPSO, and HPSO-TVAC for data clustering. J Exp Theoret Artif Intell 23(1):51–62

    Article  MathSciNet  Google Scholar 

  • Sun J, Feng B, Xu W (2004b) A global search strategy of quantum-behaved particle swarm optimization. In: IEEE conference on cybernetics and intelligent systems. IEEE Press, Piscataway, pp 111–116

  • Sun J, Xu WB, Feng B (2004a) A global search strategy of quantum-behaved particle swarm optimization. In: Cybernetics and intelligent systems proceedings of the 2004 IEEE conference, pp 111–116

  • Thangaraj R, Pant M, Abraham A, Snasel V (2012) Modified particle swarm optimization with timevarying velocity vector. Int J Innov Comput Inf Control 8(1 (A)):201–218

    Google Scholar 

  • Tsai CY, Chiu CC (2008) Developing a feature weight self-adjustment mechanism for a k-means clustering algorithm. Comput Stat Data Anal 52:4658–4672

    Article  MATH  MathSciNet  Google Scholar 

  • Voss MS (2005) Principal component particle swarm optimization (PCPSO). In: Proceedings of the IEEE symposium on swarm Intelligence, pp 401–404

  • Wang X-H, Li J-J (2004) Hybrid particle swarm optimization with simulated annealing. In: Proceedings of the IEEE international conference on machine learning and cyber, vol 4. pp 2402–2405

  • Wang S, Zhu J (2008) Variable selection for model-based high-dimensional clustering and its application to microarray data. Biometrics 64(2):440–448. ISSN 1541–0420

    Google Scholar 

  • Witten DM, Tibshirani R (2010) A framework for feature selection in clustering. J Am Stat Assoc 105(490):713–726

    Article  MathSciNet  Google Scholar 

  • Xiang T, Liao X, Wong K (2007) An improved particle swarm optimization algorithm combined with piecewise linear chaotic map. Appl Math Comput 190:1637–1645

    Article  MATH  MathSciNet  Google Scholar 

  • Xiang X, Ernst RD, Russell E, Zina BM, Robert JO (2003) Gene clustering using self-organizing maps and particle swarm optimization. In: International parallel and distributed processing symposium—IPDPS’03, pp 10 pp, 22–26 April 2003. doi:10.1109/IPDPS.2003.1213290

  • Xie XF, Zhang WJ, Yang ZL (2002a) Adaptive particle swarm optimization on individual level. In: International conference signal processing (ICSP), pp 1215–1218

  • Xie XF, Zhang WJ, Yang ZL (2002b) A dissipative particle swarm optimization. In: Congress on evolutionary computation (CEC), pp 1456–1461

  • Yang H, Du Q (2011) Particle swarm optimization-based dimensionality reduction for hyperspectral image classification. In: International geoscience and remote sensing symposium (IGARSS), pp 2357–2360. doi:10.1109/IGARSS.2011.6049683

  • Yao X (2008) Cooperatively coevolving particle swarm for large scale optimization. In: Conference of EPSRC, artificial intell technologies new and emerging computer paradigms

  • Yeang CH, Ramaswamy S, Tamayo P, Mukherjee S, Rifkin RM, Angelo M, Reich M, Lander E, Mesirov J, Golub TCH, Ramaswamy S (2001) Molecular classification of multiple tumor types. Bioinformatics 17(Suppl 1):S316–S322

    Article  Google Scholar 

  • Zeng J, Hu J, Jie J (2006) Adaptive particle swarm optimization guided by acceleration information. Proc IEEE/ICCIAS 1:351–355

    Google Scholar 

  • Zhang Y-N, Hu Q-N, Teng H-F (2008b) Active target particle swarm optimization: research articles. J Concurr Comput Pract Exp 20(1):29–40

    Article  Google Scholar 

  • Zhang Q, Mahfouf M (2011) A hierarchical Mamdani-type fuzzy modelling approach with new training data selection and multi-objective optimisation mechanisms: a special application for the prediction of mechanical properties of alloy steels. Appl Soft Comput J 11(2):2419–2443

    Article  Google Scholar 

  • Zhang Y, Jiang M (2010) Chinese text mining based on subspace clustering. In: Proceedings—2010 7th international conference on fuzzy systems and knowledge discovery. FSKD 2010, pp 1617–1620

  • Zhang Q, Lei X, Huang X, Zhang A (2010) An improved projection pursuit clustering model and its application based on quantum-behaved PSO. In: Proceedings international conference on natural computation, ICNC, vol 5. pp 2581–2585. doi:10.1109/ICNC.2010.5583182

  • Zhang Q, Mahfouf M (2006) A new structure for particle swarm optimization (nPSO) applicable to single objective and multiobjective problems. In: Proceedings of the 3rd international IEEE conference on intelligent systems, pp 176–181

  • Zhang X, Zhang Q, Fan Z, Deng G, Zhang C (2008a) Clustering spatial data with obstacles using improved ant colony optimization and hybrid particle swarm optimization. In: Proceedings of the 2008 5th international conference on fuzzy systems and knowledge, discovery, vol 02. pp 424–428

  • Zhao B, Guo CX, Cao YJ (2005) A multiagent-based particle swarm optimization approach for optimal reactive power dispatch. Power systems. IEEE Trans Power Syst 20(2):1070–1078

    Article  Google Scholar 

  • Zhou D, Shi T (2011) Variable selection in high dimensional clustering using ensemble variable importance measure. Preprint 864, Department of Statistics, the Ohio State University. Online: http://www.stat.osu.edu/~taoshi/research/publications.html

Download references

Acknowledgments

We would like to thank CNPq, FAPEMIG (Brazilian agencies) and NSERC (Canada) for partial financial support. The authors also thank the anonymous reviewers for useful remarks and suggestions.

Author information

Authors and Affiliations

  1. Department of Computer Science, Federal University of Lavras (UFLA), Campus Universitário, PO Box 3037, Lavras, MG, 37200-000, Brazil

    Ahmed A. A. Esmin & Rodrigo A. Coelho

  2. Faculty of Computer Science, Dalhousie University, Halifax, NS, B3H 1W5, Canada

    Ahmed A. A. Esmin & Stan Matwin

  3. Institute of Computer Science, Polish Academy of Sciences, Warsaw, Poland

    Stan Matwin

Authors
  1. Ahmed A. A. Esmin
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Rodrigo A. Coelho
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Stan Matwin
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Ahmed A. A. Esmin.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Esmin, A.A.A., Coelho, R.A. & Matwin, S. A review on particle swarm optimization algorithm and its variants to clustering high-dimensional data. Artif Intell Rev 44, 23–45 (2015). https://doi.org/10.1007/s10462-013-9400-4

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10462-013-9400-4

Keywords

Search

Navigation