Skip to main content
SpringerLink
Log in

MR-TP-QFPSO: map reduce two phases quantum fuzzy PSO for feature selection

  • Original Article
  • Published:
International Journal of System Assurance Engineering and Management Aims and scope Submit manuscript

Abstract

Feature selection is the utmost requirement to deal with high dimensional datasets. Fuzzy logic and particle swarm optimization are the two very popular soft computing methods which have used for feature selection. In this paper different variants of PSO are summarized to explore the latest development in PSO. The survey has been grouped in three categories; structures based PSO variants, fuzzy logic-PSO hybrids and parallel PSO variants. On the basis of findings of survey, map reduce two phases quantum behaved fuzzy rule PSO (MR-TP-QFPSO) method has been proposed. Quantum is the smallest possible state of any matter. Therefore, in proposed method smallest state of any particle is trit, which is having three values 0, 1 and #. # is included to bring a state of uncertainty where, feature is considered neither accepted nor rejected. In first phase search, feature space is exhaustively explored. During exhaustive initial search (first phase), multiple subsets of features are selected using quantum behaved fuzzy rule PSO (QFPSO). From these multiple subsets, minimum most important features (lower bound features) and maximum range of selected features are selected (upper bound feature subset). In second phase, selected feature subspace (selected in first phase) has been exploited and finally merged with lower bound features. The entire two phases search is highly iterative and it is well known that map reduce frame work can accelerate any iterative task by parallel processing. Therefore, proposed two phases QFPSO (TP-QFPSO) is applied using map reduce (MR-TP-QFPSO). The analysis of proposed algorithm clearly shows that map reduce has decreased the processing time of serial TP-QFPSO algorithm. The MR-TP-QFPSO is compared with other feature selection methods. The results on bench marking datasets show that MR-TP-QFRPSO outperformed the other methods. The reduction in execution time is directly propositional to the number of cluster nodes used. Therefore, as number of nodes is increased execution time will decrease without affecting the performance.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others

References

  • Agarwal S, Ranjan P (2016) Dimensionality reduction methods classical and recent trends: a survey. IJCTA 9(10):4801–4808

    Google Scholar 

  • Agarwal S, Rajesh R, Ranjan P (2015) Enhanced velocity BPSO and convergence analysis on dimensionality reduction. In: recent advances in mathmatics, statistics and computer science, World Scientific, ISBN 978-981-4704-84-7

  • Agarwal S, Rajesh R, Ranjan P (2017) FRBPSO: a fuzzy rule based binary PSO for feature selection. Proc Natl Acad Sci India Sect A Phys Sci 87(2):221–233

    Article  Google Scholar 

  • Aljarah I, Ludwig SA (2012) Parallel particle swarm optimization clustering algorithm based on map reduce methodology. In: NaBIC: IEEE Fouth World Congress, pp 104–111

  • Allias N, Megat MN, Ismail MN (2014) A hybrid Gini PSO-SVM feature selection based on taguchi method: an evalution on email filtering. IMCOM(ICUIMC), ACM, ISBN 978-1-4503-2644-5

  • Bousbaci A, Kamel N (2014) A parallel sampling-pso-multi-core-k-means algorithm using mapreduce. In: 2014 14th International Conference on Hybrid Intelligent Systems (HIS). IEEE, pp 129–134

  • Cao J, Cui H, Shi H, Jiao L (2016) Big data: a parallel particle swarm optimization-back-propagation neural network algorithm based on mapreduce. Plos One. https://doi.org/10.1371/journal.pone.0157551

    Google Scholar 

  • Chai R, Ling SH, Hunter GP, Tran Y, Nguyen HT (2014) Brain computer interface classifier for wheelchair commands using neural network With fuzzy particle swarm optimization. IEEE J Biomed Health Inf 18:1614–1624

    Article  Google Scholar 

  • Chang JC (2016) Modified particle swarm optimization for solving travelling salesman problem based on a Hadoop MapReduce Framework. In: ICASI, pp 26–30. doi: 10.1109/ICASI.2016.7539772

  • Chuang LY, Chang HW, Tu CJ, Yang CH (2008) Improved binary PSO for feature selection using gene expression data. Comput Biol Chem 32:29–38

    Article  MATH  Google Scholar 

  • Chuang LY, Tsai SW, Yang CH (2011) Improved binary particle swarm optimization using catfish effect for feature selection. Expert Syst Appl 38(10):12699–12707

    Article  Google Scholar 

  • Chuang LY, Tsai SW, Yang CH (2012) Fuzzy adaptive catfish particle swarm optimization. Artif Intell Res 1:149–170

    Article  Google Scholar 

  • Chunne AP, Chandrasekhar U, Malhotra C (2015) Real time clustering of tweets using adaptive PSO technique and MapReduce. In: GCCT. doi I: 10.1109/GCCT.2015.7342704, IEEE

  • Dinh P, Thanh TN, Xuan TT (2014) A Hybrid Multi-objective PSO-SA algorithm for the fuzzy rule based classifier design problem with the order based semantics of linguistic terms. VNU J Sci Comp Sci Com Eng 30:44–56

    Google Scholar 

  • Ganguly S, Sahoo NC, Das D (2013) Multi-objective particle swarm optimization based on fuzzy-Pareto-dominance for possibilistic planning of electrical distribution system incorporating distributed generation. Fuzzy Set Syst 213:47–73

    Article  MathSciNet  Google Scholar 

  • Izakian H, Abraham A, Snasel V (2009) Fuzzy clustering using hybrid fuzzy c means and fuzzy particle swarm optimization. In: Proceedings of the world congress on nature & biologically inspired computing (NaBIC), pp 1690–1694

  • Kennedy J, Eberhart RC (1995) Particle swarm optimization. In: IEEE international conference on neural networks. Perth, Australia, pp 1942–1948

  • Kennedy J, Eberhart RC (1997) A discrete binary version of the particle swarm algorithm. In: IEEE conference on systems, man, and cyber, pp 4104–4108

  • Kourid A (2014) Interative map reduce for feature selection. In: IJERT, pp 1788–1793

  • Li Y, Chen Z, Wang Y, Jiao L (2016) Quantum-behaved particle swarm optimization using mapreduce bioinspired computing theories and application. Springer, Berlin, p 1410–1430

  • Lin SW, Ying KC, Chen SC, Lee ZJ (2008) Particle swarm optimization for parameter determination and feature selection of support vector machines. Expert Syst Appl 35(4):1817–1824

    Article  Google Scholar 

  • Lin JW, Chi WC, Chang RI (2017) Particle swarm optimization combined with querybased learning using mapreduce. future information technology. Lect Note Electr Eng 309:91–97

    Article  Google Scholar 

  • Liu H, Abraham A, Zhang W (2007) Fuzzy adaptive turbulent particle swarm optimization. Int J Innov Comput Appl (IJICA) 1:39–47

    Article  Google Scholar 

  • Ludwig SA (2014) Map reduce-based optimization of overlay networks using particle swarm optimization. In: GECCO’14, pp 1031–1038

  • Ludwig SW, Aljarah I (2016) A scalable map reduce enabled glow worm swarm optimization approach for high dimensional multimodal functions. Int J Swarm Intell Res 7(1):32–54

    Article  Google Scholar 

  • McNabb AW, Monson CK and Seppi KD (2007) Parallel PSO using mapreduce. In: CEC 27: Proceedings of the IEEE Congress on Evolutionary Computation, pp 7–14

  • Mehrjoo S, Dehghanian S (2015) Map reduce based particle swarm optimization for large scale problems. In: AICS 2015: Proceeding of the 3rd International Conference on Artificial Intelligence and Computer Science, pp 12–13

  • Olivas F, Valdez F, Castillo O (2015) Fuzzy classification system design using PSO with dynamic parameter adaptation through fuzzy logic. Fuzzy Log Augment Nat Inspir Optim Metaheuristics Stud Comput Intell 574:29–47

    Google Scholar 

  • Pan H, Zhu YP, Xia L (2013) Fusing multi-feature representation and PSO-Adaboost based feature selection for reliable frontal face detection. In: Proceedings of the IEEE symposium on swarm Intelligence, pp 2998–3002

  • Rajesh R, Agarwal S (2014) Some modification in particle swarm optimization. In: the 18th Online World Conference on Soft Computing in Industrial Applications

  • Sadasivam GS, Selvaraj D (2011) A novel parallel hybrid PSOGA using Map Reduce to schedule jobs in Hadoop data grids. In: NaBIC: Second World Congres, IEEE. doi: 10.1109/NABIC.2010.5716346

  • Shi YH, Eberhart RC (2001) Fuzzy adaptive particle swarm optimization. In: Proceedings of the IEEE congress on evolutionary computation, pp 101–106

  • Soeprijanto A, Abdillah M (2011) Type 2 fuzzy adaptive binary particle swarm optimization for optimal placement and sizing of distributed generation. In: Proceedings of the 2nd international conference on instrumentation, communications, information technology, and biomedical engineering (ICICIBME), IEEE, pp 233–238

  • Sun J, Feng B, Xu W (2004) Particle swarm optimization with particle having quantum behaviour. In: Proceedings of the IEEE congress on evolutionary computation, pp 325–331

  • Torabi SA, Sahebjamnia N, Mansouri SA, Bajestani MA (2013) A particle swarm optimization for a fuzzy multi-objective unrelated parallel machine scheduling problem. Appl Soft Comput 13:4750–4762

    Article  Google Scholar 

  • Vieira SM, Mendonca LF, Farinha GJ, Sousa JMC (2013) Modified binary PSO for feature selection using SVM applied to mortality prediction of septic patients. Appl Soft Comput 13:3494–3504

    Article  Google Scholar 

  • Wai ENC, Tsai PW, Pan JS (2016) Hierarchical PSO clustering on mapreduce for scalable privacy preservation in big data. Genet Evolut Comput Ser Adv Intell Syst Comput 536:36–44

    Article  Google Scholar 

  • Wang J, Yuan D, Jiang M (2012) Parallel K-PSO based on map reduce. IEEE explorer, pp 1203–1208

  • Wang F, Yu PLH, Chung WD (2014) Combining technical trading rules using parallel particle swarm optimization based on Hadoop. In: IJCNN. doi: 10.1109/IJCNN.2014.6889599

  • Wang Y, Li Y, Chen Z, Xue X (2016) Cooperative particle swarm optimization using Map reduce. Soft computing. https://doi.org/10.1007/s00500-016-2390-9

    Google Scholar 

  • Xu J, Tang Y (2015) Improved particle optimization algorithm solving hadoop task scheduling problem. In: ICICCI, pp 11–14

  • Xua Y, You T (2013) Minimizing thermal residual stresses in ceramic matrix composites by using Iterative MapReduce guided particle swarm optimization algorithm. Compos Struct 99:388–396

    Article  Google Scholar 

  • Xue B, Zhang M, Browne WN (2014) Particle swarm optimization for feature selection in classification: novel initialisation and updating mechanisms. Appl Soft Comput 18:261–276. https://doi.org/10.1016/j.asoc.2013.09.018

    Article  Google Scholar 

  • Yang S, Wang M, Jiao L (2004) A quantum particle swarm optimization. In: Proceedings of the IEEE congress on evolutionary computation, pp 320–324

Download references

Acknowledgements

This work is supported by the SRF grant from Council of Scientific & Industrial Research (CSIR), India, SRF Grant (09/1144(0001)2015EMR-I) and Department of Computer Science, Central University of South Bihar.

Author information

Authors and Affiliations

  1. Department of Computer Science, Central University of South Bihar, CUSB, Patna, India

    Shikha Agarwal & Prabhat Ranjan

Authors
  1. Shikha Agarwal
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Prabhat Ranjan
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Shikha Agarwal.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Agarwal, S., Ranjan, P. MR-TP-QFPSO: map reduce two phases quantum fuzzy PSO for feature selection. Int J Syst Assur Eng Manag 9, 888–900 (2018). https://doi.org/10.1007/s13198-017-0682-9

Download citation

  • Received:

  • Revised:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s13198-017-0682-9

Keywords

Search

Navigation