Skip to main content

A Wrapper Feature Selection Algorithm Based on Brain Storm Optimization

  • Conference paper
  • First Online:
Bio-inspired Computing: Theories and Applications (BIC-TA 2018)

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 952))

Abstract

Feature selection is an important preprocessing technique of data, which can be generally modeled as a binary optimization problem. Brain storm optimization (BSO) is a newly proposed algorithm that has not been systematically applied to feature selection problems yet. This paper studies an effective wrapper feature selection method based on BSO. Focused on this goal, firstly, a selective probability-based real encoding strategy of individual is introduced to transform the binary feature selection problem into a continuous optimization one. Based on this, then a continuous BSO-based feature selection algorithm (CBSOFS) is proposed. The proposed algorithm is tested on standard benchmark datasets and then compared to four representative algorithms. Experimental results show that CBSOFS achieves comparable results with compared algorithms.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Jensen, R., Mac Parthalain, N.: Towards scalable fuzzy-rough feature selection. Inf. Sci. 323, 1–15 (2015)

    Article  MathSciNet  Google Scholar 

  2. Park, C.H., Kim, S.B.: Sequential random k-nearest neighbor feature selection for high-dimensional data. Expert Syst. Appl. 42(5), 2336–2342 (2015)

    Article  Google Scholar 

  3. Wang, X., Yang, J., Teng, X., Xia, W., Jensen, R.: Feature selection based on rough sets and particle swarm optimization. Pattern Recognit. Lett. 28(4), 459–471 (2007)

    Article  Google Scholar 

  4. Liu, H., Yu, L.: Toward integrating feature selection algorithms for classification and clustering. IEEE Trans. Knowl. Data Eng. 17(4), 491–502 (2005)

    Article  Google Scholar 

  5. Xue, B., Zhang, M.J., Browne, W.N., Yao, X.: A survey on evolutionary computation approaches to feature selection. IEEE Trans. Evol. Comput. 20(4), 606–626 (2016)

    Article  Google Scholar 

  6. Kohavi, R., John, G.: Wrappers for feature selection. Artif. Intell. 97(1–2), 273–324 (1997)

    Article  Google Scholar 

  7. Diao, R., Shen, Q.: Nature inspired feature selection meta-heuristics. Artif. Intell. Rev. 44, 311–340 (2015)

    Article  Google Scholar 

  8. Oreski, S., Oreski, G.: Genetic algorithm-based heuristic for feature selection in credit risk assessment. Expert Syst. Appl. 41(4), 2052–2064 (2014)

    Article  Google Scholar 

  9. Pedram, G., Jon Atli, B.: Feature selection based on hybridization of genetic algorithm and particle swarm optimization. IEEE Geosci. Remote Sens. Lett. 12(2), 309–313 (2015)

    Article  Google Scholar 

  10. Al-Ani, A., Alsukker, A., Khushaba, R.: Feature subset selection using differential evolution and a wheel based search strategy. Swarm Evol. Comput. 9, 15–26 (2013)

    Article  Google Scholar 

  11. Sina, T., Parham, M.: Relevance-redundancy feature selection based on ant colony optimization. Pattern Recognit. 48(9), 2798–2811 (2015)

    Article  Google Scholar 

  12. Wang, G., Chu, H.S., Zhang, Y.X.: Multiple parameter control for ant colony optimization applied to feature selection problem. Neural Comput. Appl. 26(7), 1693–1708 (2015)

    Article  Google Scholar 

  13. Zorarpaci, E., Ozel, S.A.: A hybrid approach of differential evolution and artificial bee colony for feature selection. Expert Syst. Appl. 62, 91–103 (2016)

    Article  Google Scholar 

  14. Hancer, E., Xue, B., Zhang, M.J.: Pareto front feature selection based on artificial bee colony optimization. Inf. Sci. 422, 462–479 (2018)

    Article  Google Scholar 

  15. Zhang, Y., Song, X.F., Gong, D.W.: A return-cost-based binary firefly algorithm for feature selection. Inf. Sci. 418–419, 561–574 (2017)

    Article  Google Scholar 

  16. Zhang, Y., Gong, D.W., Hu, Y.: Feature selection algorithm based on bare bones particle swarm optimization. Neurocomputing 148, 150–157 (2013)

    Article  Google Scholar 

  17. Xue, B., Zhang, M.J., Browne, W.N.: Particle swarm optimization for feature selection in classification: a multi-objective approach. IEEE Trans. Cybern. 43(6), 1656–1671 (2013)

    Article  Google Scholar 

  18. Zhang, Y., Gong, D.W., Cheng, J.: Multi-objective particle swarm optimization approach for cost-based feature selection in classification. IEEE/ACM Trans. Comput. Biol. Bioinform. 22(99), 64–75 (2017)

    Article  Google Scholar 

  19. Zhang, Y., Gong, D.W., Zhang, W.Q.: Feature selection of unreliable data using an improved multi-objective PSO algorithm. Neurocomputing 171, 1281–1290 (2016)

    Article  Google Scholar 

  20. Shi, Y.: Brain storm optimization algorithm. In: Tan, Y., Shi, Y., Chai, Y., Wang, G. (eds.) ICSI 2011. LNCS, vol. 6728, pp. 303–309. Springer, Heidelberg (2011). https://doi.org/10.1007/978-3-642-21515-5_36

    Chapter  Google Scholar 

  21. Cheng, S., Qin, Q.D., Chen, J.F., Shi, Y.H.: Brain storm optimization algorithm: a review. Artif. Intell. Rev. 46(4), 445–458 (2016)

    Article  Google Scholar 

  22. Ma, X.J., Jin, Y., Dong, Q.L.: A generalized dynamic fuzzy neural network based on singular spectrum analysis optimized by brain storm optimization for short-term wind speed forecasting. Appl. Soft Comput. 54, 296–312 (2017)

    Article  Google Scholar 

  23. Wang, J.Z., Hou, R., Wang, C., Shen, L.: Improved v-support vector regression model based on variable selection and brain storm optimization for stock price forecasting. Appl. Soft Comput. 49, 164–178 (2016)

    Article  Google Scholar 

  24. Duan, H.B., Li, C.: Quantum-behaved brain storm optimization approach to solving loney’s solenoid problem. IEEE Trans. Magn. 51(1), 1–7 (2015). ID: 7000307

    Article  Google Scholar 

  25. Kennedy, J., Eberhart, R.C.: A discrete binary version of the particle swarm algorithm. In: Proceedings of 1997 Conference Systems Man and Cybernetics, pp. 4104–4108 (1997)

    Google Scholar 

  26. Murphy, P.M., Aha, D.W.: UCI repository of machine learning databases. Technical report, Department of Information and Computer Science, University of California, Irvine, California. http://www.ics.uci.edu/~mlearn/MLRepository.html

  27. Pudil, P., Novovicova, J., Kittler, J.: Floating search methods in feature selection. Pattern Recognit. Lett. 15(11), 1119–1125 (1994)

    Article  Google Scholar 

  28. Kudo, M., Sklansky, J.: Comparison of algorithms that select features for pattern classifiers. Pattern Recognit. 33(1), 25–41 (2000)

    Article  Google Scholar 

  29. Oh, I.-S., Lee, J.S., Moon, B.R.: Hybrid genetic algorithms for feature selection. IEEE Trans. Pattern Anal. Mach. Intell. 26(1), 1424–1437 (2004)

    Google Scholar 

  30. Zhang, Y., Gong, D.W., Sun, X.Y., Guo, Y.N.: A PSO-based multi-objective multilabel feature selection method in classification. Sci. Rep. 7, 376 (2017)

    Article  Google Scholar 

Download references

Acknowledgement

This work was jointly supported by National Natural Science Foundation of China (No. 61473299, 61473298, 61573361), and Jiangsu Six Talents Peaks Project of Province under Grant No. DZXX-053.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Yong Zhang .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Zhang, Xt., Zhang, Y., Gao, Hr., He, Cl. (2018). A Wrapper Feature Selection Algorithm Based on Brain Storm Optimization. In: Qiao, J., et al. Bio-inspired Computing: Theories and Applications. BIC-TA 2018. Communications in Computer and Information Science, vol 952. Springer, Singapore. https://doi.org/10.1007/978-981-13-2829-9_28

Download citation

  • DOI: https://doi.org/10.1007/978-981-13-2829-9_28

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-13-2828-2

  • Online ISBN: 978-981-13-2829-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics