Skip to main content

An Improved Weighted ELM with Krill Herd Algorithm for Imbalanced Learning

  • Conference paper
  • First Online:

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 10386))

Abstract

The traditional weighted extreme learning machine chose input weights and hidden biases randomly. This made the algorithm responding slowly and led to worse generalization. In order to overcome the shortcomings, an improved weighted extreme learning machine combining with krill herd algorithm is proposed to solve the class imbalance problems. Krill herd algorithm is adopted to optimize the input weights and hidden biases. The simulation results show that krill herd algorithm can find more suitable input weights and hidden biases, which has better classify accuracy than particle swarm optimization and genetic algorithm. The proposed algorithm also has stable classify accuracy for the data sets with different imbalance ratios.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. Chawla, N.V., Bowyer, K.W., Hall, L.O., Kegelmeyer, W.P.: Smote: synthetic minority over-sampling technique. J. Artif. Intell. Res. 16(1), 321–357 (2002)

    MATH  Google Scholar 

  2. Deng, W., Zheng, Q., Chen, L.: Regularized extreme learning machine. In: IEEE Symposium on Computational Intelligence and Data Mining (CIDM 2009), pp. 389–395 (2009)

    Google Scholar 

  3. Dong, L.I.: Stock price prediction based on extreme learning machine and fruit fly of algorithm. Comput. Eng. Appl. 50(18), 14–18 (2014)

    Google Scholar 

  4. Ertam, F., Avci, E.: A new approach for internet traffic classification: GA-WK-ELM. Measurement 95, 135–142 (2017)

    Article  Google Scholar 

  5. Gandomi, A.H., Alavi, A.H.: Krill herd: a new bio-inspired optimization algorithm. Commun. Nonlinear Sci. Numer. Simul. 17(12), 4831–4845 (2012)

    Article  MathSciNet  MATH  Google Scholar 

  6. HaiboHe, Y.: Imbalanced Learning: Foundations, Algorithms, and Applications. John Wiley & Sons, Inc., Hoboken (2013)

    Google Scholar 

  7. Han, F., Yao, H.F., Ling, Q.H.: An improved evolutionary extreme learning machine based on particle swarm optimization. Neurocomputing 116, 87–93 (2013)

    Article  Google Scholar 

  8. Huang, D.S., Ip, H.H.S., Law, K.C.K., Chi, Z.: Zeroing polynomials using modified constrained neural network approach. IEEE Trans. Neural Netw. 16(3), 721–732 (2005)

    Article  Google Scholar 

  9. Huang, G.B., Zhou, H., Ding, X., Zhang, R.: Extreme learning machine for regression and multiclass classification. IEEE Trans. Syst. Man Cybern. Part B 42(42), 513–529 (2012)

    Article  Google Scholar 

  10. Huang, G.B., Chen, L., Siew, C.K.: Universal approximation using incremental constructive feedforward networks with random hidden nodes. IEEE Trans. Neural Netw. 17(4), 879–892 (2006)

    Article  Google Scholar 

  11. Liang, N.Y., Huang, G.B., Saratchandran, P., Sundararajan, N.: A fast and accurate online sequential learning algorithm for feedforward networks. IEEE Trans. Neural Netw. 17(6), 1411–1423 (2006)

    Article  Google Scholar 

  12. Ramentol, E., Caballero, Y., Bello, R., Herrera, F.: Smote-RSB*: a hybrid preprocessing approach based on oversampling and undersampling for high imbalanced data-sets using smote and rough sets theory. Knowl. Inf. Syst. 33(2), 245–265 (2012)

    Article  Google Scholar 

  13. Sun, Y., Kamel, M.S., Wong, A.K.C., Wang, Y.: Cost-sensitive boosting for classification of imbalanced data. Pattern Recognit. 40(12), 3358–3378 (2007)

    Article  MATH  Google Scholar 

  14. Yu, H., Sun, C., Yang, X., Yang, W., Shen, J., Qi, Y.: ODOC-ELM: optimal decision outputs compensation-based extreme learning machine for classifying imbalanced data. Knowl. Based Syst. 92, 55–70 (2015)

    Article  Google Scholar 

  15. Zhao, G., Shen, Z., Miao, C., Man, Z.: On improving the conditioning of extreme learning machine: a linear case. In: 7th International Conference on Information, Communications and Signal Processing (ICICS 2009), pp. 1–5 (2009)

    Google Scholar 

  16. Zhu, Q.Y., Qin, A.K., Suganthan, P.N., Huang, G.B.: Evolutionary extreme learning machine. Pattern Recognit. 38(10), 1759–1763 (2005)

    Article  MATH  Google Scholar 

  17. Zong, W., Huang, G.B., Chen, Y.: Weighted extreme learning machine for imbalance learning. Neurocomputing 101(3), 229–242 (2013)

    Article  Google Scholar 

Download references

Acknowledgments

This work is supported by National Natural Science Foundation of China under Grant 61573361, National Basic Research Program of China under Grant 2014CB046300 and the Innovation Team of CUMT under Grant 2015QN003. Also, thank you for the support from Collaborative Innovation Center of Intelligent Mining Equipment, CUMT.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Jian Cheng .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer International Publishing AG

About this paper

Cite this paper

Guo, Yn. et al. (2017). An Improved Weighted ELM with Krill Herd Algorithm for Imbalanced Learning. In: Tan, Y., Takagi, H., Shi, Y., Niu, B. (eds) Advances in Swarm Intelligence. ICSI 2017. Lecture Notes in Computer Science(), vol 10386. Springer, Cham. https://doi.org/10.1007/978-3-319-61833-3_39

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-61833-3_39

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-61832-6

  • Online ISBN: 978-3-319-61833-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics