Skip to main content
SpringerLink
Log in

Multi-label classification algorithm research based on swarm intelligence

  • Published:
Cluster Computing Aims and scope Submit manuscript

Abstract

Since data and resources have massive feature and feature of data are increasingly complex, traditional data structures are not suitable for current data anymore. Therefore, traditional single-label learning method cannot meet the requirements of technology development and the importance of multi-label leaning method becomes more and more highlighted. K-Nearest Neighbor (KNN) classification method is a lazy learning method in data classification methods. It does not need data training process and theoretical system is mature. In addition, principle and implementation is simple. This paper proposed improvements strategies only considers numerical feature of sample KNN when classifying, but not consider the disadvantage of sample structure feature. This paper introduced particle swarm optimization algorithm into KNN classification and make adjustments to Euclidean distance formula in traditional KNN classification algorithm and add weight value to each feature. Using adjusted distance formula to train training data through particle swarm optimization algorithm and optimized a set of weight value for all features and put these optimized weight values to adjusted distance formula and calculated the distance between each example in test data set and in training data set and predict the test data set. Experiment results show that weighted KNN classification algorithm based on particle swarm optimization algorithm can achieve better classification accuracy than traditional KNN classification algorithm.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18

Similar content being viewed by others

References

  1. Sinan, L.I., Ning, L.I., Zhanhuai, L.I.: Multi-label data mining technology: research summary. Comput. Sci. 40(4), 14–19 (2013)

    Google Scholar 

  2. Cover, T.M., Hart, P.E.: Nearest neighbor pattern classification. IEEE Trans. Inf. Theory 13, 21–27 (1967)

    Article  MATH  Google Scholar 

  3. Yan, X., Luo, W., Wu, Q., Sheng, V.S.: A hybrid intelligent data classification algorithm. Int. J. Wirel. Mob. Comput. 6(6), 573–580 (2013)

    Article  Google Scholar 

  4. Yan, X., Li, W., Chen, W., Luo, W., Zhang, C., Wu, Q., Liu, H.: Weighted K-nearest neighbor classification algorithm based on Genetic Algorithm. TELKOMNIKA Indones. J. Electr. Eng. 11(10), 6173–6178 (2013)

    Google Scholar 

  5. Zhang, M.L., Zhou, Z.H.: ML-kNN: A lazy learning approach to multi-label learning. Pattern Recogn. 40(7), 2038–2048 (2007)

    Article  MATH  Google Scholar 

  6. Guang, K., Pan, J.: K-Nearest Neighbor Multi-label text classification algorithm based on vector angel. Comput. Sci. 35(4), 205–207 (2008)

    Google Scholar 

  7. Wang, C.: Weighted ML-KNN algorithm. Comput. Knowl. Technol. 8(4), 816–818 (2012)

    Google Scholar 

  8. Cheng, S., Huang, Q., Liu, J.: Revised ML-KNN Multi-label file classification method. Haerbin Industry University Journey 45(11), 45–49 (2013)

    Google Scholar 

  9. Xuesong, Y., Qinghua, W., Sheng, V.S.: A double weighted Naive Bayes with niching cultural algorithm for multi-label classification, Int. J. Pattern Recognit. Artif. Intell. 30(6), 1650013 (2016)

  10. Kennedy, J., Eberhart, R.C.: Particle Swarm Optimization. In: Proceedings of IEEE International Conference on Neural Networks (1995), 1942–1948

  11. Clerc, M., Kennedy, J.: The particle swarm—explosion, stability, and convergence in a multidimensional complex space. IEEE Trans. Evol. Comput. 6(1), 58–73 (2002)

    Article  Google Scholar 

  12. Coello, C.A., Lechuga, M.S.: Mopso, A proposal for multiple objective particle swarm optimization. In: IEEE Proceedings World Congress on Computational Intelligence, pp. 1051–1056 (2002)

  13. Kennedy, J.: The particle swarm: social adaptation of knowledge. In: Proceedings of the IEEE international Conference on evolutionary computation, pp. 3003-3008 (1997)

  14. Oscan, E., Mohan, C.K.: Analysis of a simple particle swarm optimization system. Intell. Eng. Syst. Artif. Neural Netw. 8, 253–258 (1998)

    Google Scholar 

  15. Yan, X., Zhang, C., Luo, W., Li, W., Chen, W., Liu, H.: Solve traveling salesman problem using particle swarm optimization algorithm. Int. J. Comput. Sci. 9(6), 264–271 (2012)

    Google Scholar 

  16. Yan, X., Yao, H., Liang, Q., Hu, C., Fan, Y., Huang, W.: Engineering optimization algorithm based on particle swarm optimization. Int. J. Adv. Comput. Technol. 5(3), 113–121 (2013)

    Google Scholar 

  17. Yan, X., Hu, C., Yao, H., Fan, Y., Liang, Q., Liu, C.: Electronic circuit optimization design algorithm based on particle swarm optimization. Przeglad Elektrotechniczny 89(03b), 50–52 (2013)

    Google Scholar 

  18. Yan, X., Wu, Q., Hu, C., Yao, H., Fan, Y., Liang, Q., Liu, C.: Robot path planning based on swarm Intelligence. Int. J. Control Autom. 7(7), 15–32 (2014)

    Article  Google Scholar 

  19. Wu, Q., Liu, H., Yan, X.: An improved design optimisation algorithm based on swarm intelligence. Int. J. Comput. Sci. Math. 5(1), 27–36 (2014)

    Article  MathSciNet  MATH  Google Scholar 

  20. Chen, H.: Weighted KNN Algorithm and Its Application. Hebei University, Hebei (2005)

    Google Scholar 

  21. Hechenbichler, K., Schliep, K.P.: Weighted k-Nearest-Neighbor Techniques and Ordinal Classification, Discussion Paper 399, SFB 386, Ludwig-Maximilians University Munich (2004), (http://www.stat.uni-muenchen.de/sfb386/papers/dsp/paper399.ps)

Download references

Acknowledgments

This paper is supported by Natural Science Foundation of China. (Nos. 61440060, 41404076 and 61673354), the Provincial Natural Science Foundation of Hubei (No. 2015CFA065).

Author information

Authors and Affiliations

  1. Faculty of Computer Science and Engineering, Wuhan Institute of Technology, Hubei, 430074, Wuhan, China

    Qinghua Wu

  2. Wuhan Institute of Ship Building Technology, Hubei, 430074, Wuhan, China

    Hanmin Liu

  3. School of Computer Science, China University of Geosciences, Hubei, 430074, Wuhan, China

    Xuesong Yan

Authors
  1. Qinghua Wu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Hanmin Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Xuesong Yan
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Qinghua Wu.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Wu, Q., Liu, H. & Yan, X. Multi-label classification algorithm research based on swarm intelligence. Cluster Comput 19, 2075–2085 (2016). https://doi.org/10.1007/s10586-016-0646-x

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10586-016-0646-x

Keywords

Search

Navigation