Skip to main content
SpringerLink
Log in

Laplacian Generalized Eigenvalues Extreme Learning Machine

  • Published:
Neural Processing Letters Aims and scope Submit manuscript

Abstract

Semi-supervised learning is an attractive technique for using unlabeled data in classification. In this work, an efficient semi-supervised extreme learning machine (ELM) classification framework is proposed by introducing the Laplacian regularization term. It tries to build two nonparallel hyperplanes such that each hyperplane is closer to one of the two classes and farther away from the other class in ELM feature space, based on which, two new semi-supervised ELM classification algorithms are proposed. First, we formulate semi-supervised ELM as a ratio form, and reformulate it as a generalized eigenvalue problem (called Laplacian generalized eigenvalue extreme learning machine, LapGELM) to solve simply. Then we replace the form of ratio with a form of difference so that the optimization problems can be transformed into a standard eigenvalue problem (called Laplacian standard eigenvalue ELM, LapSELM) to control overfit and solve quickly. Furthermore, the proposed algorithms are implemented on various datasets with different sizes and structures. Compared with traditional methods, experiment results show the feasibility and effectiveness of the proposed algorithms due to their simplicity, rapidity, and good generalization performance.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18

Similar content being viewed by others

References

  1. Petros X, Panos P, Theodore T (2013) Robust data mining. https://doi.org/10.1007/978-1-4419-9878-1

  2. Bauman E, Bauman K (2017) One-Class Semi-supervised Learning. In: Braverman Readings in Machine Learning, pp 189–200

  3. K O, Soguero-Ruíz C, Bianchi FM, Jenssen R (2019) Noisy multi-label semi-supervised dimensionality reduction. Pattern Recognit 90:257–270

  4. Joachims T (1999) Transductive inference for text classification using support vector machines. In: ICML

  5. Bennett K, Demiriz A (1998) Semi-supervised support vector machines. In: NIPS

  6. Huang G, Song S, Gupta J, Wu C (2014) Semi-supervised and unsupervised extreme learning machines. IEEE Trans Cybern 44:2405–2417

    Article  Google Scholar 

  7. Luo X, Liu F, Yang S, Wang X, Zhou Z (2015) Joint sparse regularization based Sparse Semi-Supervised Extreme Learning Machine (S3ELM) for classification. Knowl Based Syst 73:149–160

    Article  Google Scholar 

  8. Gomez-Chova L, Camps-Valls G, Munoz-Mari J, Calpe J (2008) Semisupervised image classification with Laplacian support vector machines. IEEE Geosci Remote Sens Lett 5(3):336–340. https://doi.org/10.1109/LGRS.2008.916070

    Article  Google Scholar 

  9. Qi Z, Tian Y, Shi Y (2012) Laplacian twin support vector machine for semi-supervised classification. Neural Netw 35:46–53

    Article  Google Scholar 

  10. Mangasarian O, Wild EW (2006) Multisurface proximal support vector machine classification via generalized eigenvalues. IEEE Trans Pattern Anal Mach Intell 28:69–74

    Article  Google Scholar 

  11. Shao Y, Deng N, Chen W, Wang Z (2013) Improved generalized eigenvalue proximal support vector machine. IEEE Signal Process Lett 20:213–216

    Article  Google Scholar 

  12. Tang L, Tian Y, Yang C, Pardalos P (2018) Ramp-loss nonparallel support vector regression: robust, sparse and scalable approximation. Knowl Based Syst 147:55–67

    Article  Google Scholar 

  13. Viola M, Sangiovanni M, Toraldo G, Guarracino M (2019) Semi-supervised generalized eigenvalues classification. Ann Oper Res 276:249–266

    Article  MathSciNet  Google Scholar 

  14. Chen W, Shao Y, Xu D, Fu Y (2013) Manifold proximal support vector machine for semi-supervised classification. Appl Intell 40:623–638

    Article  Google Scholar 

  15. Huang G, Zhu Q, Siew C (2006) Extreme learning machine: theory and applications. Neurocomputing 70:489–501

    Article  Google Scholar 

  16. Zhou Z (2016) Machine learning. Tsinghua University Press, Beijing

    Google Scholar 

  17. Samat A, Du P, Liu S, Li JY, Cheng L (2014) \({{\rm E}^{2}}{\rm LMs}\): ensemble extreme learning machines for hyperspectral image classification. IEEE J Sel Top Appl Earth Obs Remote Sens 7:1060–1069

    Article  Google Scholar 

  18. Qing Y, Zeng Y, Li Y, Huand G (2020) Deep and wide feature based extreme learning machine for image classification. Neurocomputing 412:426–436

    Article  Google Scholar 

  19. Zhao Y, Huang G, Hu Q, Tan J, Wang J, Yang Z (2019) Soft extreme learning machine for fault detection of aircraft engine. Aerosp Sci Technol 91:70–81

    Article  Google Scholar 

  20. Wang X, Yang K, Kalivas J (2020) Comparison of extreme learning machine models for gasoline octane number forecasting by near-infrared spectra analysis. Optik 200:163325

    Article  Google Scholar 

  21. Wang Z, Xin J, Yang H, Tian S, Yu G, Xu C, Yao Y (2017) Distributed and weighted extreme learning machine for imbalanced big data learning. Tsinghua Sci Technol 22:160–173

    Article  Google Scholar 

  22. Huang G, Ding X, Zhou H (2010) Optimization method based extreme learning machine for classification. Neurocomputing 74:155–163

    Article  Google Scholar 

  23. Li S, Song S, Wan Y (2018) Laplacian twin extreme learning machine for semi-supervised classification. Neurocomputing 321:17–27

    Article  Google Scholar 

  24. Yang J, Cao J, Wang T, Xue A, Chen B (2020) Regularized correntropy criterion based semi-supervised ELM. Neural Netw 122:117–129

    Article  Google Scholar 

  25. Yang J, Cao J, Xue A (2020) Robust maximum mixture correntropy criterion based semi-supervised ELM with variable center. IEEE Trans Circuits Syst II Express Briefs 67:3572–3576

    Article  Google Scholar 

  26. Ma J, Wen Y, Yang L (2020) Fisher-regularized supervised and semi-supervised extreme learning machine. Knowl Inf Syst 62:3995–4027

    Article  Google Scholar 

  27. Krishnasamy G, Paramesran R (2016) Hessian semi-supervised extreme learning machine. Neurocomputing 207:560–567

    Article  Google Scholar 

  28. Tang L, Tian Y, Pardalos P (2019) A novel perspective on multiclass classification: regular simplex support vector machine. Inf Sci 480:324–338

    Article  MathSciNet  Google Scholar 

Download references

Acknowledgements

This work was supported in part by National Natural Science Foundation of China (No. 11471010) and Chinese Universities Scientific Fund.

Author information

Authors and Affiliations

  1. College of Information and Electrical Engineering, China Agricultural University, Beijing, 100083, People’s Republic of China

    Xue Wang

  2. College of Science, China Agricultural University, Beijing, 100083, People’s Republic of China

    Liming Yang

Authors
  1. Xue Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Liming Yang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Liming Yang.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Wang, X., Yang, L. Laplacian Generalized Eigenvalues Extreme Learning Machine. Neural Process Lett 54, 467–499 (2022). https://doi.org/10.1007/s11063-021-10640-5

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11063-021-10640-5

Keywords

Search

Navigation