Skip to main content
Log in

A robust extreme learning machine framework for uncertain data classification

  • Published:
The Journal of Supercomputing Aims and scope Submit manuscript

Abstract

Uncertain or missing data may occur in many practical applications. A principled strategy for handling this problem would therefore be very useful. We consider two-class and multi-class classification problems where the mean and covariance of each class are assumed to be known. With simple structure, fast speed and good performance, extreme learning machine (ELM) has been an important technology in machine learning. In this work, from the viewpoint of probability, we present a robust ELM framework (RELM) for missing data classification. Applying the Chebyshev–Cantelli inequality, the proposed RELM is reformulated as a second-order cone programming with global optimal solution. The proposed RELM only relates to the second moments of input samples and makes no assumption about the data probability distribution. Expectation maximization algorithm is used to fill in missing values and then obtain complete data. Numerical experiments are simulated in various datasets from UCI database and a practical application database. Experimental results show that the proposed method can achieve better performance than traditional methods. These results illustrate the feasibility and effectiveness of the proposed method for missing data classification.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

References

  1. Dempster A (1977) Maximum likelihood from incomplete data via the EM algorithm. J R Stat Soc 39(1):1–38

    MathSciNet  MATH  Google Scholar 

  2. Huang GB, Zhu QY, Siew CK (2006) Extreme learning machine: theory and applications. Neurocomputing 70:489–501

    Article  Google Scholar 

  3. Huang GB, Ding XJ, Zhou HM (2010) Optimization method based extreme learning machine for classification. Neurocomputing 74:155–163

    Article  Google Scholar 

  4. Zhu H, Tsang ECC, Zhu J (2018) Training an extreme learning machine by localized generalization error model. Soft Comput 2:1–9

    MATH  Google Scholar 

  5. Yang LM, Zhang S (2016) A sparse extreme learning machine framework by continuous optimization algorithms and its application in pattern recognition. Eng Appl Artif Intell 53:176–189

    Article  Google Scholar 

  6. Yu YL, Sun Z (2017) Sparse coding extreme learning machine for classification. Neurocomputing 261:50–56. https://doi.org/10.1016/j.neucom.2016.06.078

    Article  Google Scholar 

  7. Wang Z, Wu D, Gravina R, Fortino G, Jiang Y (2017) Kernel fusion based extreme learning machine for cross-location activity recognition. Inf Fusion 37:1–9

    Article  Google Scholar 

  8. Yu Q, Miche Y, Eirola E, Heeswijk MV, Verin E (2013) Regularized extreme learning machine for regression with missing data. Neurocomputing 102(2):45–51

    Article  Google Scholar 

  9. Sovilj D, Eirola E, Miche Y, Björk KM, Nian R, Akusok A, Lendasse A (2016) Extreme learning machine for missing data using multiple imputations. Neurocomputing 174((PA)):220–231

    Article  Google Scholar 

  10. Shivaswamy PK, Bhattacharyya C, Smola AJ (2006) Second order cone programming approaches for handling missing and uncertain data. J Mach Learn Res 7:1283–1314

    MathSciNet  MATH  Google Scholar 

  11. Scholkopf B, Platt J, Hofmann T (2007) Max-margin classification of incomplete data. In: Advances in neural information processing system, pp 233–240

  12. Garcia-Laencina PJ, Sancho-Gomez J-L, Figueiras-Vidal AR (2010) Pattern classification with missing data: a review. Neural Comput Appl 19(2):263–282

    Article  Google Scholar 

  13. Fraley C, Hesterberg T (2009) Least angle regression and LASSO for large datasets. Stat Anal Data Min 1(4):251–259

    Article  MathSciNet  Google Scholar 

  14. Mclachlan GJ, Krishnan T (2008) The EM algorithm and extensions. Biometrics 382(1):154–156

    MATH  Google Scholar 

  15. Welling M, Weber M (2001) A constrained EM algorithm for independent component analysis. Neural Comput 13(3):677–689

    Article  MATH  Google Scholar 

  16. Marshall W, Olkin I (1960) Multivariate Chebychev inequalities. Ann Math Stat 31(4):1001–1014

    Article  MATH  Google Scholar 

  17. Lobo MS, Vandenberghe L, Boyd S, Lebret H (1998) Applications of second-order cone programming. Linear Algebra Appl 284(1–3):193–228

    Article  MathSciNet  MATH  Google Scholar 

  18. Alzalg BM (2012) Stochastic second-order cone programming: applications models. Appl Math Model 36(10):5122–5134

    Article  MathSciNet  MATH  Google Scholar 

  19. Bartlett PL, Wegkamp MH (2008) Classification with a reject option using a hinge loss. J Mach Learn Res 9(12):1823–1840

    MathSciNet  MATH  Google Scholar 

  20. Lanckriet GRG, Ghaoui LE, Bhattacharyya C et al (2003) A robust minimax approach to classification. J Mach Learn Res 3(3):555–582

    MathSciNet  MATH  Google Scholar 

  21. Blake CL, Merz CJ (1998) UCI Repository for Machine Learning Databases, Department of Information and Computer Sciences, University of California, Irvine http://www.ics.uci.edu/mlearn/MLRepository.html

  22. Yang L, Dong H (2018) Support vector machine with truncated pinball loss and its application in pattern recognition. Chemom Intell Lab Syst 177:89–99

    Article  Google Scholar 

Download references

Acknowledgements

This work was supported by National Nature Science Foundation of China (11471010) and Chinese Universities Scientific Fund (2017LX003). Moreover, the authors thank very the referees and the editor for their constructive comments. Their suggestions improved the paper significantly.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Liming Yang.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Jing, S., Yang, L. A robust extreme learning machine framework for uncertain data classification. J Supercomput 76, 2390–2416 (2020). https://doi.org/10.1007/s11227-018-2430-6

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11227-018-2430-6

Keywords

Navigation