Skip to main content

Evaluation Criteria for Noise Resilience in Regression Algorithms

  • Conference paper
  • First Online:
Explainable AI and Other Applications of Fuzzy Techniques (NAFIPS 2021)

Abstract

Noise resilience is a popular attribute among machine learning algorithms. In regression problems, it refers to the ability to keep high performance even when the data is noisy. Surprisingly, there is no standard figure of merit to quantify it. This theoretical research leverages the variance of the residuals to determine objectively the performance of a regression algorithm in the presence of noisy data. The two main contributions of the paper are the locality conditions of noise resilience and the noise resilience score, NR.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Liu, J., Feng, K., Qu, Y., Nawaz, A., Song, H., Wang, F.: Stability analysis of T–S fuzzy coupled oscillator systems influenced by stochastic disturbance. Neural Comput. Appli. 33(7), 2549–2560 (2020). https://doi.org/10.1007/s00521-020-05116-x

    Article  Google Scholar 

  2. Ontiveros-Robles, E., Melin, P., Castillo, O.: Comparative analysis of noise robustness of type 2 fuzzy logic controllers. Kybernetika 54, 175–201 (2018)

    MathSciNet  MATH  Google Scholar 

  3. Hoseini, S.A., Labibi, B.: Robust fuzzy controller design with bounded control effort for nonlinear systems with parametric uncertainties. In: 2009 International Conference on Networking, Sensing and Control, pp. 118–123. IEEE, Okayama, Japan (2009)

    Google Scholar 

  4. Sathyan, A., Cohen, K.: Development of a genetic fuzzy controller and its application to a noisy inverted double pendulum. Fuzzy Logic Based in Optimization Methods and Control Systems and its Applications, IntechOpen, pp. 27–40 (2018).

    Google Scholar 

  5. Aman, S., Simmhan, Y., Prasanna, V.K.: Holistic measures for evaluating prediction models in smart grids. IEEE Trans. Knowl. Data Eng. 27(2), 475–488 (2015)

    Article  Google Scholar 

  6. Chai, T., Draxler, R.R.: Root mean square error (RMSE) or mean absolute error (MAE)?–arguments against avoiding RMSE in the literature. Geosci. Model Dev. 7(3), 1247–1250 (2014)

    Article  Google Scholar 

  7. Kitchenham, B.A., Pickard, L.M., MacDonell, S.G., Shepperd, M.J.: What accuracy statistics really measure? IEE Proc.-Softw. 148(3), 81–85 (2001)

    Article  Google Scholar 

  8. Makridakis, S.: Accuracy measures: theoretical and practical concerns. Int. J. Forecast. 9(4), 527–529 (1993)

    Article  Google Scholar 

  9. Morley, S.K., Brito, T.V., Welling, D.T.: Measures of model performance based on the log accuracy ratio. Space Weather 16(1), 69–88 (2018)

    Article  Google Scholar 

  10. Likassa, H.T., Fang, W.: Robust regression for image alignment via subspace recovery techniques. In: Proceedings of the 2018 VII International Conference on Network, Communication and Computing (ICNCC 2018), pp. 288–293. Association for Computing Machinery, New York, NY, USA (2018)

    Google Scholar 

  11. Anubi, O.M., Konstantinou, C.: Enhanced resilient state estimation using data-driven auxiliary models. IEEE Trans. Industr. Inf. 16(1), 639–647 (2020)

    Article  Google Scholar 

  12. Brandman, D.M., Burkhart, M.C., Kelemen, J., Franco, B., Harrison, M.T., Hochberg, L.R.: Robust closed-loop control of a cursor in a person with tetraplegia using Gaussian process regression. Neural Comput. 30(11), 2986–3008 (2018)

    Article  MathSciNet  Google Scholar 

  13. Li, J., Chen, Q., Leng, J., Zhang, W., Guo, M.: Probabilistic robust regression with adaptive weights — a case study on face recognition. Front. Comp. Sci. 14(5), 1–12 (2019). https://doi.org/10.1007/s11704-019-9097-x

    Article  Google Scholar 

  14. Both, Gert-Jan., Choudhury, S., Sens, P., Kusters, R.: DeepMoD: deep learning for model discovery in noisy data. J. Comput. Phys. 428, 109985 (2021). https://doi.org/10.1016/j.jcp.2020.109985

    Article  MathSciNet  Google Scholar 

  15. Li, M., Soltanolkotabi, M., Oymak, S.: Gradient descent with early stopping is provably robust to label noise for overparameterized neural networks. In: Proceedings of the Twenty Third International Conference on Artificial Intelligence and Statistics, PMLR, vol. 108, pp. 4313–4324 (2020)

    Google Scholar 

  16. Dick, K., Russell, L., Dosso, Y., Kwamena, F., Green, J.: Deep learning for critical infrastructure resilience. J. Infrastruct. Syst. 25(2), 05019003 (2019). https://doi.org/10.1061/(ASCE)IS.1943-555X.0000477

    Article  Google Scholar 

Download references

Acknowledgements

The project that generated these results was supported by a grant from the “la Caixa” Banking Foundation (ID 100010434), whose code is LCF/BQ/AA19/11720045.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Javier Viaña .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Viaña, J., Cohen, K. (2022). Evaluation Criteria for Noise Resilience in Regression Algorithms. In: Rayz, J., Raskin, V., Dick, S., Kreinovich, V. (eds) Explainable AI and Other Applications of Fuzzy Techniques. NAFIPS 2021. Lecture Notes in Networks and Systems, vol 258. Springer, Cham. https://doi.org/10.1007/978-3-030-82099-2_43

Download citation

Publish with us

Policies and ethics