Abstract
State-of-the-art machine learning methods, such as (deep) neural networks and support vector classifiers, have been successfully applied to problems related to the prediction of natural hazard events. However, the effectiveness of those methods is, in general, obtained at the cost of a complex algorithmic architecture that requires fine-tuning of several parameters. Moreover, their current popularity as a hot topic in the literature makes researchers to ignore simpler and classical methods that might perform equally well and should be preferred according to the Occam’s razor principle. In this paper we exemplify this case by showing that two particular problems of slope stability prediction —that were recently solved using complex approaches named bee colony optimized support vector classifier and metaheuristic-optimized least squares support vector classifier, respectively— can be successfully solved by much more simpler pattern recognition methods. We also emphasize on the importance of data visualization and incremental evaluation during the design cycle of a parsimonious pattern recognition system.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
Notes
Consider, as two examples of events of interest, the following ones: the prediction of slope collapses and the automated classification of seismic events.
The eigenvalues are the variances associated to the uncorrelated components found by PCA.
References
Abdalla JA, Attom MF, Hawileh R (2015) Prediction of minimum factor of safety against slope failure in clayey soils using artificial neural network. Environmental Earth Sciences 73 (9):5463–5477. https://doi.org/10.1007/s12665-014-3800-x
Alpaydin E (2014) Introduction to machine learning. MIT Press, Cambridge
Biem A (2003) A model selection criterion for classification: application to HMM topology optimization. In: Proceedings of the seventh international conference on document analysis and recognition - ICDAR 2003. https://doi.org/10.1109/ICDAR.2003.1227641, pp 104–108
Bishop C (2006) Pattern recognition and machine learning, 1st edn. Springer, New York
Cheng MY, Hoang ND (2015) Typhoon–induced slope collapse assessment using a novel bee colony optimized support vector classifier. Nat Hazards 78(3):1961–1978. https://doi.org/10.1007/s11069-015-1813-8
Choobbasti AJ, Farrokhzad F, Barari A (2009) Prediction of slope stability using artificial neural network (case study: noabad, Mazandaran, Iran). Arab J Geosci 2(4):311–319. https://doi.org/10.1007/s12517-009-0035-3
Cilliers P (2002) Complexity and postmodernism. Understanding complex systems, 1st edn. Routledge, New York
Das SK, Biswal RK, Sivakugan N, Das B (2011) Classification of slopes and prediction of factor of safety using differential evolution neural networks. Environmental Earth Sciences 64(1):201–210. https://doi.org/10.1007/s12665-010-0839-1
Dheeru D, Karra Taniskidou E (2017) UCI machine learning repository. http://archive.ics.uci.edu/ml
Duda RO, Hart PE, Stork DG (2001) Pattern classification, 2nd edn. Wiley, New York
Duin RP, Juszczak P, Paclik P, Pekalska E, de Ridder D, Tax D, Verzakov S (2007) Matlab pattern recognition toolbox for representation and generalization, PRTools. http://prtools.org/
Duin RPW (2014) Who invented the nearest neighbor rule? Available at: http://37steps.com/4370/nn-rule-invention/. http://37steps.com/4370/nn-rule-invention/, 37 Steps - 540 Pattern Recognition Tools: Understanding, Teaching, Services
Duin RPW, Pekalska E (2007) The science of pattern recognition. Achievements and perspectives. Springer, Berlin. chap 10, pp 221–259. https://doi.org/10.1007/978-3-540-71984-7_10
Duncan JM (1996) State of the art: Limit equilibrium and finite–element analysis of slopes. J Geotech Eng 122(7):577–596 . https://doi.org/10.1061/(ASCE)0733-9410(1996)122:7(577)
Erzin Y, Cetin T (2012) The use of neural networks for the prediction of the critical factor of safety of an artificial slope subjected to earthquake forces. Scientia Iranica 19(2):188–194. https://doi.org/10.1016/j.scient.2012.02.008
Erzin Y, Cetin T (2013) The prediction of the critical factor of safety of homogeneous finite slopes using neural networks and multiple regressions. Computers & Geosciences 51:305–313. https://doi.org/10.1016/j.cageo.2012.09.003
Faris H, Hassonah MA, Al-Zoubi AM, Mirjalili S, Aljarah I (2018) A multi–verse optimizer approach for feature selection and optimizing SVM parameters based on a robust system architecture. Neural Comput & Applic 30(8):2355–2369. https://doi.org/10.1007/s00521-016-2818-2
Feng X, Li S, Yuan C, Zeng P, Sun Y (2018) Prediction of slope stability using naive bayes classifier. KSCE J Civ Eng 22(3):941–950. https://doi.org/10.1007/s12205-018-1337-3
Ferentinou M, Sakellariou M (2007) Computational intelligence tools for the prediction of slope performance. Computers and Geotechnics 34(5):362–384. https://doi.org/10.1016/j.compgeo.2007.06.004, special issue on biologically inspired and other novel computing techniques in geomechanics
Gordan B, Jahed Armaghani D, Hajihassani M, Monjezi M (2016) Prediction of seismic slope stability through combination of particle swarm optimization and neural network. Engineering with Computers 32(1):85–97. https://doi.org/10.1007/s00366-015-0400-7
Han J, Kamber M (2006) Data mining: Concepts and techniques. Data management systems, 2nd edn. Elsevier, Oxford
Hand DJ (2006) Classifier technology and the illusion of progress. Stat Sci 21(1):1–14. https://doi.org/10.1214/088342306000000060
Hastie T, Tibshirani R, Friedman J (2009) The elements of statistical learning: data mining, inference, and prediction. Springer Series in Statistics. Springer, New York. https://web.stanford.edu/hastie/Papers/ESLII.pdf
He L, Gomes AT, Broggi M, Beer M (2018) Risk analysis of infinite slope failure using advanced Bayesian networks. In: Eight international workshop on reliable engineering computing, computing with confidence. University of Liverpool, UK, p 15
van der Heijden F, Duin RPW, de Ridder D, Tax DMJ (2004) Classification, parameter estimation and state estimation: an engineering approach using MATLAB. Wiley, Chichester
Hoang ND, Bui DT (2017) Chapter 18 - slope stability evaluation using radial basis function neural network, least squares support vector machines, and extreme learning machine. In: Samui P, Sekhar S, Balas V E (eds) Handbook of neural computation. https://doi.org/10.1016/B978-0-12-811318-9.00018-1. Academic Press, New York, pp 333–344
Hoang ND, Pham AD (2016) Hybrid artificial intelligence approach based on metaheuristic and machine learning for slope stability assessment: a multinational data analysis. Expert Syst Appl 46:60–68. https://doi.org/10.1016/j.eswa.2015.10.020
Hofmann T, Scholkopf B, Smola AJ (2008) Kernel methods in machine learning. Ann Statist 36 (3):1171–1220. https://doi.org/10.1214/009053607000000677
Huang Y, Zhao L (2018) Review on landslide susceptibility mapping using support vector machines. CATENA 165:520–529. https://doi.org/10.1016/j.catena.2018.03.003
Jain AK, Duin RPW, Mao J (2000) Statistical pattern recognition: a review. IEEE Trans Pattern Anal Mach Intell 22(1):4–37. https://doi.org/10.1109/34.824819
James G, Witten D, Hastie T, Tibshirani R (2013) An introduction to statistical learning with applications in R. Springer, New York
Kang F, Xu B, Li J, Zhao S (2017) Slope stability evaluation using Gaussian processes with various covariance functions. Appl Soft Comput 60:387–396. https://doi.org/10.1016/j.asoc.2017.07.011
Koopialipoor M, Jahed Armaghani D, Hedayat A, Marto A, Gordan B (2018) Applying various hybrid intelligent systems to evaluate and predict slope stability under static and dynamic conditions. Soft Computing. https://doi.org/10.1007/s00500-018-3253-3
Kumar M, Samui P, Naithani AK (2016) Determination of stability of epimetamorphic rock slope using minimax probability machine. Geomatics, Natural Hazards and Risk 7(1):186–193. https://doi.org/10.1080/19475705.2014.883440
Lameski P, Zdravevski E, Mingov R, Kulakov A (2015) SVM parameter tuning with grid search and its impact on reduction of model over-fitting. In: Yao Y, Hu Q, Yu H, Grzymala-Busse J W (eds) Rough sets, fuzzy sets, data mining, and granular computing. Springer International Publishing, Cham, pp 464–474
Li B, Li D, Zhang Z, Yang S, Wang F (2015a) Slope stability analysis based on quantum–behaved particle swarm optimization and least squares support vector machine. Appl Math Model 39(17):5253–5264. https://doi.org/10.1016/j.apm.2015.03.032
Li DQ, Tang XS, Zhou CB, Phoon KK (2015b) Characterization of uncertainty in probabilistic model using bootstrap method and its application to reliability of piles. Appl Math Model 39(17):5310–5326. https://doi.org/10.1016/j.apm.2015.03.027
Li A, Khoo S, Lyamin A, Wang Y (2016a) Rock slope stability analyses using extreme learning neural network and terminal steepest descent algorithm. Automation in Construction 65:42–50. https://doi.org/10.1016/j.autcon.2016.02.004
Li DQ, Zheng D, Cao ZJ, Tang XS, Phoon KK (2016b) Response surface methods for slope reliability analysis: Review and comparison. Engineering Geology 203:3–14. https://doi.org/10.1016/j.enggeo.2015.09.003, Special issue on probabilistic and soft computing methods for engineering geology
Li XY, Zhang LM, Li JH (2016c) Using conditioned random field to characterize the variability of geologic profiles. J Geotech Geoenviron Eng 142(4):04015096. https://doi.org/10.1061/(ASCE)GT.1943-5606.0001428
Lin Y, Zhou K, Li J (2018) Prediction of slope stability using four supervised learning methods. IEEE Access 6:31169–31179. https://doi.org/10.1109/ACCESS.2018.2843787
Liu Z, Shao J, Xu W, Chen H, Zhang Y (2014) An extreme learning machine approach for slope stability evaluation and prediction. Nat Hazards 73(2):787–804. https://doi.org/10.1007/s11069-014-1106-7
Lu P, Rosenbaum MS (2003) Artificial neural networks and grey systems for the prediction of slope stability. Nat Hazards 30(3):383–398. https://doi.org/10.1023/B:NHAZ.0000007168.00673.27
Malkawi AIH, Hassan WF, Abdulla FA (2000) Uncertainty and reliability analysis applied to slope stability. Structural Safety 22(2):161–87. https://doi.org/10.1016/S0167-4730(00)00006-0
Mohri M, Rostamizadeh A, Talwalkar A (2018) Foundations of machine learning, 2nd edn. MIT Press, Cambridge
Pȩkalska E, Duin RP (2002) Dissimilarity representations allow for building good classifiers. Pattern Recogn Lett 23(8):943–956. https://doi.org/10.1016/S0167-8655(02)00024-7
Pȩkalska E, Paclik P, Duin RPW (2002) A generalized kernel approach to dissimilarity-based classification. J Mach Learn Res 2:175– 211
Pekalska E, Duin RPW (2008) Beyond traditional kernels: classification in two dissimilarity-based representation spaces. IEEE Trans Sys Man Cybern Part C (Applications and Reviews) 38(6):729–744. https://doi.org/10.1109/TSMCC.2008.2001687
Pham BT, Pradhan B, Bui DT, Prakash I, Dholakia M (2016) A comparative study of different machine learning methods for landslide susceptibility assessment: a case study of Uttarakhand area (India). Environmental Modelling & Software 84:240–250. https://doi.org/10.1016/j.envsoft.2016.07.005
Phoon KK, Prakoso WA, Wang Y, Ching J (2016) Reliability of geotechnical structures in ISO2394. CRC Press, EH Leiden, The Netherlands, pp 49–87. chap Uncertainty representation of geotechnical design parameters
Plasencia-Calaña Y, Orozco-Alzate M, Méndez-Vázquez H, García-Reyes E, Duin RPW (2014) Towards scalable prototype selection by genetic algorithms with fast criteria. In: Fränti P, Brown G, Loog M, Escolano F, Pelillo M (eds) Structural, syntactic, and statistical pattern recognition. Springer, Berlin, pp 343–352
Qi C, Tang X (2018a) A hybrid ensemble method for improved prediction of slope stability. Int J Numer Anal Methods Geomech 42(15):1823–1839. https://doi.org/10.1002/nag.2834
Qi C, Tang X (2018b) Slope stability prediction using integrated metaheuristic and machine learning approaches: a comparative study. Computers & Industrial Engineering 118:112–122. https://doi.org/10.1016/j.cie.2018.02.028
Rukhaiyar S, Alam MN, Samadhiya NK (2018) A PSO–ANN hybrid model for predicting factor of safety of slope. Int J Geotech Eng 12(6):556–566. https://doi.org/10.1080/19386362.2017.1305652
Sakellariou MG, Ferentinou MD (2005) A study of slope stability prediction using neural networks. Geotech Geol Eng 23(4):419. https://doi.org/10.1007/s10706-004-8680-5
Samui P (2008) Slope stability analysis: a support vector machine approach. Environ Geol 56(2):255. https://doi.org/10.1007/s00254-007-1161-4
Samui P (2013) Support vector classifier analysis of slope. Geomatics, Natural Hazards and Risk 4(1):1–12. https://doi.org/10.1080/19475705.2012.684725
Samui P, Kothari D (2011) Utilization of a least square support vector machine (LSSVM) for slope stability analysis. Scientia Iranica 18(1):53–58. https://doi.org/10.1016/j.scient.2011.03.007
Samui P, Lansivaara T, Kim D (2011) Utilization relevance vector machine for slope reliability analysis. Appl Soft Comput 11(5):4036–4040. https://doi.org/10.1016/j.asoc.2011.03.009
Steinwart I (2013) Empirical inference. Festschrift in Honor of Vladimir N. Vapnik, Springer-Verlag Berlin Heidelberg, chap Some Remarks on the Statistical Analysis of SVMs and Related Methods, pp 25–36
Wang H, Xu W, Xu R (2005) Slope stability evaluation using Back Propagation Neural Networks. Eng Geol 80(3):302–315. https://doi.org/10.1016/j.enggeo.2005.06.005
Yu HS, Salgado R, Sloan SW, Kim JM (1998) Limit analysis versus limit equilibrium for slope stability. J Geotech Geoenviron Eng 124(1):1–11. https://doi.org/10.1061/(ASCE)1090-0241(1998)124:1(1)
Zhang F, Liu Z, Zheng L, Zhang Y (2014) Development of an adaptive relevance vector machine approach for slope stability inference. Neural Comput & Applic 25(7):2025–2035. https://doi.org/10.1007/s00521-014-1690-1
Zhang Y, Dai M, Ju Z (2016) Preliminary discussion regarding SVM kernel function selection in the twofold rock slope prediction model. J Comput Civil Eng 30(3):04015031. https://doi.org/10.1061/(ASCE)CP.1943-5487.0000499
Zhao H, Yin S, Ru Z (2012) Relevance vector machine applied to slope stability analysis. Int J Numer Anal Methods Geomech 36(5):643–652. https://doi.org/10.1002/nag.1037
Zhou LY, Shan FP, Shimizu K, Imoto T, Lateh H, Peng KS (2017) A comparative study of slope failure prediction using logistic regression, support vector machine and least square support vector machine models. AIP Conference Proceedings 1870(1):060012. https://doi.org/10.1063/1.4995939
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interests
The authors declare that they have no conflict of interest.
Additional information
Communicated by: H. Babaie
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Ospina-Dávila, Y.M., Orozco-Alzate, M. Parsimonious design of pattern recognition systems for slope stability analysis. Earth Sci Inform 13, 523–536 (2020). https://doi.org/10.1007/s12145-019-00429-5
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12145-019-00429-5