Abstract
This study is concerned with the augmentation of rule-based models or fuzzy rule-based models by associating the numeric results produced by them with granular characterization in the form of prediction intervals. The role of prediction intervals encountered in regression analysis is well emphasized in the literature, especially for “monolithic” models such as linear regression or neural networks. However, there have not been comprehensive and algorithmically complete studies devoted to the conceptualization and determination of prediction intervals for rule-based models, Boolean (two-valued) and fuzzy ones. While the results generated by rule-based models are formed by aggregating partial outcomes resulting from the individual rules, the prediction intervals adhere to the same way of aggregation. In this sense, one can regard the rule-based model augmented by the associated prediction intervals as a granular rule-based model. The construction of rule-based models is, in a nutshell, the optimization process being commonly guided by the sum of squared errors (say, RMSE or alike), and the quality of the granular counterpart of the rule-based models is assessed by looking at the quality of prediction intervals and introducing the two pertinent quality measures focused on the granular nature of the obtained results, namely coverage and specificity along with their combined index. In this study, we analyze an impact of the rules and the parameters of fuzzy clustering on the quality of the numeric and granular performance of the models. A series of experimental results is presented to help quantify the performance of granular outputs (prediction intervals) constructed for rule-based models.
Similar content being viewed by others
References
Ak R, Li YF, Vitelli V, Zio E (2018) Adequacy assessment of a wind-integrated system using neural network-based interval predictions of wind power generation and load. Electr Power Energy Syst 95:213–226
Beran RJ (1992) Introduction to Efron (1979) bootstrap methods: another look at the Jackknife. Springer, New York
Box GEP, Jenkins GM, Reinsel GC (1994) Time series analysis: forecasting and control. Englewood Cliffs, Prentice-Hall
Chiang HS, Chen MY, Wu ZW (2017) Applying fuzzy petri nets for evaluating the impact of bedtime behaviors on sleep quality. Granul Comput. https://doi.org/10.1007/s41066-017-0069-y
Christoffersen PF (1998) Evaluating interval forecasts. Int Econ Rev 39:841–862
Cogan NG, Hussaini MY, Chellam S (2018) Uncertainty propagation in a model of dead-end bacterial microfiltration using fuzzy interval analysis. J Membr Sci 546:215–224
Cordón O (2011) A historical review of evolutionary learning methods for Mamdani-type fuzzy rule-based systems: designing interpretable genetic fuzzy systems. Int J Approx Reason 52:894–913
Fujita H, Gaeta A, Loia V, Orciuoli F (2018) Improving awareness in early stages of security analysis: a zone partition method based on GrC. Appl Intell. https://doi.org/10.1007/s10489-018-1315-y
Hesamian G, Shams M (2016) Parametric testing statistical hypotheses for fuzzy random variables. Soft Comput 20(4):1537–1548
Hwang JTG, Ding AA (1997) Prediction intervals for artificial neural networks. J Am Stat Assoc 92:748–757
Kerr-Wilson J, Pedrycz W (2017) Some new qualitative insights into quality of fuzzy rule-based models. Fuzzy Sets Syst 307:29–49
Khosravi A, Nahavandi S, Creighton D (2010) A prediction interval-based approach to determine optimal structures of neural network metamodels. Expert Syst Appl 37:2377–2387
Khosravi A, Nahavandi S, Creighton D, Atiya AF (2011a) Comprehensive review of neural network-based prediction intervals and new advances. IEEE Trans Neural Netw 22:1341–1356
Khosravi A, Nahavandi S, Creighton D, Atiya AF (2011b) Lower upper bound estimation method for construction of neural network-based prediction intervals. IEEE Trans Neural Netw 22:337–346
Lee YS, Scholtes S (2014) Empirical prediction intervals revisited. Int J Forecast 30:217–234
Li K, Wang R, Lei H, Zhang T, Liu Y, Zheng X (2018a) Interval prediction of solar power using an improved bootstrap method. Sol Energy 159:97–112
Li J, Yang L, Qu Y et al (2018b) An extended Takagi–Sugeno–Kang inference system (TSK+) with fuzzy interpolation and its rule base generation. Soft Comput 22(10):3155–3170
Moore RE (1966) Interval analysis. Prentice-Hall, Englewood Cliffs
Pedrycz W (2013) Granular computing: analysis and design of intelligent systems. CRC Press/Francis Taylor, Boca Raton
Pedrycz W, Lu W, Liu X et al (2014) Human-centric analysis and interpretation of time series: a perspective of granular computing. Soft Comput 18(12):2397–2411
Sandhu R, Kaur N, Sood SK et al (2018) TDRM: tensor-based data representation and mining for healthcare data in cloud computing environments. J Supercomput 74:592. https://doi.org/10.1007/s11227-017-2163-y
Seber GAF, Lee AJ (2003) Linear regression analysis, 2nd edn. Wiley, New York
Shrestha DL, Solomatine DP (2006) Machine learning approaches for estimation of prediction interval for the model output. Neural Netw 19:225–235
Tang M, Chen X, Hu W, Yu W (2012) Generation of a probabilistic fuzzy rule base by learning from examples. Inf Sci 217:21–30
Vieaux RDD, Schumi J, Schweinsberg J, Ungar LH (1998) Prediction intervals for neural networks via nonlinear regression. Technometrics 40:273–282
Wu JJ (2012) Semiparametric forecast intervals. J Forecast 31:189–228
Xu KJ, Pedrycz W, Li ZW, Nie WK (2019) High-accuracy signal subspace separation algorithm based on gaussian kernel. IEEE Trans Ind Electron 66(1):491–499
Yun SL, Scholtes S (2014) Empirical prediction intervals revisited. Int J Forecast 30:217–234
Acknowledgements
Support from the Natural Sciences and Engineering Research Council (NSERC) and Canada Research Chair (CRC) Program is gratefully acknowledged.
Funding
This study was funded by NSERC and CRC.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
All the authors have no conflict of interest.
Ethical approval
This article does not contain any studies with human participants or animals performed by any of the authors.
Additional information
Communicated by V. Loia.
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Cui, Y., Hanyu E, Pedrycz, W. et al. Augmentation of rule-based models with a granular quantification of results. Soft Comput 23, 12745–12759 (2019). https://doi.org/10.1007/s00500-019-03825-7
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00500-019-03825-7