Abstract
Although the Wang–Mendel (WM) method, a typical way of fuzzy modeling, can rapidly obtain fuzzy rules from data to construct fuzzy systems with good interpretability, its accuracy is not high. In the literatures, many optimization approaches are proposed to improve the accuracy of the WM method, but the optimization process is in general time-consuming. A shallow or single fuzzy system cannot deal with “the curse of dimensionality”, which makes it challenging to realize modeling of high-dimensional data. Inspired by deep neural networks, building deep fuzzy systems (DFS) through many shallow fuzzy systems will become a new direction of fuzzy modeling for high-dimensional data modeling. As a building block in DFS, each shallow fuzzy system should have the characteristics of high precision and fast training speed to ensure the operating efficiency of DFS. This paper proposes a Fast Learning-algorithm with Optimized Weights for Fuzzy Systems (FLOWFS) in the following three steps: (1) Obtain a basic fuzzy system with full rules through fast training; (2) Assign each fuzzy rule a weight starting with 1; (3) Develop a fast learning-algorithm optimal weights via the least square method and coefficient regularization. Aiming at the regression problems, FLOWFS is compared with the back propagation neural network (BP), radial basis function neural network (RBF), the WM method and long short-term memory (LSTM) on three classic datasets of UCI. The experimental results show that: (1) FLOWFS has achieved a higher prediction accuracy; (2) Compared with the WM method, FLOWFS not only has greater accuracy, but also is faster in training; (3) In terms of comprehensive indicators of accuracy and running-time, FLOWFS has the best performance. Therefore, FLOWFS can provide good fuzzy building blocks for DFS to enable fast modeling of high-dimensional data and achieve good interpretability and high accuracy.
Similar content being viewed by others
References
Zadeh, L.A.: Fuzzy sets. Inform. Control 8(3), 338–353 (1965)
Kosko, B.: Fuzzy systems as universal approximators. IEEE Trans. Comput. 43(11), 1329–1333 (1994)
Cheng, K.H., Hsu, C.F., Lin, C.M.: Fuzzy-neural sliding-mode control for DC–DC converters using asymmetric Gaussian membership functions. IEEE Trans. Indust. Electron. 54(3), 1528–1536 (2017)
Chakraborty, A., Konar, A., Chakraborty, U.K., Chatterjee, A.: Emotion recognition from facial expressions and its control using fuzzy logic. IEEE Trans. Syst. Man Cybern. Part A 39(4), 726–743 (2019)
Tsipouras, M.G., Exarchos, T.P., Fotiadis, D.I., et al.: Automated diagnosis of coronary artery disease based on data mining and fuzzy modeling. IEEE Trans. Inform. Technol. Biomed. 12(4), 447–58 (2018)
Huarng, K.H., Yu, H.K., Hsu, Y.W.: A multivariate heuristic model for fuzzy time-series forecasting. IEEE Trans. Syst. Man Cybern. 37(4), 836 (2007)
Niknam, T., Mojarrad, H.D., Nayeripour, M.: A new fuzzy adaptive particle swarm optimization for non-smooth economic dispatch. Energy 35(4), 1764–1778 (2010)
Pena-Reyes, C.A., Sipper, M.: Combining evolutionary and fuzzy techniques in medical diagnosis. Physica Verlag HD 96, 391–426 (2002)
Joelianto, E., Widiyantoro, S., Ichsan, M.: Time series estimation on earthquake events using ANFIS with mapping function. Int. J. Artif. Intell. 3(9), 37–63 (2009)
Majumdar, K.K., Majumder, D.D.: Fuzzy knowledge-based and model-based systems. J. Intell. Fuzzy Syst. 18(4), 391–403 (2007)
Wang, L.X., Mendel, J.M.: Generating fuzzy rules by learning from examples. IEEE Trans. Syst. Man Cybern. 22(6), 1414–1427 (2002)
Yang, X., Yuan, J., Yuan, J., et al.: An improved WM method based on PSO for electric load forecasting. Expert Syst. Appl. Int. J. 37(12), 8036–8041 (2010)
Wang, Y., Duan, X., Liu, X., et al.: Semantic description method for face features of larger Chinese ethnic groups based on improved WM method. Neurocomputing 175, 515–528 (2016)
Gou, J., Hou, F., Chen, W., et al.: Improving Wang-Mendel method performance in fuzzy rules generation using the fuzzy C-means clustering algorithm. Neurocomputing 151, 1293–1304 (2015)
Fan, Z., Wang, C.: An improved Wang–Mendel method based on the FSFDP clustering algorithm and sample correlation. J. Intell. Fuzzy Syst. 31(6), 2839–2850 (2016)
Chang, C.W., Tao, C.W.: A simplified implementation of hierarchical fuzzy systems. Soft Comput. 23(12), 4471–4481 (2019)
Wang, L.X.: Fast training algorithms for deep convolutional fuzzy systems with application to stock index prediction. IEEE Trans. Syst. 28(7), 1301–1314 (2020)
Zhang, J., Deng, Z., Choi, K.S., et al.: Data-driven elastic fuzzy logic system modeling: constructing a concise system with human-like inference mechanism. IEEE Trans. Fuzzy Syst. 26(4), 2160–2173 (2018)
Aghaeipoor, F., Javidi, M.M.: MOKBL+MOMs: an interpretable multi-objective evolutionary fuzzy system for learning high-dimensional regression data. Inform. Sci. 496, 1–24 (2019)
Rhode, S., Usevich, K., Markovsky, I., et al.: A recursive restricted total least-squares algorithm. IEEE Trans. Signal Process. 62(21), 5652–5662 (2014)
Hecht-Nielsen, R.: Theory of the Backpropagation Neural Network. Neural Networks for Perception, pp. 65–93. Academic Press, Cambridge (1992)
Vt, S.E., Shin, Y.C.: Radial basis function neural network for approximation and estimation of nonlinear stochastic dynamic systems. IEEE Trans. Neural Netw. 5(4), 594–603 (1994)
Wang, L.X.: The WM method completed: a flexible fuzzy system approach to data mining. IEEE Trans. Fuzzy Syst. 11(6), 768–782 (2003)
Le, X.H., Ho, H.V., Lee, G., et al.: Application of long short-term memory (LSTM) neural network for flood forecasting. Water 11(7), 1387 (2019)
Huang, Y., Chen, D., Zhao, W., et al.: Deep fuzzy system algorithms based on deep learning and input sharing for regression application. Int. J. Fuzzy Syst. 23(3), 727–742 (2021)
Acknowledgements
Open Project Support of State Key Laboratory for Management and Control of Complex Systems (20210116). The authors would like to thank the anonymous referees for their invaluable insights, and the research work was jointly by grants from the National Natural Science Foundation of China (No. 61976055); Special fund for education and scientific research of Fujian Provincial Department of Finance (GY-Z21001).
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Chen, D., Tong, W., Huang, Y. et al. FLOWFS: Fast Learning-algorithm with Optimal Weights for Fuzzy Systems. Int. J. Fuzzy Syst. 24, 3162–3173 (2022). https://doi.org/10.1007/s40815-022-01329-5
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s40815-022-01329-5