Abstract
A systematic classification of the data-driven approaches for design of fuzzy systems is given in the paper. The possible ways to solve this modelling and identification problem are classified on the basis of the optimisation techniques used for this purpose. One algorithm for each of the two basic categories of design methods is presented and its advantages and disadvantages are discussed. Both types of algorithms are self-learning and do not require interaction during the process of fuzzy model design. They perform adaptation of both the fuzzy model structure (rule-base) and the parameters. The indirect approach exploits the dual nature of Takagi-Sugeno (TS) models and is based on recently introduced recursive clustering combined with Kalman filtering-based procedure for recursive estimation of the parameter of the local sub-models. Both algorithms result in finding compact and transparent fuzzy models. The direct approach solves the optimisation problem directly, while the indirect one decomposes the original problem into on-line clustering and recursive estimation problems and finds a sub-optimal solution in real-time. The later one is computationally very efficient and has a range of potential applications in real-time process control, moving images recognition, autonomous systems design etc. It is extended in this paper for the case of multi-input–multi-output (MIMO systems). Both approaches have been tested with real data from an engineering process.
Similar content being viewed by others
References
Andreas G-S. (1995) Fuzzy rule-based expert systems and genetic machine learning. Physica Verlag, Heidelberg
Angelov PP (2002) Evolving rule-based models: a tool for design of flexible adaptive systems. Springer, Berlin Heidelberg, New York
Angelov PP, Buswell RA (2002) Identification of evolving fuzzy rule-based models. IEEE Trans Fuzzy Syst 5(10):667–677
Angelov P, Buswell R (2003) Automatic generation of fuzzy rule-based models from data by genetic algorithms. Inform Sci 150(1/2):17–31
Angelov PP, Filev DP (2004) An approach to on-line identification of Takagi-Sugeno fuzzy models. IEEE Trans Syst Man Cybern B 34(1):484–498
Astroem KJ, Wittenmark B (1989) Adaptive control. Addison Wesley, Massachusetts USA
Bastian A (1996) A genetic algorithm for tuning membership functions. In: Proceedings of the 4th European congress on fuzzy and intelligent technologies EUFIT’96, Aachen, Germany 1:494–498
Chiang CK, Chung H-Y, Lin JJ (1996) A self-learning fuzzy logic controller using genetic algorithms with reinforcements. IEEE Trans Fuzzy Syst 5:460–467
Cios KJ, Pedricz W, Swinarski RW (1998) Data mining methods for knowledge discovery. Kluwer, Boston, USA
Chiu SL (1994) Fuzzy model identification based on cluster estimation. J Intell Fuzzy Syst 2:267–278
Cordon O, del Jesus MJ, Herrera F, Magdalena L, Villar P. (2003) A multiobjective genetic learning process for joint feature selection and granularity and contexts learning in Fuzzy rule-based classification systems. In: Casillas J, Cordón O, Herrera F, Magdalena L, (ed). Interpretability issues in fuzzy modeling, studies in fuziness and soft computing 128. Physica Verlag, Heidelberg, Germany
Deng D, Kasabov N (2000) Evolving self-organizing maps for on-line learning, data analysis and modeling. In: Amari S-I, Giles CL, Gori M, Piuri V. (ed) Proceedings of IJCNN’2000 neural networks, neural computing: new challenges perspectives new millennium VI: 3–8. New York, USA
Duda RO, Hart P, Stork DG (2001) Pattern classification, 2nd edn. Wiley, New York, USA
Filev DP, Larsson T, Ma L (2000) Intelligent control for automotive manufacturing-rule based guided adaptation. In: Proceedings of the IEEE Conference IECON-2000, Nagoya, Japan, 283–288 October 2000
Filev DP (2001) Rule-base guided adaptation for mode detection in process control. In: Proceedings of the joint 9th IFSA World Congress/20th NAFIPS Annual Conference, Vancouver, BC, Canada, pp 1068–1073
Gustafson DE, Kessel WC (1979) Fuzzy clustering with a fuzzy covariance matrix. In: Prococeedings of the IEEE Control and Decision Conference, San Diego, USA, pp 761–766
Hoffmann F, Pfister G (1996) Learning of a fuzzy control rule base using messy genetic algorithms. In: Herrera F, Verdegay JL (eds) Stud Fuzziness Soft Comput 8:279–305
Hornik K (1991) Approximation capabilities of multilayer feedforward network. Neural Netw 4:251–257
Kasabov NK, Song Q (2002) DENFIS: Dynamic evolving neural-fuzzy inference system and its application for time-series prediction. IEEE Trans Fuzzy Syst 10(2):144–154
Kasabov N (1998) Evolving fuzzy neural networks - algorithms, applications and biological motivation. In: Yamakawa T, Matsumoto G. (ed). Methodologies for the conception, design and application of soft computing. World Scientific, Singapore, pp 271–274
Jang J-SR, Sun C-T, Mizutani E (1997) Neuro-fuzzy and soft computing: a computational approach to learning and machine intelligence. Prentice Hall, Upper Sadle River, USA
Lim MH, Rahardja S, Gwee BH (1996) A GA paradigm for learning fuzzy rules. Fuzzy Sets Syst 82:177–186
Lin, F-J, Lin C-H, Shen P-H (2001) Self-constructing fuzzy neural network speed controller for permanent-magnet synchronous motor drive. IEEE Trans Fuzzy Syst 9(5):751–759
Ljung L (1987) System identification. Theory for the user. Prentice Hall, NJ
Michalewicz Z (1996) Genetic algorithms+data structures = evolution programs. Springer, Berlin Heidelberg, New York
Nelles O (1996) FUREGA – Fuzzy rule extraction by GA, In: Proceedings of the 4th European congress on fuzzy and intelligent technologies EUFIT’96, Aachen, Germany, 1:489–493
Nozaki K, Morisawa T, Ishibuchi H (1995) Adjusting membership functions in fuzzy rule-based classification systems. In: Proceedings of the 3rd European congress on fuzzy and intelligent technologies, EUFIT’95, Aachen, Germany, 1:615–619
Johanson TA, Murray-Smith R (1997) Operating regime approach to non-linear modeling and control. In: Murray-Smith R, Johanson TA. (ed). Multiple model approaches to modeling and control. Taylor Francis, UK, pp 3–72
Pereira C, Dourado A (2002) Intelligent control of a solar power plant using support vector machines. In: Proceedings of the 2nd EUNITE Symposium, Albufeira, Portugal, pp 657–663
Setnes M, Roubos JA (1999) Transparent fuzzy modelling using clustering and GA’s. In: Proceedings of the NAFIPS Conference, New York, USA, pp 198–202
Shimojima K, Fukuda T, Hasegawa Y (1995) Self-tuning fuzzy modeling with adaptive membership function, rules, and hierarchical structure based on genetic algorithm. Fuzzy Sets Syst 71:295–309
Specht D. (1991) A general regression neural network. IEEE Trans Neural Netw 2(6):568–576
Sugeno M, Yasukawa T (1993) A fuzzy logic based approach to qualitative modelling. IEEE Trans Fuzzy Syst 1(1):7–31
Takagi T, Sugeno M (1985) Fuzzy identification of systems and its application to modeling and control. IEEE Trans SMC, B 15:116–132
Valente de Olivieira J (1999) Semantic constraints for membership function optimisation. IEEE Trans Fuzzy Syst 19:128–138
Wang L-X (1992) Fuzzy systems are universal approximators. In: Proceedings of the international conference on fuzzy systems, San Diego, CA, USA, pp 1163–1170
Yager RR, Filev DP (1993) Learning of fuzzy rules by mountain clustering. In: Proceedings of SPIE conference on application of fuzzy logic technology. Boston, USA, pp 246–254
Yager R, Filev D (1994) Essentials of fuzzy modeling and control. Willey, NY USA
Yen J, Wang L, Gillespie CW (1998) Improving the interpretability of TSK fuzzy models by combining global and local learning. IEEE Trans Fuzzy Syst 6:530–537
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Angelov, P., Xydeas, C. Fuzzy systems design: direct and indirect approaches. Soft Comput 10, 836–849 (2006). https://doi.org/10.1007/s00500-005-0006-x
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00500-005-0006-x