Skip to main content

Advertisement

Log in

A robust learning algorithm based on support vector regression and robust fuzzy cerebellar model articulation controller

  • Published:
Applied Intelligence Aims and scope Submit manuscript

Abstract

For real-world applications, the obtained data are always subject to noise or outliers. The learning mechanism of cerebellar model articulation controller (CMAC), a neurological model, is to imitate the cerebellum of human being. CMAC has an attractive property of learning speed in which a small subset addressed by the input space determines output instantaneously. For fuzzy cerebellar model articulation controller (FCMAC), the concept of fuzzy is incorporated into CMAC to improve the accuracy problem. However, the distributions of errors into the addressed hypercubes may cause unacceptable learning performance for input data with noise or outliers. For robust fuzzy cerebellar model articulation controller (RFCMAC), the robust learning of M-estimator can be embedded into FCMAC to degrade noise or outliers. Meanwhile, support vector machine (SVR) is a machine learning theory based algorithm which has been applied successfully to a number of regression problems when noise or outliers exist. Unfortunately, the practical application of SVR is limited to defining a set of parameters for obtaining admirable performance by the user. In this paper, a robust learning algorithm based on support SVR and RFCMAC is proposed. The proposed algorithm has both the advantage of SVR, the ability to avoid corruption effects, and the advantage of RFCMAC, the ability to obtain attractive properties of learning performance and to increase accurate approximation. Additionally, particle swarm optimization (PSO) is applied to obtain the best parameters setting for SVR. From simulation results, it shows that the proposed algorithm outperforms other algorithms.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. Albus JS (1975) A new approach to manipulator control: the cerebellar model articulation controller (CMAC). ASME J Dyn Syst Meas Control 97(3):220–227

    MATH  Google Scholar 

  2. Albus JS (1975) Data storage in the cerebellar model articulation controller (CMAC). ASME J Dyn Syst Meas Control 97(3):228–233

    MATH  Google Scholar 

  3. Wong Y-F, Sideris A (1992) Learning convergence in the cerebellar model articulation controller. IEEE Trans Neural Netw 3(1):115–121

    Article  Google Scholar 

  4. Lane SH, Militzer J (1992) A comparison of five algorithm for the training of CMAC memories for learning control systems. Int Fed Autom Control 28(5):1027–1035

    Google Scholar 

  5. Cotter NE, Guillerm TJ (1991) The CMAC and a theorem of Kolmogorov. Neural Netw 5:221–228

    Article  Google Scholar 

  6. Lee C-Y, Lin C-J, Chen H-J (2007) A self-constructing fuzzy CMAC model and its applications. Inf Sci 177(1):264–280

    Article  MathSciNet  MATH  Google Scholar 

  7. Hu J, Pratt J, Pratt G (1999) Stable adaptive control of a bipedal walking; robot with CMAC neural networks. In: Proceedings of 1999 IEEE international conference on robotics and automation, pp 1050–1056

  8. Shelton RO, Peterson JK (1992) Controlling a truck with an adaptive critic CMAC design. Simulation 58(5):319–326

    Article  Google Scholar 

  9. Horvath G (2003) CMAC neural network as an SVM with B-Spline kernel functions. In: Proceedings IMTC 2003—instrumentation and measurement technology conference, pp 20–22

  10. Nam S-H, Oh S-Y (1999) Real-time dynamic visual tracking using PSD sensors and extended trapezoidal motion planning. Appl Intell 10(1)

  11. Hwang K-S, Lin C-S (1998) Smooth trajectory tracking of three-link robot: a self-organizing CMAC approach. IEEE Trans Syst Man Cybern Part B 28(5):680–692

    Article  Google Scholar 

  12. Iiguni Y (1996) Hierarchical image coding via cerebellar model arithmetic computers. IEEE Trans Image Process 5(10):1393–1401

    Article  Google Scholar 

  13. Su S-F, Tao T, Hung T-H (2003) Credit assigned CMAC and its application to online learning robust controllers. IEEE Trans Syst Man Cybern Part B 33(2):202–213

    Article  Google Scholar 

  14. Lee Z-J, Wang Y-P, Su S-F (2006) A genetic algorithm based robust learning credit assignment cerebellar model articulation controller. Appl Soft Comput 4(4):357–367

    Article  Google Scholar 

  15. Su S-F, Lee Z-J, Wang Y-P (2006) Robust and fast learning for fuzzy cerebellar model articulation controllers. IEEE Trans Syst Man Cybern Part B 36(1):1–6

    Article  Google Scholar 

  16. Vapnik VN (1995) The nature of statistical learning theory. Springer, New York

  17. Trafalis TB, Gilbert RC (2006) Robust classification and regression using support vector machines. Eur J Oper Res 173:893–909

    Article  MathSciNet  MATH  Google Scholar 

  18. Cherkassky V, Yunqian M (2004) Practical selection of SVM parameters and noise estimation for SVM regression. Neural Netw 17(1):113–126

    Article  MATH  Google Scholar 

  19. Jeng J-T (2006) Hybrid approach of selecting hybperparameters of support vector machine for regression. IEEE Trans Syst Man Cybern Part B 36(3):699–709

    Article  MathSciNet  Google Scholar 

  20. Üstün B, Melssen WJ, Oudenhuijzen M, Buydens LMC (2005) Determination of optimal support vector regression parameters by genetic algorithms and simplex optimization. Anal Chim Acta 544:292–305

    Article  Google Scholar 

  21. Kennedy J, Eberhart R (1995) Particle swarm optimization. In: Proceedings of IEEE international conference on neural networks, pp 1942–1948

  22. Coello CAC, Pulido GT, Lechuga MS (2004) Handling multiple objectives with particle swarm optimization. IEEE Trans Evol Comput 8(3):256–279

    Article  Google Scholar 

  23. Huang C-M, Huang C-J, Wang M-L (2005) A particle swarm optimization to identifying the ARMAX model for short-term load forecasting. IEEE Trans Power Syst 20:1126–1133

    Article  Google Scholar 

  24. Xia W, Wu Z (2005) An effective hybrid optimization approach for multi-objective flexible job-shop scheduling problems. Comput Ind Eng 48(2):409–425

    Article  MathSciNet  Google Scholar 

  25. Liang J-J, Qin AK, Suganthan PN, Baskar S (2006) Comprehensive learning particle swarm optimizer for global optimization of multimodal functions. IEEE Trans Evol Comput 10(3):281–295

    Article  Google Scholar 

  26. Holmstrom L, Koistinen P (1992) Using additive noise in back-propagation training. IEEE Trans Neural Netw 3:24–38

    Article  Google Scholar 

  27. Cichocki A, Unbehauen R (1993) Neural networks for optimization and signal processing. Wiley, New York

    MATH  Google Scholar 

  28. Lin C-S, Chiang C-T (1997) Learning convergence of CMAC Technique. IEEE Trans Neural Netw 8(6):1281–1292

    Article  Google Scholar 

  29. Chuang C-C, Su S-F, Chen S-S (2001) Robust TSK fuzzy modeling for function approximation with outliers. IEEE Trans Fuzzy Syst 9(6):810–821

    Article  Google Scholar 

  30. Connor JT, Martin RD, Atlas LE (1994) Recurrent neural networks and robust time series prediction. IEEE Trans Neural Netw 5(2):240–254

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Zne-Jung Lee.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Lee, ZJ. A robust learning algorithm based on support vector regression and robust fuzzy cerebellar model articulation controller. Appl Intell 29, 47–55 (2008). https://doi.org/10.1007/s10489-007-0080-0

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10489-007-0080-0

Keywords

Navigation