Skip to main content

Performance Enhancement of RBF Networks in Classification by Removing Outliers in the Training Phase

  • Conference paper
Modeling Decisions for Artificial Intelligence (MDAI 2007)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 4617))

  • 1538 Accesses

Abstract

During data collection and analysis there often exist outliers which affect final results. In this paper we address reducing effects of outliers in classification with Radial Basis Function (RBF) networks. A new approach called iterative RBF (iRBF) is proposed. In which training RBF networks is repeated if there exist outliers in the training set. Detection of outliers is performed by relying upon outputs of the RBF networks which correspond to applying the training set at the input units. Detected outliers have had to be eliminated before the training set is used in the next training time. In this approach we achieve a good performance in outlier rejection and classification with training sets existing outliers.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Duda, R.O., Hart, P.E., Stork, D.G.: Pattern classification. John Wiley & Sons, New York (2001)

    MATH  Google Scholar 

  2. Lu, S.-X., Wang, X.-Z.: A comparison among four SVM classification methods: LSVM, NLSVM, SSVM and NSVM. In: Proc. of 2004 Int’l on Machine Learning and Cybernetics, vol. 7, pp. 4277–4282 (2004)

    Google Scholar 

  3. Mavroforakis, M.E., Theodoridis, S.: A geometric approach to support vector machine (SVM) classification, IEEE Trans. on Neural Networks,17(3), (May 2006)

    Google Scholar 

  4. Lee, H.: Model selection for neural network classification. Journal of classification 18(2), 227–243 (2001)

    MATH  MathSciNet  Google Scholar 

  5. Kubat, M.: Decision trees can initialize radial-basis function networks. IEEE Trans. on Neural Networks 9, 813–821 (1998)

    Article  Google Scholar 

  6. Titsias, M., Likas, A.: A probabilistic RBF network for classification. In: Proc. of the IEEE-INNS-ENNS Int’l Joint Conf. on Neural Networks, vol. 4, pp. 238–243 (2000)

    Google Scholar 

  7. Chen, S., Cowan, C.F.N., Grant, P.M.: Orthogonal least squares learning algorithm for radial basis function networks. IEEE Trans. on Neural Networks 2, 302–309 (1991)

    Article  Google Scholar 

  8. Chen, S., Chng, E.S., Alkadhimi, K.: Regularized orthogonal least squares algorithm for constructing radial basis function networks. Int’l Journal of Control 64(5), 829–837 (1996)

    Article  MATH  MathSciNet  Google Scholar 

  9. Schalkoff, R.J.: Artificial Neural Networks. McGraw-Hill, New York (1997)

    MATH  Google Scholar 

  10. Barnett, V., Lewis, T.: Outliers in Statistical Data, 3rd edn. John Wiley, New York (1994)

    MATH  Google Scholar 

  11. Knorr, E.M., Ng, R.T.: Finding Intensional Knowledge of Distance-based Outliers. In: Proc. 25th Int’l Conference on very large Data Bases, Edinburgh, Scotland, pp. 211–222 (1999)

    Google Scholar 

  12. Jiang, S.-Y., Li, Q.-h., Li, K.-l., Wang, H., Meng, Z.-l.: GLOF: A New Approach for Mining Local Outlier. In: Proc. of the 2nd Int’l Conference on Machine Learning and Cybernetics, pp. 157–162 (November 2003)

    Google Scholar 

  13. Lu, X., Li, Y., Zhang, X.: A simple strategy for detecting outlier samples in microarray data. In: The 8th Int’l Conference on Control, Automation, Robotics and Vision Kunming pp. 1331–1335 (December 2004)

    Google Scholar 

  14. Lu, C.-T., Chen, D., Kou, Y.: Algorithms for Spatial Outliers Detection. In: Proc. of the Third IEEE Int’l Conference on Data Mining (ICDM03) (2003)

    Google Scholar 

  15. Amidan, B.G., Ferryman, T.A., Cooley, S.K.: Data Outlier Detection using the Chebyshev Theorem, Aerospace, 2005. In: IEEE Conference, March 2005, pp. 1–6 (2005)

    Google Scholar 

  16. Liu, J., Gader, P.: Outlier Rejection with MLPs and Variants of RBF Networks. In: Proc. 15th Int’l Conference on Pattern Recognition, vol. 2, pp. 680–683 (2000)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Vicenç Torra Yasuo Narukawa Yuji Yoshida

Rights and permissions

Reprints and permissions

Copyright information

© 2007 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Huynh, H.T., Vo, N.H., Hoang, MT.T., Won, Y. (2007). Performance Enhancement of RBF Networks in Classification by Removing Outliers in the Training Phase. In: Torra, V., Narukawa, Y., Yoshida, Y. (eds) Modeling Decisions for Artificial Intelligence. MDAI 2007. Lecture Notes in Computer Science(), vol 4617. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-73729-2_32

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-73729-2_32

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-73728-5

  • Online ISBN: 978-3-540-73729-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics