Skip to main content

Combining MLP and RBF Neural Networks for Novelty Detection in Short Time Series

  • Conference paper

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 2972))

Abstract

Novelty detection in time series is an important problem with application in different domains such as machine failure detection, fraud detection and auditing. In many problems, the occurrence of short length time series is a frequent characteristic. In previous works we have proposed a novelty detection approach for short time series that uses RBF neural networks to classify time series windows as normal or novelty. Additionally, both normal and novelty random patterns are added to training sets to improve classification performance. In this work we consider the use of MLP networks as classifiers. Next, we analyze (a) the impact of validation and training sets generation, and (b) of the training method. We have carried out a number of experiments using four real-world time series, whose results have shown that under a good selection of these alternatives, MLPs perform better than RBFs. Finally, we discuss the use of MLP and MLP/RBF committee machines in conjunction with our previous method. Experimental results shows that these committee classifiers outperform single MLP and RBF classifiers.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Berthold, M.R.: A time delay radial basis function network for phoneme recognition. In: Proc. of the IEEE International Conference on Neural Networks, vol. 7, pp. 4470–4473 (1994)

    Google Scholar 

  2. Berthold, M.R., Diamond, J.: Boosting the performance of RBF networks with dynamic decay adjustment. In: Tesauro, G., Touretzky, D., Alspector, J. (eds.) Advances in Neural Information Processing, vol. 7 (1995)

    Google Scholar 

  3. Chatfield, C.: The Analysis of Time Series – An Introduction, 4th edn. Chapman & Hall, Boca Raton (1989)

    MATH  Google Scholar 

  4. Zell, A., et al.: SNNS - Stuttgart Neural Network Simulator, User Manual, Version 4.2. University of Stuttgart and University of Tubingen

    Google Scholar 

  5. Gonzalez, F., Dasgupta, D., Kozma, R.: Combining negative selection and classification techniques for anomaly detection. In: Proc. of the Congress on Evolutionary Computing (2002)

    Google Scholar 

  6. Haykin, S.: Neural Networks: A Comprehensive Foundation, 2nd edn. Prentice Hall, Englewood Cliffs (1998)

    Google Scholar 

  7. Keogh, E., Lonardi, S., Chiu, W.: Finding surprising patterns in a time series database in linear time and space. In: Proc. ACM Knowledge Discovery and Data Mining - SIGKDD 2002, pp. 550–556 (2002)

    Google Scholar 

  8. Koskivaara, E.: Artificial neural network models for predicting patterns in auditing monthly balances. Journal of Operational Research Society 51(9), 1060–1069 (2000)

    MATH  Google Scholar 

  9. Oliveira, L.I., Azevedo, G., Barros, A., Santos, A.L.M.: A neural network based system for payroll audit support. In: Proceeding of the IV Brazilian National Artificial Intelligence Meeting (2003) (in portuguese)

    Google Scholar 

  10. Oliveira, L.I., Neto, F.B.L., Meira, S.R.L.: Novelty detection for short time series with neural networks. In: Abraham, A., Köppen, M., Franke, K. (eds.) Design and Application of Hybrid Intelligent Systems. Frontiers in Artificial Intelligence and Applications, vol. 104, IOS Press, Amsterdam (2003)

    Google Scholar 

  11. Prechelt, L.: Proben1 – a set of neural networks benchmark problems and benchmarking rules. Technical Report 21/94, Universität Karlsruhe, Germany (1994)

    Google Scholar 

  12. Riedmiller, M., Braun, H.: A direct adaptive method for faster backpropagation learning: The RPROP algorithm. In: Proceedings of the IEEE International Conference on Neural Networks, ICNN 1993 (1993)

    Google Scholar 

  13. Shahabi, C., Tian, X., Zhao, W.: TSA-tree: A wavelet-based approach to improve the efficiency of multi-level surprise and trend queries on time-series data. In: Proc. of 12th International Conference on Scientific and Statistical Database Management (2000)

    Google Scholar 

  14. Singh, S., Markou, M.: An approach to novelty detection applied to the classification of image regions. IEEE Transactions on Knowledge and Data Engineering 15 (2003)

    Google Scholar 

  15. Yao, J., Tan, C.L.: A case study on using neural networks to perform technical forecasting of forex. Neurocomputing (34), 79–98 (2000)

    Article  MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2004 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Oliveira, A.L.I., Neto, F.B.L., Meira, S.R.L. (2004). Combining MLP and RBF Neural Networks for Novelty Detection in Short Time Series. In: Monroy, R., Arroyo-Figueroa, G., Sucar, L.E., Sossa, H. (eds) MICAI 2004: Advances in Artificial Intelligence. MICAI 2004. Lecture Notes in Computer Science(), vol 2972. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-24694-7_87

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-24694-7_87

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-21459-5

  • Online ISBN: 978-3-540-24694-7

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics