Skip to main content

Novelty Detection Using a New Group Outlier Factor

  • Conference paper
  • 3284 Accesses

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 7665))

Abstract

We present in this paper a new measure named GOF (Group Outlier Factor) for cluster outliers and novelty detection. The main difference between GOF and existing methods is that being an outlier is not associated to a single pattern but to a cluster. GOF is based on relative density of each group of data and provides a quantitative indicator of outlier-ness which enables to detect automatically ”cluster outliers”. To learn GOF measure, we integrate it in a clustering process using Self-organizing Map. Experimental results and comparison studies show that the use of GOF sensibly improves the results in term of cluster-outlier detection and novelty detection.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Markou, M., Singh, S.: Novelty detection: a review part 1: statistical approaches. Signal Process. 83, 2481–2497 (2003)

    Article  MATH  Google Scholar 

  2. Angiulli, F., Ben-Eliyahu-Zohary, R., Palopoli, L.: Tractable strong outlier identification. CoRR abs/1109.4623 (2011)

    Google Scholar 

  3. Su, X., Tsai, C.L.: Outlier detection. Wiley Interdisc. Rew.: Data Mining and Knowledge Discovery 1(3), 261–268 (2011)

    Article  Google Scholar 

  4. Breunig, M., Kriege, H., Ng, R., Sander, J.: Lof: Identifying density-based local outliers. In: ACM SIGMOD 2000 International Congerence on Management of Data (2000)

    Google Scholar 

  5. Hasan, M.A., Chaoji, V., Salem, S., Zaki, M.J.: Robust partitional clustering by outlier and density insensitive seeding. Pattern Recogn. Lett. 30, 994–1002 (2009)

    Article  Google Scholar 

  6. Kohonen, T., Schroeder, M.R., Huang, T.S. (eds.): Self-Organizing Maps, 3rd edn. Springer-Verlag New York, Inc., Secaucus (2001)

    MATH  Google Scholar 

  7. Markou, M., Singh, S.: Novelty detection: a review part 2: neural network based approaches. Signal Process. 83, 2499–2521 (2003)

    Article  MATH  Google Scholar 

  8. Hansen, L.K., Liisberg, C., Salamon, P.: The error-reject tradeoff. Open Systems and Information Dynamics 4, 159–184 (1995)

    Article  Google Scholar 

  9. Duda, R., Hart, P., Stork, D.: Pattern Classification. Wiley (2001)

    Google Scholar 

  10. Hoffmann, H.: Kernel pca for novelty detection. Pattern Recognition 40 (2007)

    Google Scholar 

  11. Vapnik, V.N.: The nature of statistical learning theory. Springer, New York (1995)

    MATH  Google Scholar 

  12. Schölkopf, B., Platt, J.C., Shawe-Taylor, J.C., Smola, A.J., Williamson, R.C.: Estimating the support of a high-dimensional distribution. Neural Comput. 13(7), 1443–1471 (2001)

    Article  MATH  Google Scholar 

  13. Cai, Q., He, H., Man, H.: Somso: A self-organizing map appoach for spacial outlier detection with multiple attributes. In: Proccedings of IJCNN 2009, pp. 425–431 (2009)

    Google Scholar 

  14. Cai, Q., He, H., Man, H., Qiu, J.: Iterativesomso: An iterative self-organizing map for spatial outlier detection. In: Proccedings of IJCNN 2010, pp. 325–330 (2010)

    Google Scholar 

  15. Gao, J., Hu, W., Li, W., Zhang, Z.: Local outlier detection based on kernel regression. In: International Conference on Pattern Recognition (2010)

    Google Scholar 

  16. Frank, A., Asuncion, A.: Uci machine learning repository. Technical report, University of California, Irvine, School of Information and Computer Sciences (2010)

    Google Scholar 

  17. Moya, M.M., Hush, D.R.: Network constraints and multi-objective optimization for one-class classification. Neural Netw. 9, 463–474 (1996)

    Article  Google Scholar 

  18. Fawcett, T.: An introduction to roc analysis. Pattern Recognition Letters 27(8), 861–874 (2006)

    Article  MathSciNet  Google Scholar 

  19. Yeung, D.Y., Chow, C.: Parzen-window network intrusion detectors. In: Proceedings of the Sixteenth International Conference on Pattern Recognition, pp. 385–388 (2002)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2012 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Chaibi, A., Lebbah, M., Azzag, H. (2012). Novelty Detection Using a New Group Outlier Factor. In: Huang, T., Zeng, Z., Li, C., Leung, C.S. (eds) Neural Information Processing. ICONIP 2012. Lecture Notes in Computer Science, vol 7665. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-34487-9_45

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-34487-9_45

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-34486-2

  • Online ISBN: 978-3-642-34487-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics