Skip to main content

Visual and Dynamic Change Detection for Data Streams

  • Conference paper
  • First Online:
Neural Information Processing (ICONIP 2015)

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 9491))

Included in the following conference series:

  • 2665 Accesses

Abstract

We propose in this paper a new approach to detect and visualize the change in a streaming clustering. This approach can be used to explore visually the data streams. We assume that the data stream structure can be different during the time. Our objective is to alert the user on the structure change during the time period. A common approach to deal with data streams is to observe and process it in a window. The principle of the proposed approach is to apply a data exploration method on each window. We then propose to visualize the change between all windows for each extracted cluster. The user can investigate more precisely the change between the two windows through a visual projection for each extracted cluster.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Adams, R., MacKay, D.: Bayesian online changepoint detection. Technical report, University of Cambridge (2007)

    Google Scholar 

  2. Aggarwal, C.C., Watson, T.J., Ctr, R., Han, J., Wang, J., Yu, P.S.: A framework for clustering evolving data streams. In: VLDB, pp. 81–92 (2003)

    Google Scholar 

  3. Aizen, J., Huttenlocher, D., Kleinberg, J., Novak, A.: Traffic-based feedback on the web. Proc. Natl. Acad.Sci. 101(Suppl. 1), 5254–5260 (2004)

    Article  Google Scholar 

  4. Anderson, N.H., Hall, P., Titterington, D.M.: Two-sample test statistics for measuring discrepancies between two multivariate probability density functions using kernel-based density estimates. J. Multivar. Anal. 50(1), 41–54 (1994)

    Article  MathSciNet  MATH  Google Scholar 

  5. Bifet, A., Gavalda, R.: Learning from time-changing data with adaptive windowing. In: Seventh SIAM International Conference Data Mining, pp. 443–448 (2007)

    Google Scholar 

  6. Bifet, A., Holmes, G., Pfahringer, B., Kranen, P., Kremer, H., Jansen, T., Seidl, T.: Moa: massive online analysis, a framework for stream classification and clustering. In: WAPA, pp. 44–50 (2010)

    Google Scholar 

  7. Blake, C., Merz, C.: UCI repository of machine learning databses. Technical report, University of California, Irvine, Department of Information and Computer Sciences (1998). http://archive.ics.uci.edu/ml/datasets.html. Accessed January 2014

  8. Bondu, A., Boulle, M.: A supervised approach for change detection in data streams. In: The 2011 International Joint Conference on Neural Networks (IJCNN), pp. 519–526 (2011)

    Google Scholar 

  9. Boudjeloud-Assala, L., Blansché, A.: Iterative evolutionary subspace clustering. In: International Conference on Neural Information Processing, vol. 1, pp. 424–431 (2012)

    Google Scholar 

  10. Wemmert, C., Gançarski, P., Korczak, J.: A collaborative approach to combine multiple learning methods. Int. J. Artif. Intell. Tools 9(1), 59–78 (2000)

    Article  Google Scholar 

  11. Dries, A., Rückert, U.: Adaptive concept drift detection. Stat. Anal. Data Min. 2(5–6), 311–327 (2009)

    Article  MathSciNet  Google Scholar 

  12. Gama, J., Medas, P., Castillo, G., Rodrigues, P.: Learning with drift detection. In: Bazzan, A.L.C., Labidi, S. (eds.) SBIA 2004. LNCS (LNAI), vol. 3171, pp. 286–295. Springer, Heidelberg (2004)

    Chapter  Google Scholar 

  13. Golab, L., Özsu, M.T.: Issues in data stream management. SIGMOD Rec. 32(2), 5–14 (2003)

    Article  Google Scholar 

  14. Hall, P.: Permutation tests for equality of distributions in high-dimensional settings. Biometrika 89(2), 359–374 (2002)

    Article  MathSciNet  MATH  Google Scholar 

  15. Kifer, D., Ben-David, S., Gehrke, J.: Detecting change in data streams. In: Endowment, V. (ed.) Proceedings of the Thirtieth International Conference on Very Large Data Bases, vol. 30, p. 191 (2004)

    Google Scholar 

  16. Kranen, P., Kremer, H., Jansen, T., Seidl, T., Bifet, A., Holmes, G., Pfahringer, B.: Clustering performance on evolving data streams: assessing algorithms and evaluation measures within MOA. In: ICDM Workshops, pp. 1400–1403 (2010)

    Google Scholar 

  17. Street, W.N., Kim, Y.: A streaming ensemble algorithm SEA for large-scale classification. ACM Press, pp. 377–382 (2001). http://www.liaad.up.pt/kdus/products/datasets-for-concept-drift Accessed April 2014

  18. Tran, D.H.: Change detection in streaming mining. Ph.D. thesis, Faculty of computer science and automation, Ilmenau University of Technology (2013)

    Google Scholar 

  19. van der Maaten, L., Hinton, G.: Visualizing high-dimensional data using t-SNE. J. Mach. Learn. Res. 9, 2579–2605 (2008). Nov

    MATH  Google Scholar 

  20. Vlachos, M., Wu, K.-L., Chen, S.-K., Yu, P.S.: Fast burst correlation of financial data. In: Jorge, A.M., Torgo, L., Brazdil, P.B., Camacho, R., Gama, J. (eds.) PKDD 2005. LNCS (LNAI), vol. 3721, pp. 368–379. Springer, Heidelberg (2005)

    Chapter  Google Scholar 

  21. Wei, C.-P., Chang, Y.-H.: Discovering event evolution patterns from document sequences. IEEE Trans. Syst. Man Cybern. A Syst. Hum. 37(2), 273–283 (2007)

    Article  MathSciNet  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Lydia Boudjeloud-Assala .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2015 Springer International Publishing Switzerland

About this paper

Cite this paper

Boudjeloud-Assala, L., Pinheiro, P., Blansché, A., Tamisier, T., Otjaques, B. (2015). Visual and Dynamic Change Detection for Data Streams. In: Arik, S., Huang, T., Lai, W., Liu, Q. (eds) Neural Information Processing. ICONIP 2015. Lecture Notes in Computer Science(), vol 9491. Springer, Cham. https://doi.org/10.1007/978-3-319-26555-1_45

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-26555-1_45

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-26554-4

  • Online ISBN: 978-3-319-26555-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics