Skip to main content
Log in

A graphical method for detection of Flash Crowds in traffic

  • Published:
Telecommunication Systems Aims and scope Submit manuscript

Abstract

Majority of traffic analysis tools today are based on NetFlow technology including its more recent successor, IPFIX protocol. Even with the flexibility of IPFIX in mind, processing traffic in realtime is still difficult. Given the urgent need for lightweight methods in the area, this paper is crossing inter-disciplinary borders to find a solution. Specifically, this paper looks into a possibility of applying video compression to 2D visualization of traffic in search for anomalies. The proposed method is applied to detection of Flash Crowds in traffic and is found successful when compared to other methods.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others

References

  1. Abrahao, B., & Kleinberg, R. (2008). On the Internet delay space dimensionality. In Proc. of 8th ACM SIGCOMM conference on Internet measurement (pp. 157–168).

    Chapter  Google Scholar 

  2. Baccelli, F., Machiraju, S., Veitch, D., & Bolot, J. (2009). The role of PASTA in network measurement. In: Proc. of IEEE/ACM Transactions on Networking, vol. 17(4), pp. 1340–1353.

    Google Scholar 

  3. Choi, B., & Zhang, Z. (2006). Adaptive random sampling for traffic volume measurement. Telecommunications Systems, 34, 71–80.

    Article  Google Scholar 

  4. Jung, J., Krishnamurthy, B., & Rabinovich, M. (2002). Flash crowds and denial of service attacks: characterization and implications for CDNs and web sites. In Proc. of WWW conference, Hawaii, USA (pp. 532–569).

    Google Scholar 

  5. Lakhina, A., Crovella, M., & Diot, C. (2004). Characterization of network-wide anomalies in traffic flows. In Proc. of Internet measurement conference, Italy (pp. 201–206).

    Google Scholar 

  6. Lakhina, A., Crovella, M., & Diot, C. (2004). Diagnosing network-wide traffic anomalies. In Proc. of ACM SIGCOMM computer communication review (Vol. 34(4), pp. 219–230).

    Google Scholar 

  7. Rekhter, Y., Moskowitz, B., Karrenberg, D., de Groot, G. J., & Lear, E. (1918). Address allocation for private Internets. RFC 1918.

  8. Rocha, E., Salvador, P., & Nogueira, A. (2010). Can multiscale traffic analysis be used to differentiate Internet applications? Telecommunications Systems, 48, 19–30.

    Article  Google Scholar 

  9. Soule, A., Salamatian, K., & Taft, N. (2005). Combining filtering and statistical methods for anomaly detection. In Proc. of Internet measurement conference (IMC) (pp. 331–344).

    Google Scholar 

  10. Susitaival, R., Juva, I., Peuhkuri, M., & Aalto, S. (2006). Characteristics of origin-destination pair traffic in Funet. Telecommunications Systems, 33, 67–88.

    Article  Google Scholar 

  11. Wamser, F., Pries, R., Staehle, D., Heck, K., & Tran-Gia, P. (2010). Traffic characterization of a residential wireless Internet access. Telecommunications Systems, 48, 5–17.

    Article  Google Scholar 

  12. Zadnik, M., Pecenka, T., & Korenek, J. (2005). NetFlow probe intended for high-speed networks. In Proc. of international conference on field programmable logic and applications (pp. 695–698).

    Google Scholar 

  13. Zhanikeev, M., & Tanaka, Y. (2009). Lightweight traffic monitoring and analysis using video compression techniques. In Lecture notes in computer science: Vol. 5787. Proc. of managements enabling the future Internet for changing business and new computing services (pp. 92–101). Berlin: Springer.

    Chapter  Google Scholar 

  14. IPv4 address report. Available at. http://www.potaroo.net/tools/ipv4/.

  15. IPv4 WHOIS Map. Available at: http://www.caida.org/research/id-consumption/whois-map/.

  16. MAWI working group traffic archive. Available at: http://tracer.csl.sony.co.jp/mawi/.

  17. The R project for statistical computing. Available at: http://www.r-project.org.

  18. FFmpeg Homepage. Available at: http://ffmpeg.org/.

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Marat Zhanikeev.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Zhanikeev, M., Tanaka, Y. A graphical method for detection of Flash Crowds in traffic. Telecommun Syst 57, 91–105 (2014). https://doi.org/10.1007/s11235-013-9768-0

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11235-013-9768-0

Keywords

Navigation