Skip to main content

Efficient Algorithms for Flock Detection in Large Spatio-Temporal Data

  • Conference paper
  • First Online:
Big Data Analytics (BDA 2019)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 11932))

Included in the following conference series:

Abstract

Increasing availability of location-based applications and sensor devices have necessitated quicker analysis of moving object data streams in order to identify patterns. The efficiency of currently available algorithms used in pattern detection is not adequate to handle large scale data streams that are increasingly available. We focus on the particular problem of flock detection in moving object data and our goal is to detect flocks quickly and using fast algorithms. Firstly, we employ a triangular grid to reduce the search space of clustering algorithms which has a significant effect in case of dense objects. As a second step, we implement a modified flock membership function and pipeline creation that ensures better memory and time performance during cluster detection. We show that this refinement also improves the rate of flock detection. Finally, we parallelize our algorithm to further enhance the handling of massive data streams. Based on an extensive empirical evaluation of these algorithms across a variety of moving object data sets, we show that our method is significantly faster than the existing comparable methods over sliding windows. In particular, it requires lesser time to identify flocks and is 2–4 times faster thus confirming the efficiency and effectiveness of our approach.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Dataset details. http://www.chorochronos.org/Default.aspx?tabid=71&iditem=31. Accessed 04 Mar 2019

  2. Github - onlinereview/flockidentification: Identification of flocks. https://github.com/OnlineReview/FlockIdentification. Accessed 04 Aug 2019

  3. Index of /pub/datasets/noaa/g00807. ftp://sidads.colorado.edu/pub/DATASETS/NOAA/G00807. Accessed 04 Mar 2019

  4. KML Tutorial—Keyhole Markup Language—Google Developers. https://media.readthedocs.org/pdf/fastkml/latest/fastkml.pdf. Accessed 04 Mar 2019

  5. KML Tutorial—Keyhole Markup Language—Google Developers. https://developers.google.com/kml/documentation/kml_tut. Accessed 04 Mar 2019

  6. Atluri, G., Karpatne, A., Kumar, V.: Spatio-temporal data mining: a survey of problems and methods. ACM Comput. Surv. (CSUR) 51(4), 83 (2018)

    Article  Google Scholar 

  7. Babcock, B., Babu, S., Datar, M., Motwani, R., Widom, J.: Models and issues in data stream systems. In: Proceedings of the Twenty-First ACM SIGMOD-SIGACT-SIGART Symposium on Principles of Database Systems, pp. 1–16. ACM (2002)

    Google Scholar 

  8. Benkert, M., Gudmundsson, J., Hübner, F., Wolle, T.: Reporting flock patterns. In: Azar, Y., Erlebach, T. (eds.) ESA 2006. LNCS, vol. 4168, pp. 660–671. Springer, Heidelberg (2006). https://doi.org/10.1007/11841036_59

    Chapter  Google Scholar 

  9. Bhushan, A., Bellur, U.: Mining swarms from moving object data streams. In: Sarda, N.L., Acharya, P.S., Sen, S. (eds.) Geospatial Infrastructure, Applications and Technologies: India Case Studies, pp. 271–284. Springer, Singapore (2018). https://doi.org/10.1007/978-981-13-2330-0_20

    Chapter  Google Scholar 

  10. Bhushan, A., Bellur, U., Sharma, K., Deshpande, S., Sarda, N.L.: Mining swarm patterns in sliding windows over moving object data streams. In: Proceedings of the 25th ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems. SIGSPATIAL 2017, pp. 60:1–60:4. ACM, New York (2017). https://doi.org/10.1145/3139958.3139988

  11. Cao, Y., Zhu, J., Gao, F.: An algorithm for mining moving flock patterns from pedestrian trajectories. In: Morishima, A., et al. (eds.) APWeb 2016. LNCS, vol. 9865, pp. 310–321. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-45835-9_27

    Chapter  Google Scholar 

  12. Diez, Y., Fort, M., Korman, M., Sellarès, J.: Group evolution patterns in running races. Inf. Sci. 479, 20–39 (2019)

    Article  Google Scholar 

  13. Jeung, H., Yiu, M.L., Zhou, X., Jensen, C.S.: Path prediction and predictive range querying in road network databases. VLDB J. 19(4), 585–602 (2010)

    Article  Google Scholar 

  14. Jeung, H., Yiu, M.L., Zhou, X., Jensen, C.S., Shen, H.T.: Discovery of convoys in trajectory databases. Proc. VLDB Endow. 1(1), 1068–1080 (2008)

    Article  Google Scholar 

  15. Khezerlou, A.V., Zhou, X., Li, L., Shafiq, Z., Liu, A.X., Zhang, F.: A traffic flow approach to early detection of gathering events: comprehensive results. ACM Trans. Intell. Syst. Technol. (TIST) 8(6), 74 (2017)

    Google Scholar 

  16. van Kreveld, M., Loffler, M., Staals, F., Wiratma, L.: A refined definition for groups of moving entities and its computation. Int. J. Comput. Geom. Appl. 28(02), 181–196 (2018)

    Article  MathSciNet  Google Scholar 

  17. Li, Z., Ding, B., Han, J., Kays, R.: Swarm: mining relaxed temporal moving object clusters. Proc. VLDB Endow. 3(1–2), 723–734 (2010). https://doi.org/10.14778/1920841.1920934

    Article  Google Scholar 

  18. McKenney, M., Frye, R., Dellamano, M., Anderson, K., Harris, J.: Multi-core parallelism for plane sweep algorithms as a foundation for GIS operations. GeoInformatica 21(1), 151–174 (2017)

    Article  Google Scholar 

  19. Nievergelt, J., Preparata, F.P.: Plane-sweep algorithms for intersecting geometric figures. Commun. ACM 25(10), 739–747 (1982)

    Article  Google Scholar 

  20. Orakzai, F., Calders, T., Pedersen, T.B.: Distributed convoy pattern mining. In: 2016 17th IEEE International Conference on Mobile Data Management (MDM), vol. 1, pp. 122–131. IEEE (2016)

    Google Scholar 

  21. Tanaka, P.S., Vieira, M.R., Kaster, D.S.: An improved base algorithm for online discovery of flock patterns in trajectories. J. Inf. Data Manag. 7(1), 52 (2016)

    Google Scholar 

  22. Tanuja, V., Govindarajulu, P.: A survey on trajectory data mining. Int. J. Comput. Sci. Secur. (IJCSS) 10(5), 195 (2016)

    Google Scholar 

  23. Vieira, M.R., Bakalov, P., Tsotras, V.J.: On-line discovery of flock patterns in spatio-temporal data. In: Proceedings of the 17th ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems, pp. 286–295. ACM (2009)

    Google Scholar 

  24. Yuan, G., Sun, P., Zhao, J., Li, D., Wang, C.: A review of moving object trajectory clustering algorithms. Artif. Intell. Rev. 47(1), 123–144 (2017)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Sumit Sen .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Mhatre, J., Agrawal, H., Sen, S. (2019). Efficient Algorithms for Flock Detection in Large Spatio-Temporal Data. In: Madria, S., Fournier-Viger, P., Chaudhary, S., Reddy, P. (eds) Big Data Analytics. BDA 2019. Lecture Notes in Computer Science(), vol 11932. Springer, Cham. https://doi.org/10.1007/978-3-030-37188-3_18

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-37188-3_18

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-37187-6

  • Online ISBN: 978-3-030-37188-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics