Skip to main content
SpringerLink
Log in

A versatile computational framework for group pattern mining of pedestrian trajectories

  • Published:
GeoInformatica Aims and scope Submit manuscript

Abstract

Mining patterns of large-scale trajectory data streams has been of increase research interest. In this paper, we are interested in mining group patterns of moving objects. Group pattern mining describes a special type of trajectory mining task that requires to efficiently discover trajectories of objects that are found in close proximity to each other for a period of time. In particular, we focus on trajectories of pedestrians coming from motion video analysis and we are interested in interactive analysis and exploration of group dynamics, including various definitions of group gathering and dispersion. Traditional approaches to solve the problem adhere to strict definition of group semantics. That restricts their application to specific problems and renders them inadequate for many real-world scenarios. To address this limitation, we propose a novel versatile method, timeWgroups, for efficient discovery of pedestrian groups that can adhere to different pattern semantics. First, the method efficiently discovers pairs of pedestrians that move together over time, under varying conditions of space and time. Subsequently, pairs of pedestrians are used as a building block for effectively discovering groups of pedestrians that can satisfy versatile group pattern semantics. As such, the proposed method can accommodate many different scenarios and application requirements. In addition, we introduce a new group pattern, individual perspective grouping that focuses on how individuals perceive groups. Based on the new group pattern we define the concept of dominant groups, a global metric for defining important groups that respects the individual perspective group pattern. Through experiments on real data, we demonstrate the effectiveness of our methods on discovering group patterns of pedestrian trajectories against sensible baselines, for a varying range of conditions. Furthermore, a query-based search method is provided that allows for interactive exploration and analysis of group dynamics over time and space. In addition, a visual testing is performed on real motion video to assert the group dynamics discovered by our methods.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15

Similar content being viewed by others

Notes

  1. https://sites.google.com/view/pedestrians-group-pattern/

  2. https://sites.google.com/view/pedestrians-group-pattern/

  3. https://sites.google.com/view/pedestrians-group-pattern/

  4. https://sites.google.com/view/pedestrians-group-pattern/

References

  1. Abuolaim A, Leow WK, Varadarajan J, Ahuja N (2017) On the essence of unsupervised detection of anomalous motion in surveillance videos. In: International Conference on Computer Analysis of Images and Patterns, pp 160–171

    Chapter  Google Scholar 

  2. Andriluka M, Roth S, Schiele B (2008) People-tracking-by-detection and people-detection-by-tracking. In: Computer vision and Pattern Recognition (CVPR), pp 1–8

  3. Bae SH, Yoon KJ (2014) Robust online multiobject tracking with data association and track management. IEEE Trans Image Process 23(7):2820–2833

    Article  Google Scholar 

  4. Bastani V, Campo D, Marcenaro L, Regazzoni C (2015) Online pedestrian group walking event detection using spectral analysis of motion similarity graph. In: International Conference on Advanced Video and Signal Based Surveillance (AVSS), pp 1–5

  5. Benkert M, Gudmundsson J, Hübner F, Wolle T (2008) Reporting flock patterns. Comput Geom 41(3):111–125

    Article  Google Scholar 

  6. Brščić D, Zanlungo F, Kanda T (2017) Modelling of pedestrian groups and application to group recognition. In: International Convention on Information and Communication Technology, Electronics and Microelectronics (MIPRO), pp 564–569

  7. Cartwritht D, Zander A (1960) Group dynamics. Harper and Row, New York

  8. Dollar P, Wojek C, Schiele B, Perona P (2012) Pedestrian detection: an evaluation of the state of the art. IEEE Trans Pattern Anal Mach Intell 34(4):743–761

    Article  Google Scholar 

  9. Ester M, Kriegel HP, Sander J, Xu X, et al. (1996) A density-based algorithm for discovering clusters in large spatial databases with noise. In: KDD, vol 96, pp 226–231

  10. Fan Q, Zhang D, Wu H, Tan KL (2016) A general and parallel platform for mining co-movement patterns over large-scale trajectories. Proceed VLDB Endowment 10(4):313–324

    Article  Google Scholar 

  11. Faugeras O (1993) Three-dimensional computer vision: a geometric viewpoint. MIT Press, Cambridge

  12. Gaffney S, Smyth P (1999) Trajectory clustering with mixtures of regression models. In: Knowledge Discovery and Data Mining (SIGKDD), pp 63–72

  13. Guo D, Liu S, Jin H (2010) A graph-based approach to vehicle trajectory analysis. J Locat Based Serv 4(3-4):183–199

    Article  Google Scholar 

  14. Hwang S, Park J, Kim N, Choi Y, So Kweon I (2015) Multispectral pedestrian detection: Benchmark dataset and baseline. In: Computer Vision and Pattern Recognition (CVPR), pp 1037–1045

  15. Jeung H, Shen HT, Zhou X (2008) Convoy queries in spatio-temporal databases. In: International Conference on Data Engineering (ICDE), pp 1457–1459

  16. Jeung H, Yiu ML, Zhou X, Jensen CS, Shen HT (2008) Discovery of convoys in trajectory databases. Proc VLDB Endowment 1(1):1068–1080

    Article  Google Scholar 

  17. Kalnis P, Mamoulis N, Bakiras S (2005) On discovering moving clusters in spatio-temporal data. In: Spatial and Temporal Databases (SSTD), pp 364–381

  18. Lan R, Yu Y, Cao L, Song P, Wang Y (2017) Discovering evolving moving object groups from massive-scale trajectory streams. In: Mobile Data Management (MDM), pp 256–265

  19. Le Bon G (1921) The Crowd: A study of the popular mind. Macmillan New York, New York

  20. Lee JG, Han J, Whang KY (2007) Trajectory clustering: a partition-and-group framework. In: Proceedings of the international conference on Management of data (SIGMOD). ACM, pp 593–604

  21. Lerner A, Chrysanthou Y, Lischinski D (2007) Crowds by example. In: Computer Graphics Forum, vol 26, pp 655–664

    Article  Google Scholar 

  22. Moussaïd M, Perozo N, Garnier S, Helbing D, Theraulaz G (2010) The walking behaviour of pedestrian social groups and its impact on crowd dynamics. PloS one 5(4):e10047

    Article  Google Scholar 

  23. Nanopoulos A, Theodoridis Y, Manolopoulos Y (2001) C2p: clustering based on closest pairs. In: VLDB, pp 331–340

  24. Pelekis N, Tampakis P, Vodas M, Doulkeridis C, Theodoridis Y (2017) On temporal-constrained sub-trajectory cluster analysis. Data Min Knowl Disc 31:1294–1330

    Article  Google Scholar 

  25. Rupasinghe R, Senanayake S, Padmasiri D, Ekanayake M, Godaliyadda G, Wijayakulasooriya J (2016) Modes of clustering for motion pattern analysis in video surveillance. In: Information and Automation for Sustainability (ICIAfs), pp 1–6

  26. Sakr MA, Güting RH (2014) Group spatiotemporal pattern queries. GeoInformatica 18(4):699–746

    Article  Google Scholar 

  27. Sawas A, Abuolaim A, Afifi M, Papagelis M (2018) Tensor methods for group pattern discovery of pedestrian trajectories. In: 2018 19Th IEEE International Conference on Mobile Data Management (MDM), pp 76–85. IEEE

  28. Sawas A, Abuolaim A, Afifi M, Papagelis M (2018) Trajectolizer: Interactive analysis and exploration of trajectory group dynamics. In: Mobile Data Management (MDM), pp 286–287

  29. Shu G, Dehghan A, Oreifej O, Hand E, Shah M (2012) Part-based multiple-person tracking with partial occlusion handling. In: Computer Vision and Pattern Recognition (CVPR), pp 1815–1821

  30. Siła-Nowicka K, Vandrol J, Oshan T, Long JA, Demšar U, Fotheringham AS (2016) Analysis of human mobility patterns from gps trajectories and contextual information. Int J Geogr Inf Sci 30(5):881–906

    Article  Google Scholar 

  31. Solera F, Calderara S, Cucchiara R (2016) Socially constrained structural learning for groups detection in crowd. IEEE Trans Pattern Anal Mach Intell 38 (5):995–1008

    Article  Google Scholar 

  32. Vilain M, Burger J, Aberdeen J, Connolly D, Hirschman L (1995) A model-theoretic coreference scoring scheme. In: Proceedings of the 6th Conference on Message Understanding. Association for Computational Linguistics, pp 45–52

  33. Volkhardt M, Schneemann F, Gross HM (2013) Fallen person detection for mobile robots using 3d depth data. In: International Conference on Systems, Man, and Cybernetics (SMC), pp 3573–3578

  34. Wakuda Y, Asano S, Koshizuka N, Sakamura K (2012) An adaptive map-matching based on dynamic time warping for pedestrian positioning using network map. In: Proceedings of the 2012 IEEE/ION Position, Location and Navigation Symposium, pp 590–597

  35. Wu S, Wong HS, Yu Z (2014) A bayesian model for crowd escape behavior detection. IEEE Trans Circ Syst Video Technol 24(1):85–98

    Article  Google Scholar 

  36. Yi S, Li H, Wang X (2015) Understanding pedestrian behaviors from stationary crowd groups. In: Computer Vision and Pattern Recognition (CVPR), pp 3488–3496

  37. Yuan G, Sun P, Zhao J, Li D, Wang C (2017) A review of moving object trajectory clustering algorithms. Artif Intell Rev 47(1):123–144

    Article  Google Scholar 

  38. Zanlungo F, Ikeda T, Kanda T (2014) Potential for the dynamics of pedestrians in a socially interacting group. Phys Rev E 89(1):012811

    Article  Google Scholar 

  39. Zanlungo F, Kanda T (2013) Do walking pedestrians stabily interact inside a large group? analysis of group and sub-group spatial structure. In: Cogsci

  40. Zhang T, Soh SH, Fu X, Lee KK, Wong L, Ma S, Xiao G, Kwoh CK (2009) Hpcgen a fast generator of contact networks of large urban cities for epidemiological studies. In: Computational Intelligence, Modelling and Simulation (CSSim), pp 198–203

  41. Zheng K, Zheng Y, Yuan NJ, Shang S (2013) On discovery of gathering patterns from trajectories. In: International Conference on Data Engineering (ICDE), pp 242–253

Download references

Acknowledgements

This research has been partially supported by a Natural Sciences and Engineering Research Council of Canada (NSERC) Discovery Grant (#RGPIN-2017-05680).

Author information

Authors and Affiliations

  1. York University, 4700 Keele St, Toronto, ON, M3J 1P3, Canada

    Abdullah Sawas, Abdullah Abuolaim, Mahmoud Afifi & Manos Papagelis

Authors
  1. Abdullah Sawas
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Abdullah Abuolaim
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Mahmoud Afifi
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Manos Papagelis
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Abdullah Sawas.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Reproducibility

The source code, data, sample rendered videos and an online interactive demonstration are publicly available to encourage reproducibility of results. They can be accessed onlineFootnote 4.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Sawas, A., Abuolaim, A., Afifi, M. et al. A versatile computational framework for group pattern mining of pedestrian trajectories. Geoinformatica 23, 501–531 (2019). https://doi.org/10.1007/s10707-019-00353-2

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10707-019-00353-2

Keywords

Search

Navigation