Skip to main content
Log in

Towards a reactive system for managing big trajectory data

  • Original Research
  • Published:
Journal of Ambient Intelligence and Humanized Computing Aims and scope Submit manuscript

Abstract

Spatio-temporal events often describe the movements of an object in terms of space, time, and potential other attributes. Significant knowledge can be inferred by analysing them, either individually or atomically in form of trajectories. The trajectories can abstract additional properties and lead to deeper value. Moreover, external contextual information can be attributed to them to change their structure and lead to different perspectives. Because of this potentially valuable knowledge, nowadays indoor and outdoor tracking devices are used everywhere; generating countless events instantaneously. However, the extraction of knowledge from such heterogeneous, massive data is not a trivial task. In other terms, there is a need for a sophisticated system that is efficient in terms of distributed computing, failure handling, responsiveness, and abstraction. To answer this need, our study incorporates a fully fledged, reactive system for big trajectory data management. The system is unique of its kind because it is actor-based and features responsiveness, resiliency, and elasticity. Furthermore, our system is implemented using Scala; hence, we have the expressive power of both the Object-Oriented (OO) and Functional Programming (FP) paradigms. Allowing us to reach a higher level of abstraction to be able to process any trajectory type. The scope of this paper is to detail our system and discuss elasticity, routing strategies, load balancing, and our proper fault-tolerance mechanism. To fulfill this study, we consider the Geolife project’s GPS trajectory dataset.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16

Similar content being viewed by others

Notes

  1. https://akka.io/.

  2. https://www.playframework.com/.

  3. https://www.nginx.com/.

  4. https://angular.io/.

  5. https://d3js.org/.

  6. https://www.mongodb.com/.

  7. https://www.docker.com/.

  8. http://reactivemongo.org/.

  9. https://www.scala-lang.org/.

  10. https://spark.apache.org/.

  11. https://hadoop.apache.org/.

  12. https://github.com/OpenHFT/Chronicle-Map.

  13. https://storm.apache.org/.

  14. https://scalaz.github.io/.

  15. https://typelevel.org/cats/.

References

  • Basiri A, Amirian P, Winstanley A, Moore T (2018) Making tourist guidance systems more intelligent, adaptive and personalised using crowd sourced movement data. J Ambient Intell Humaniz Comput 9(2):413–427. https://doi.org/10.1007/s12652-017-0550-0

    Article  Google Scholar 

  • Bonér J, Farley D, Kuhn R, Thompson M (2014) The reactive manifesto, v2. 0. https://www.reactivemanifesto.org/. Accessed 18 Aug 2019

  • Boulmakoul A, Karim L, Lbath A (2012) Moving object trajectories meta-model and spatio-temporal queries. arXiv preprint arXiv:1205.1796

  • Chen C, Ding Y, Xie X, Zhang S (2018) A three-stage online map-matching algorithm by fully using vehicle heading direction. J Ambient Intell Humaniz Comput 9(5):1623–1633. https://doi.org/10.1007/s12652-018-0760-0

    Article  Google Scholar 

  • da Silva TLC, Neto ACA, Magalhães RP, de Farias VA, de Macêdo JAF, Machado JC (2014) Efficient and distributed dbscan algorithm using mapreduce to detect density areas on traffic data. In: ICEIS (1), pp 52–59

  • da Silva TLC, Zeitouni K, de Macêdo JA (2016) Online clustering of trajectory data stream. In: Mobile Data Management (MDM), 2016 17th IEEE International Conference on, IEEE, vol 1, pp 112–121

  • Ding X, Chen L, Gao Y, Jensen CS, Bao H (2018a) Ultraman: a unified platform for big trajectory data management and analytics. Proc VLDB Endow 11(7):787–799

    Article  Google Scholar 

  • Ding X, Chen R, Chen L, Gao Y, Jensen CS (2018b) Viptra: visualization and interactive processing on big trajectory data. In: 2018 19th IEEE international conference on mobile data management (MDM), IEEE, pp 290–291

  • Gong Y, Rimba P, Sinnott R (2017) A big data architecture for near real-time traffic analytics. In: Companion Proceedings of the 10th International Conference on Utility and Cloud Computing, ACM, pp 157–162

  • He T, Bao J, Li R, Ruan S, Li Y, Tian C, Zheng Y (2018) Detecting vehicle illegal parking events using sharing bikes’ trajectories. In: Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, ACM, pp 340–349

  • Hewitt C, Bishop P, Steiger R (1973) Session 8 formalisms for artificial intelligence a universal modular actor formalism for artificial intelligence. In: Advance papers of the conference, Stanford Research Institute, vol 3, p 235

  • Jadallah H, Al Aghbari Z (2018) Spatial cloaking for location-based queries in the cloud. J Ambient Intell Humaniz Comput. https://doi.org/10.1007/s12652-018-0767-6

  • Kubuszok M (2018) Kinds of types in scala. https://kubuszok.com/compiled/kinds-of-types-in-scala/. Accessed 18 Aug 2019

  • Li R, Ruan S, Bao J, Zheng Y (2017) A cloud-based trajectory data management system. In: Proceedings of the 25th ACM SIGSPATIAL international conference on advances in geographic information systems, ACM, p 96

  • Liu D, Weng D, Li Y, Bao J, Zheng Y, Qu H, Wu Y (2017) Smartadp: Visual analytics of large-scale taxi trajectories for selecting billboard locations. IEEE Trans Vis Comput Graphics 23(1):1–10

    Article  Google Scholar 

  • Ma S, Zheng Y, Wolfson O et al (2015) Real-time city-scale taxi ridesharing. IEEE Trans Knowl Data Eng 27(7):1782–1795

    Article  Google Scholar 

  • Maguerra S, Boulmakoul A, Karim L, Badir H (2018) A survey on solutions for big spatio-temporal data processing and analytics. In: Proceedings of the 7th international conference on innovation and new trends in information systems, pp 127–140

  • Maguerra S, Boulmakoul A, Badir H (2019a) Load balancing of distributed actors in an asynchronous message processing boundary, submitted

  • Maguerra S, Boulmakoul A, Karim L, Badir H, Lbath A (2019b) A reactive system for big trajectory data management. Procedia Comput Sci 151:463–470

    Article  Google Scholar 

  • Milewski B (2018) Category theory for programmers

  • Ruan S, Li R, Bao J, He T, Zheng Y (2018) Cloudtp: a cloud-based flexible trajectory preprocessing framework. ICDE IEEE

  • Sarcevic P, Kincses Z, Pletl S (2019) Online human movement classification using wrist-worn wireless sensors. J Ambient Intell Humaniz Comput 10(1):89–106. https://doi.org/10.1007/s12652-017-0606-1

    Article  Google Scholar 

  • Shang Z, Li G, Bao Z (2018) Dita: distributed in-memory trajectory analytics. In: Proceedings of the 2018 International Conference on Management of Data, ACM, pp 725–740

  • Sinnott RO, Morandini L, Wu S (2015) Smash: a cloud-based architecture for big data processing and visualization of traffic data. In: Data Science and Data Intensive Systems (DSDIS), 2015 IEEE International Conference on, IEEE, pp 53–60

  • Su Y, Sun W (2019) Dynamic differential models for studying traffic flow and density. J Ambient Intell Humaniz Comput 10(1):315–320. https://doi.org/10.1007/s12652-017-0506-4

    Article  Google Scholar 

  • Xie D, Li F, Phillips JM (2017) Distributed trajectory similarity search. Proc VLDB Endow 10(11):1478–1489

    Article  Google Scholar 

  • Xie X, Mei B, Chen J, Du X, Jensen CS (2016) Elite: an elastic infrastructure for big spatiotemporal trajectories. VLDB J-Int J Very Large Data Bases 25(4):473–493

    Article  Google Scholar 

  • Zhang Z, Jin C, Mao J, Yang X, Zhou A (2017) Trajspark: a scalable and efficient in-memory management system for big trajectory data. In: Chen L, Jensen C, Shahabi C, Yang X, Lian X (eds) Web and big data. APWeb-WAIM 2017. Lecture Notes in Computer Science, vol 10366. Springer, Cham, pp 11–26

    Google Scholar 

  • Zheng Y, Li Q, Chen Y, Xie X, Ma WY (2008) Understanding mobility based on GPS data. In: Proceedings of the 10th international conference on Ubiquitous computing, ACM, 2008, pp 312–321

  • Zheng Y, Zhang L, Xie X, Ma WY (2009) Mining interesting locations and travel sequences from GPS trajectories. In: Proceedings of the 18th international conference on World wide web, ACM, pp 791–800

  • Zheng Y, Xie X, Ma WY (2010) Geolife: a collaborative social networking service among user, location and trajectory. IEEE Data Eng Bull 33(2):312–321

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Azedine Boulmakoul.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Maguerra, S., Boulmakoul, A., Karim, L. et al. Towards a reactive system for managing big trajectory data. J Ambient Intell Human Comput 11, 3895–3906 (2020). https://doi.org/10.1007/s12652-019-01625-3

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12652-019-01625-3

Keywords

Navigation