Skip to main content

Big Data and the Internet of Things in Edge Computing for Smart City

  • Conference paper
  • First Online:

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 11703))

Abstract

Requests expressing collective human expectations and outcomes from city service tasks can be partially satisfied by processing Big Data provided to a city cloud via the Internet of Things. To improve the efficiency of the city clouds an edge computing has been introduced regarding Big Data mining. This intelligent and efficient distributed system can be developed for citizens that are supposed to be informed and educated by the smart agents. Besides, we suggest that these intelligent agents can be moved to the edge of the cloud and reduce the latency of the big data receiving. Finally, some numerical experiments with edge computing have been submitted to support this approach with optimization of two criteria. The first one is the CPU workload of the bottleneck computer and the second one is the communication workload of the bottleneck server.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. Altameem, T., Amoon, M.: An agent-based approach for dynamic adjustment of scheduled jobs in computational grids. J. Comput. Syst. Sci. Int. 49(5), 765–772 (2010)

    Article  Google Scholar 

  2. Apache Hadoop. http://hadoop.apache.org/. Accessed 17 April 2019

  3. Ayed, B., Halima, A.B., Alimi, A.M.: Big data analytics for logistics and transportation. In: 4th International Conference on Advanced Logistics and Transport (ICALT), pp. 311–316. IEEE (2015)

    Google Scholar 

  4. Balicki, J.: Negative selection with ranking procedure in tabu-based multi-criterion evolutionary algorithm for task assignment. In: Alexandrov, V.N., van Albada, G.D., Sloot, P.M.A., Dongarra, J. (eds.) ICCS 2006. LNCS, vol. 3993, pp. 863–870. Springer, Heidelberg (2006). https://doi.org/10.1007/11758532_112

    Chapter  Google Scholar 

  5. Balicki, J.: An adaptive quantum–based multiobjective evolutionary algorithm for efficient task assignment in distributed systems. In: Mastorakis, N., et al. (eds.) Recent Advances in Computer Engineering 2009, 13th International Conference on Computers, Rhodes, Greece, pp. 417–422. WSEAS, Athens (2009)

    Google Scholar 

  6. Balicki, J., Kitowski, Z.: Multicriteria evolutionary algorithm with tabu search for task assignment. In: Zitzler, E., Thiele, L., Deb, K., Coello Coello, C.A., Corne, D. (eds.) EMO 2001. LNCS, vol. 1993, pp. 373–384. Springer, Heidelberg (2001). https://doi.org/10.1007/3-540-44719-9_26

    Chapter  Google Scholar 

  7. Balicki, J., Korłub, W., Szymanski, J., Zakidalski, M.: Big data paradigm developed in volunteer grid system with genetic programming scheduler. In: Rutkowski, L., Korytkowski, M., Scherer, R., Tadeusiewicz, R., Zadeh, L.A., Zurada, J.M. (eds.) ICAISC 2014. LNCS (LNAI), vol. 8467, pp. 771–782. Springer, Cham (2014). https://doi.org/10.1007/978-3-319-07173-2_66

    Chapter  Google Scholar 

  8. Balicki, J., Korlub, W., Krawczyk, H., et al.: Genetic programming with negative selection for volunteer computing system optimization. In: Paja, W.A., Wilamowski, B.M. (eds.) Human System Interactions 2013, Gdańsk, Poland, pp. 271–278 (2013)

    Google Scholar 

  9. BOINC. http://boinc.berkeley.edu/. Accessed 17 April 2019

  10. Cao, L., Gorodetsky, V., Mitkas, P.A.: Agent mining: the synergy of agents and data mining. IEEE Intell. Syst. 24(3), 64–72 (2009)

    Article  Google Scholar 

  11. Comcute grid. http://comcute.eti.pg.gda.pl/. Accessed 17 April 2019

  12. Dean, J., Ghemawat, S.: MapReduce: simplified data processing on large clusters. Commun. ACM 51(1), 1–13 (2008)

    Article  Google Scholar 

  13. Galligan, S.D., O’Keeffe, J.: Big Data Helps City of Dublin Improves its Public Bus Transportation Network and Reduce Congestion. IBM Press (2013)

    Google Scholar 

  14. Guojun, L., Ming, Z., Fei, Y.: Large–scale social network analysis based on MapReduce. In: International Proceedings on Computational Aspects of Social Networks, pp. 487–490 (2010)

    Google Scholar 

  15. Kang, J., Sim, K.M.: A multiagent brokering protocol for supporting Grid resource discovery. Appl. Intell. 37(4), 527–542 (2012)

    Article  Google Scholar 

  16. Li, H.X., Chosler, R.: Application of multilayered multi–agent data mining architecture to bank domain. In: International Proceedings on Wireless Communications and Mobile Computing, pp. 6721–6724 (2007)

    Google Scholar 

  17. Mardani, S., Akbari, M.K., Sharifian, S.: Fraud detection in process aware information systems using MapReduce. In: International Proceedings on Information and Knowledge Technology, pp. 88–91 (2014)

    Google Scholar 

  18. Marz, N., Warren, J.: Big Data – Principles and Best Practices of Scalable Realtime Data Systems. Manning, Shelter Island (2014)

    Google Scholar 

  19. O’Leary, D.E.: Artificial intelligence and big data. IEEE Intell. Syst. 28(2), 96–99 (2013)

    Article  Google Scholar 

  20. Ostrowski, D.A.: MapReduce design patterns for social networking analysis. In: International Proceedings on Semantic Computing, pp. 316–319 (2014)

    Google Scholar 

  21. Qiu, X., et al.: Using MapReduce technologies in bioinformatics and medical informatics. In: International Proceedings on High Performance Computing, Networking, Storage and Analysis, Portland (2009)

    Google Scholar 

  22. Reed, D.A., Gannon, D.B., Larus, J.R.: Imagining the future: thoughts on computing. IEEE Comput. 45(1), 25–30 (2012)

    Article  Google Scholar 

  23. Shibata, T., Choi, S., Taura, K.: File–access patterns of data-intensive workflow applications. In: International Proceedings on Cluster, Cloud and Grid Computing, pp. 522–525. IEEE/ACM (2010)

    Google Scholar 

  24. Shvachko, K., et al.: The Hadoop distributed file system. In: MSST, pp. 1–10 (2010)

    Google Scholar 

  25. Snijders, C., Matzat, U., Reips, U.-D.: ‘Big Data’: big gaps of knowledge in the field of internet. Int. J. Internet Sci. 7(1), 1–5 (2012)

    Google Scholar 

  26. Twardowski, B., Ryzko, D.: Multi-agent architecture for real–time big data processing. In: International Proceedings on Web Intelligence and Intelligent Agent Technologies, vol. 3, pp. 333–337 (2014)

    Google Scholar 

  27. Vavilapalli, V.K.: Apache Hadoop YARN: yet another resource negotiator. In: International Proceedings on Cloud Computing, New York, USA, pp. 5:1–5:16 (2013)

    Google Scholar 

  28. Verbrugge, T., Dunin-Kęplicz, B.: Teamwork in Multi–agent Systems. A Formal Approach. Wiley, New York (2010)

    MATH  Google Scholar 

  29. Viegas, J.: Big data and transport. International Transport Forum (2013)

    Google Scholar 

  30. Węglarz, J., Błażewicz, J., Kovalyov, M.: Preemptable malleable task scheduling problem. IEEE Trans. Comput. 55(4), 486–490 (2006)

    Article  Google Scholar 

  31. Zhou, D., et al.: Multi–agent distributed data mining model based on algorithm analysis and task prediction. In: International Proceedings on Information Engineering and Computer Science, pp. 1–4 (2010)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Jerzy Balicki .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Balicki, J., Balicka, H., Dryja, P., Tyszka, M. (2019). Big Data and the Internet of Things in Edge Computing for Smart City. In: Saeed, K., Chaki, R., Janev, V. (eds) Computer Information Systems and Industrial Management. CISIM 2019. Lecture Notes in Computer Science(), vol 11703. Springer, Cham. https://doi.org/10.1007/978-3-030-28957-7_9

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-28957-7_9

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-28956-0

  • Online ISBN: 978-3-030-28957-7

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics