Skip to main content
SpringerLink
Log in

Big Data Analytics in IOT: Challenges, Open Research Issues and Tools

  • Conference paper
  • First Online:
Trends and Advances in Information Systems and Technologies (WorldCIST'18 2018)

Part of the book series: Advances in Intelligent Systems and Computing ((AISC,volume 746))

Included in the following conference series:

Abstract

Terabytes of data are generated day-to-day from modern information systems, cloud computing and digital technologies, as the increasing number of Internet connected devices grows. However, the analysis of these massive data requires many efforts at multiple levels for knowledge extraction and decision making. Therefore, Big Data Analytics is a current area of research and development that has become increasingly important. This article investigates cutting-edge research efforts aimed at analyzing Internet of Things (IoT) data. The basic objective of this article is to explore the potential impact of large data challenges, research efforts directed towards the analysis of IoT data and various tools associated with its analysis. As a result, this article suggests the use of platforms to explore big data in numerous stages and better understand the knowledge we can draw from the data, which opens a new horizon for researchers to develop solutions based on open research challenges and topics.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Tavana, M., Puranam, K.: Handbook of Research on Organizational Transformations through Big Data Analytics, p. 109 (2012)

    Google Scholar 

  2. Marjani, M., et al.: Big IoT data analytics: architecture, opportunities, and open research challenges. IEEE Access PP(99), 1 (2017)

    Google Scholar 

  3. Tiainen, P.: New opportunities in electrical engineering as a result of the emergence of the Internet of Things. AaltoDoc, Aalto Univ. (2016)

    Google Scholar 

  4. Beyer, M.: Gartner says solving ‘Big Data’ challenge involves more than just managing volumes of data. AaltoDoc, Aalto Univ. (2011)

    Google Scholar 

  5. Acharjya, D.P., Ahmed, K.: A survey on Big Data analytics: challenges, open research issues and tools. Int. J. Adv. Comput. Sci. Appl. 7(2), 511–518 (2016)

    Google Scholar 

  6. Mital, R., Coughlin, J., Canaday, M.: Using Big Data technologies and analytics to predict sensor anomalies. In: Proceedings of the Advanced Maui Optical and Space Surveillance Technologies Conference, p. 84 (2014)

    Google Scholar 

  7. Golchha, N.: Big data-the information revolution. Int. J. Adv. Res. 1, 791–794 (2015)

    Google Scholar 

  8. Tsai, C.-W.: Big Data analytics: a survey. J. Big Data 2, 1–32 (2015)

    Article  Google Scholar 

  9. Russom, P.: Big Data Analytics. TDWI Best Pract. Rep., pp. 1–35 (2011)

    Google Scholar 

  10. LaValle, S., Lesser, E., Shockley, R., Hopkins, M.S., Kruschwitz, N.: Big Data, analytics and the path from insights to value. MIT Sloan Manag. Rev. 52, 21 (2011)

    Google Scholar 

  11. CollaB, O.: Big Data Definition, Open Framework, Information Management Strategy & Collaborative Governance| Data & Social Methodology - MIKE2.0 Methodology, 2015. http://mike2.openmethodology.org/wiki/Big_Data_Definition

  12. Gantz, J., Reinsel, D.: The digital universe in 2020: Big Data, bigger digital shadows, and biggest growth in the far east. IDC Anal. Future (2012)

    Google Scholar 

  13. U. S. Profile, The Digital Universe in 2020: Big Data, Bigger Digital Shadows, and Biggest Growth in the Far East — United States, pp. 1–7 (2013)

    Google Scholar 

  14. Atzori, L., Iera, A., Morabito, C.: The Internet of Things: a survey, pp. 2787–2805 (2010)

    Article  Google Scholar 

  15. Hsieh, H.-C., Lai, C.-H.: Internet of Things architecture based on integrated PLC and 3G communication networks. IEEE Access, pp. 853–856

    Google Scholar 

  16. Kwon, O., Lee, N., Shin, B.: Data quality management, data usage experience and acquisition intention of big data analytics. Int. J. Inf. Manag. 34, 387–394 (2014)

    Article  Google Scholar 

  17. Alvarado, J.C.: Estudio descriptivo de técnicas aplicadas en herramientas Open Source y comerciales para visualización de …, January 2017, 2016

    Google Scholar 

  18. Hashema, I.A.T., Yaqoob, I., Anuara, N.B., Mokhtara, S., Gania, A., Khanb, S.U.: The rise of ‘Big Data’ on cloud computing: review and open research issues. Inf. Syst. 47, 98–115 (2015)

    Article  Google Scholar 

  19. Kuo, M.-H., Sahama, T., Kushniruk, A.W., Borycki, E.M., Grunwell, D.K.: Health Big Data analytics: current perspectives, challenges and potential solutions. Int. J. Big Data Intell. 1, 114–126 (2014)

    Article  Google Scholar 

  20. Huang, Z.: Extensions to the k-Means algorithm for clustering large data sets with categorical values. Data Min. Knowl. Discov. 2(3), 283–304 (1998)

    Article  MathSciNet  Google Scholar 

  21. T. A. S. Foundation., Apache Hadoop (2014). http://hadoop.apache.org/

  22. Dean, J., Ghemawat, S.: MapReduce: simplified data processing on large clusters. In: Proceedings of the 6th Symposium on Operating Systems Design and Implementation, pp. 137–149 (2004)

    Google Scholar 

  23. Kaisler, S., Armour, F., Money, W., Espinosa, J.A.: Big Data issues and challenges, vol. 5, no. 2013, pp. 2013–2015 (2015)

    Google Scholar 

  24. E. Consulting: The importance of scalability in big data processing. http://blog.eccellaconsulting.com/the-importance-of-scalability-in-big-data-processing

  25. Hanrahan, P.: Tableau (2017). https://www.tableau.com/es-es/resource/business-intelligence

  26. Mishra, N., Lin, C.C., Chang, H.T.: A cognitive adopted framework for IoT Big-Data management and knowledge discovery prospective. Int. J. Distrib. Sens. Networks 2015(March), 1–13 (2015)

    Google Scholar 

  27. Chen, X.-Y., Jin, Z.-G.: Research on key technology and applications for internet of things. Phys. Procedia 33, 561–566 (2012)

    Article  Google Scholar 

  28. Spark – A modern data processing framework for cross platform analytics Deploying Spark on HPE Elastic Platform for Big Data

    Google Scholar 

  29. A. S. Foundation: Apache Storm (2015)

    Google Scholar 

  30. T. O. Center: Introducción a Hadoop y su ecosistema. http://www.ticout.com/blog/2013/04/02/introduccion-a-hadoop-y-su-ecosistema/

  31. Ingersoll, G.: Introducing apache mahout: Scalable, commercial friendly machine learning for building intelligent applications, pp. 1–18. White Paper, IBM Developer Works (2009)

    Google Scholar 

  32. Isard, M., Budiu, M., Yu, Y., Birrell, A., Fetterly, D.: Dryad: distributed data-parallel programs from sequential building blocks. ACM SIGOPS Oper. Syst. Rev. 41, 59–72 (2007)

    Article  Google Scholar 

  33. Chen, C.L.P., Zhang, C.Y.: Data-intensive applications, challenges, techniques and technologies: a survey on Big Data. Inf. Sci. 275, 314–347 (2014)

    Google Scholar 

  34. Kelly, J.: Apache Drill Brings SQL-Like, Ad Hoc Query Capabilities to Big Data (2013). http://wikibon.org/wiki/v/Apache_Drill_Brings_SQL-Like,_Ad_Hoc_Query_Capabilities_to_Big_Data

  35. Huang, T., Lan, L., Fang, X., An, P., Min, J., Wang, F.: Promises and challenges of big data computing in health sciences. Big Data Res. 2, 2–11 (2015)

    Article  Google Scholar 

  36. Castella: Introducción a Hadoop y su ecosistema (2013). http://www.ticout.com/blog/2013/04/02/introduccion-a-hadoop-y-su-ecosistema/

  37. A. S. Foundation: Spark 0.8.0: This document gives a short overview of how Spark runs on clusters, to make it easier to understand the components involved. (2014). https://spark.apache.org/docs/0.8.0/cluster-overview.html

  38. I. d. i. d. Conocimiento: 7 Herramientas Big Data para tu empresa (2016). http://www.iic.uam.es/innovacion/herramientas-big-data-para-empresa/

  39. Acharjya, D.P., Dehuri, S., Sanyal, S. (eds.): Computational Intelligence for Big Data Analysis (2015)

    Google Scholar 

Download references

Acknowledgments

This work was possible thanks to Senescyt of Ecuador for the financing of research studies at the Polytechnic Institute of Leiria, Portugal and to the FCT project UID/CEC/4524/2016.

Author information

Authors and Affiliations

  1. School of Technology and Management, Computer Science and Communications Research Centre, Polytechnic Institute of Leiria, Leiria, Portugal

    Fabián Constante Nicolalde, Fernando Silva & António Pereira

  2. Universidad Central del Ecuador, Quito, Ecuador

    Fabián Constante Nicolalde & Boris Herrera

  3. Information and Communications Technologies Unit, INOV INESC Innovation-Delegation Office at Leiria, Leiria, Portugal

    António Pereira

Authors
  1. Fabián Constante Nicolalde
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Fernando Silva
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Boris Herrera
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. António Pereira
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to António Pereira .

Editor information

Editors and Affiliations

  1. Departamento de Engenharia Informática, Universidade de Coimbra, Coimbra, Portugal

    Álvaro Rocha

  2. College of Engineering, The Ohio State University, Columbus, Ohio, USA

    Hojjat Adeli

  3. DSI/EEUM, Universidade do Minho, Guimarães, Portugal

    Luís Paulo Reis

  4. DIMES, Universita della Calabria, Arcavacata di Rende, Italy

    Sandra Costanzo

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer International Publishing AG, part of Springer Nature

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Constante Nicolalde, F., Silva, F., Herrera, B., Pereira, A. (2018). Big Data Analytics in IOT: Challenges, Open Research Issues and Tools. In: Rocha, Á., Adeli, H., Reis, L., Costanzo, S. (eds) Trends and Advances in Information Systems and Technologies. WorldCIST'18 2018. Advances in Intelligent Systems and Computing, vol 746. Springer, Cham. https://doi.org/10.1007/978-3-319-77712-2_73

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-77712-2_73

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-77711-5

  • Online ISBN: 978-3-319-77712-2

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics

Search

Navigation