Skip to main content
SpringerLink
Log in

The role of structured and unstructured data managing mechanisms in the Internet of things

  • Published:
Cluster Computing Aims and scope Submit manuscript

Abstract

Internet of Things (IoT) has the idea of receiving data and sending them for each object within the communication network. One of the main issues in this type of networks is handling a growing volume of data with various data sources and data types to satisfy the performance requirements of applications. In this regard, data management in the IoT plays an important role in its efficient operations and has become a major research topic. However, the data management has a crucial role in the IoT, there is not any comprehensive and systematic work to analyze its approaches. Thus, main propose of this paper is to systematically review and study the existing data management approaches in the IoT. The data management approaches are classified into three main classes, including SQL database, NoSQL database, and graph database. In addition, the detailed comparison of the important mechanisms in each category brings a recommendation for further works.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5

Similar content being viewed by others

References

  1. Abbasi, M.A., Memon, Z.A., Memon, J., Syed, T.Q., Alshboul, R.: Addressing the future data management challenges in iot: a proposed framework. Int. J. Adv. Comput. Sci. Appl. 8(5), 197–207 (2017)

    Google Scholar 

  2. Abu-Elkheir, M., Hayajneh, M., Ali, N.A.: Data management for the internet of things: design primitives and solution. Sensors 13(11), 15582–15612 (2013)

    Google Scholar 

  3. Al-Ali, A., Zualkernan, I.A., Rashid, M., Gupta, R., Alikarar, M.: A smart home energy management system using IoT and big data analytics approach. IEEE Trans. Consum. Electron. 63(4), 426–434 (2017)

    Google Scholar 

  4. Alelaiwi, A.: A collaborative resource management for big IoT data processing in Cloud. Clust. Comput. 20(2), 1791–1799 (2017)

    Google Scholar 

  5. Angles, R., Gutierrez, C.: Survey of graph database models. ACM Computi. Surv. (CSUR) 40(1), 1 (2008)

    Google Scholar 

  6. Babar, M., Khan, F., Iqbal, W., Yahya, A., Arif, F., Tan, Z., Chuma, J.M.: A secured data management scheme for smart societies in industrial internet of things environment. IEEE Access 6, 43088–43099 (2018)

    Google Scholar 

  7. Bagci, I.E., Raza, S., Roedig, U., Voigt, T.: Fusion: coalesced confidential storage and communication framework for the IoT. Secur. Commun. Netw. 9(15), 2656–2673 (2016)

    Google Scholar 

  8. Bokefode, J.D., Bhise, A.S., Satarkar, P.A., Modani, D.G.: Developing a secure cloud storage system for storing IoT data by applying role based encryption. Procedia Comput. Sci. 89, 43–50 (2016)

    Google Scholar 

  9. Cai, H., Xu, B., Jiang, L., Vasilakos, A.V.: IoT-based big data storage systems in cloud computing: perspectives and challenges. IEEE Internet Things J. 4(1), 75–87 (2017)

    Google Scholar 

  10. Charalampidis, P., Tragos, E., Fragkiadakis, A.: A fog-enabled IoT platform for efficient management and data collection. Paper presented at the IEEE 22nd international workshop on computer aided modeling and design of communication links and networks (CAMAD), 2017

  11. Chen, W.-C., Chen, Y.-H., Wu, C.-L., Fu, L.-C.: An efficient data storage method of NoSQL database for HEM mobile applications in IoT. Paper presented at the Internet of Things (iThings) 2014 IEEE international conference on green computing and communications (GreenCom), IEEE and cyber, physical and social computing (CPSCom), IEEE, 2014

  12. Cooper, J., James, A.: Challenges for database management in the internet of things. IETE Tech. Rev. 26(5), 320–329 (2009)

    Google Scholar 

  13. D’silva, G.M., Thakare, S., Bharadi, V.A.: Real-time processing of IoT events using a Software as a Service (SaaS) architecture with graph database. Paper presented at the international conference 2016 on the computing communication control and automation (ICCUBEA), 2016

  14. Din, S., Paul, A.: Smart health monitoring and management system: toward autonomous wearable sensing for internet of things using big data analytics. Future Gener. Comput. Syst. 91, 611–619 (2018)

    Google Scholar 

  15. Ding, Z., Gao, X., Xu, J., Wu, H.: IOT-StatisticDB: a general statistical database cluster mechanism for big data analysis in the internet of things. Paper presented at the IEEE international conference on green computing and communications (GreenCom), 2013 IEEE and internet of things (iThings/CPSCom) and IEEE cyber, physical and social computing, 2013

  16. Fazio, M., Celesti, A., Villari, M., Puliafito, A.: The need of a hybrid storage approach for iot in paas cloud federation. Paper presented at the 28th international conference on advanced information networking and applications workshops (WAINA), 2014

  17. Fu, J., Liu, Y., Chao, H.-C., Bhargava, B., Zhang, Z.: Secure data storage and searching for industrial IoT by integrating fog computing and cloud computing. IEEE Trans. Industr. Inf. 14(10), 4519–4528 (2018)

    Google Scholar 

  18. Gogawale, A., Khatib, F., Sontakke, P., Saigaonkar, S.: Database-as-a-Service for IoT. Paper presented at the 3rd international conference on computing for sustainable global development (INDIACom), 2016

  19. Golsorkhtabaramiri, M., Issazadehkojidi, N., Pouresfehani, N., Mohammadialamoti, M., Hosseinzadehsadati, S.M.: Comparison of energy consumption for reader anti-collision protocols in dense RFID networks. Wirel. Netw. (2018). https://doi.org/10.1007/s11276-018-1670-y

    Article  Google Scholar 

  20. Gonizzi, P., Ferrari, G., Gay, V., Leguay, J.: Data dissemination scheme for distributed storage for IoT observation systems at large scale. Inf. Fus. 22, 16–25 (2015)

    Google Scholar 

  21. Gu, F., Ma, B., Guo, J., Summers, P.A., Hall, P.: Internet of things and big data as potential solutions to the problems in waste electrical and electronic equipment management: an exploratory study. Waste Manage. 68, 434–448 (2017)

    Google Scholar 

  22. Gubbi, J., Buyya, R., Marusic, S., Palaniswami, M.: Internet of things (IoT): a vision, architectural elements, and future directions. Future Gener. Comput. Syst. 29(7), 1645–1660 (2013). https://doi.org/10.1016/j.future.2013.01.010

    Article  Google Scholar 

  23. Gurav, T., Kudale, R.: DoT (Database for IoT): requirements and selection criteria. Int. J. Comput. Appl. 159(8), 975–8887 (2017)

    Google Scholar 

  24. Hamzei, M., Navimipour, N.J.: Toward efficient service composition techniques in the internet of things. IEEE Internet Things J. 5(5), 3774–3787 (2018)

    Google Scholar 

  25. Ibrahim, H., Bao, W., Nguyen, U.T.: Data rate utility analysis for uplink two-hop internet-of-things networks. IEEE Internet Things J. 6(2), 3601–3619 (2018)

    Google Scholar 

  26. Jayashree, K., Abirami, R., Babu, R.: A collaborative approach of IoT, big data, and smart city. In: Dey, N. (ed.) Big Data Analytics for Smart and Connected Cities, pp. 25–37. IGI Global, Hershey (2019)

    Google Scholar 

  27. Jeong, S., Zhang, Y., O’Connor, S., Lynch, J.P., Sohn, H., Law, K.H.: A NoSQL data management infrastructure for bridge monitoring. Smart Struct. Syst. 17(4), 669–690 (2016)

    Google Scholar 

  28. Jiang, H., Shen, F., Chen, S., Li, K.-C., Jeong, Y.-S.: A secure and scalable storage system for aggregate data in IoT. Future Gener. Comput. Syst. 49, 133–141 (2015)

    Google Scholar 

  29. Jiang, L., Da Xu, L., Cai, H., Jiang, Z., Bu, F., Xu, B.: An IoT-oriented data storage framework in cloud computing platform. IEEE Trans. Industr. Inf. 10(2), 1443–1451 (2014)

    Google Scholar 

  30. Karkouch, A., Mousannif, H., Al Moatassime, H., Noel, T.: A model-driven framework for data quality management in the Internet of Things. J. Ambient Intell. Humaniz. Comput. 9(4), 977–998 (2017)

    Google Scholar 

  31. Kim, H.-W., Jeong, Y.-S.: Efficient auto-scaling scheme for rapid storage service using many-core of desktop storage virtualization based on IoT. Neurocomputing 209, 67–74 (2016)

    Google Scholar 

  32. Ko, J., Lee, B.-B., Lee, K., Hong, S.G., Kim, N., Paek, J.: Sensor virtualization module: virtualizing iot devices on mobile smartphones for effective sensor data management. Int. J. Distrib. Sens. Netw. 11(10), 730762 (2015)

    Google Scholar 

  33. Ku, A.Y.: Anticipating critical materials implications from the Internet of Things (IOT): potential stress on future supply chains from emerging data storage technologies. Sustain. Mater. Technol. 15, 27–32 (2017)

    Google Scholar 

  34. Li, T., Liu, Y., Tian, Y., Shen, S., Mao, W.: A storage solution for massive IoT data based on NoSQL. Paper presented at the IEEE international conference on green computing and communications (GreenCom), 2012

  35. Liono, J., Jayaraman, P.P., Qin, A., Nguyen, T., Salim, F.D.: QDaS: quality driven data summarisation for effective storage management in Internet of Things. J. Parallel Distrib. Comput. 127, 196–208 (2018)

    Google Scholar 

  36. Mishra, N., Lin, C.-C., Chang, H.-T.: A cognitive adopted framework for IoT big-data management and knowledge discovery prospective. Int. J. Distrib. Sens. Netw. 11(10), 718390 (2015)

    Google Scholar 

  37. Ning, H., Belanger, D.G., Xia, Y., Piuri, V., Zomaya, A.Y.: Guest editorial special issue on big data analytics and management in Internet of things. IEEE Internet Things J. 2(4), 265–267 (2015)

    Google Scholar 

  38. Paethong, P., Sato, M., Namiki, M.: Low-power distributed NoSQL database for IoT middleware. Paper presented at the Fifth ICT international student project conference (ICT-ISPC), 2016

  39. Pashazadeh, A., Navimipour, N.J.: Big data handling mechanisms in the healthcare applications: a comprehensive and systematic literature review. J. Biomed. Inf. 82, 47–62 (2018)

    Google Scholar 

  40. Pourghebleh, B., Navimipour, N.J.: Data aggregation mechanisms in the Internet of things: a systematic review of the literature and recommendations for future research. J. Netw. Comput. Appl. 97, 23–34 (2017)

    Google Scholar 

  41. Rizzatti, L.: Digital data storage is undergoing mind-boggling growth. 14th September 2016

  42. Robinson, I., Webber, J., Eifrem, E.: Graph Databases: New Opportunities for Connected Data. O’Reilly Media, Inc., Newton (2015)

    Google Scholar 

  43. Shafagh, H., Burkhalter, L., Hithnawi, A., Duquennoy, S.: Towards blockchain-based auditable storage and sharing of IoT data. Paper presented at the proceedings of the 2017 on cloud computing security workshop, 2017

  44. Shona, M., Arathi, B.: A survey on the data management in IoT. Int. J. Sci. Tech. Adv. 2(1), 261–264 (2016)

    Google Scholar 

  45. Song, X.H.: The study on cloud storage data management method based on minimum access cost for internet of things. Paper presented at the applied mechanics and materials, 2012

  46. Sood, S.K., Sandhu, R., Singla, K., Chang, V.: IoT, big data and HPC based smart flood management framework. Sustain. Comput. Inf. Syst. 20, 102–117 (2017)

    Google Scholar 

  47. Tao, M., Ota, K., Dong, M.: Ontology-based data semantic management and application in IoT-and cloud-enabled smart homes. Future Gener. Comput. Syst. 76, 528–539 (2017)

    Google Scholar 

  48. Teing, Y.-Y., Dehghantanha, A., Choo, K.-K.R., Yang, L.T.: Forensic investigation of P2P cloud storage services and backbone for IoT networks: bitTorrent Sync as a case study. Comput. Electr. Eng. 58, 350–363 (2017)

    Google Scholar 

  49. Terroso-Saenz, F., González-Vidal, A., Ramallo-González, A.P., Skarmeta, A.F.: An open IoT platform for the management and analysis of energy data. Future Gener. Comput. Syst. 92, 1066–1079 (2017)

    Google Scholar 

  50. Terroso-Saenz, F., González-Vidal, A., Ramallo-González, A.P., Skarmeta, A.F.: An open IoT platform for the management and analysis of energy data. Future Gener. Comput. Syst. 92, 1066–1079 (2019)

    Google Scholar 

  51. Tripathi, G., Sharma, B., Rajvanshi, S.: A combination of internet of things (IoT) and graph database for future battlefield systems. Paper presented at the international conference on computing, communication and automation (ICCCA), 2017

  52. Ueta, K., Xue, X., Nakamoto, Y., Murakami, S.: A distributed graph database for the data management of IoT systems. Paper presented at the 2016 IEEE international conference on internet of things (iThings) and IEEE green computing and communications (GreenCom) and IEEE cyber, physical and social computing (CPSCom) and IEEE smart data (SmartData), 2016

  53. Urbanczyk, T., Peter, L.: Database development for the urgent department of hospital based on tagged entity storage following the IoT concept. IFAC-PapersOnLine 49(25), 278–283 (2016)

    MathSciNet  Google Scholar 

  54. Van der Veen, J.S., Van Der Waaij, B., Meijer, R.J.: Sensor data storage performance: SQL or NoSQL, physical or virtual. Paper presented at the 2012 IEEE 5th international conference on cloud computing (CLOUD), 2012

  55. Wang, F.Y., Li, G., Du, L. M., Han, Z.Y.: Elementary discussion on data management of the internet of things. Paper presented at the advanced materials research, 2012

  56. Wang, H.Z., Lin, G.W., Wang, J.Q., Gao, W.L., Chen, Y.F., Duan, Q.L.: Management of big data in the internet of things in agriculture based on cloud computing. Paper presented at the applied mechanics and materials, 2014

  57. Wang, W., Xu, P., Yang, L.T.: Secure data collection, storage and access in cloud-assisted IoT. IEEE Cloud Comput. 5(4), 77–88 (2018)

    Google Scholar 

  58. Witkowski, K.: Internet of things, big data, industry 4.0–innovative solutions in logistics and supply chains management. Proced. Eng. 182, 763–769 (2017)

    Google Scholar 

  59. Wu, D., Shi, H., Wang, H., Wang, R., Fang, H.: A feature-based learning system for internet of things applications. IEEE Internet Things J. 6(2), 1928–1937 (2018)

    Google Scholar 

  60. Yang, Y., Zheng, X., Guo, W., Liu, X., Chang, V.: Privacy-preserving smart IoT-based healthcare big data storage and self-adaptive access control system. Inf. Sci. 479, 567–592 (2018)

    Google Scholar 

  61. Yang, Y., Zheng, X., Tang, C.: Lightweight distributed secure data management system for health Internet of Things. J. Netw. Comput. Appl. 89, 26–37 (2017)

    Google Scholar 

  62. Yassine, A., Singh, S., Hossain, M.S., Muhammad, G.: IoT big data analytics for smart homes with fog and cloud computing. Future Gener. Comput. Syst. 91, 563–573 (2019)

    Google Scholar 

  63. Zhao, X., Lucani, D.E., Shen, X., Wang, H.: Reliable IoT storage: minimizing bandwidth use in storage without newcomer nodes. IEEE Commun. Lett. 22(7), 1462–1465 (2018)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Computer Engineering, Science and Research Branch, Islamic Azad University, Tehran, Iran

    Poopak Azad, Amir Masoud Rahmani & Arash Sharifi

  2. Department of Computer Engineering, Tabriz Branch, Islamic Azad University, Tabriz, Iran

    Nima Jafari Navimipour

Authors
  1. Poopak Azad
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Nima Jafari Navimipour
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Amir Masoud Rahmani
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Arash Sharifi
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Nima Jafari Navimipour.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Azad, P., Navimipour, N.J., Rahmani, A.M. et al. The role of structured and unstructured data managing mechanisms in the Internet of things. Cluster Comput 23, 1185–1198 (2020). https://doi.org/10.1007/s10586-019-02986-2

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10586-019-02986-2

Keywords

Search

Navigation