Skip to main content
Log in

Price Versus Performance of Big Data Analysis for Cloud Based Internet of Things Networks

  • Published:
Mobile Networks and Applications Aims and scope Submit manuscript

Abstract

Many devices share their data with the online world to derive global knowledge and information that have high business value. Trillions of smart devices are connected together over the Internet, which are known as Internet-of-Things (IoT). These devices generate enormous data on daily basis, in orders of Exabytes, which is called Big Data. Since cloud services are used to handle the Big Data generated from these IoT devices, new architectures for handling smart devices are designed through cloud enabled IoT networks. In this paper, we discuss in detail the issues of handling Big Data from an operational perspective in this new cloud based IoT network architecture. We tackle the incurred price and overall efficiency for storing and analyzing data for these networks on periodical basis. We propose an optimization model that address the price versus performance while carrying out Big Data analysis in these cloud based IoT networks.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

References

  1. Mehmood Y, Ahmad F, Yaqoob I, Adnane A, Imran M, Guizani S (2017) Internet-of-things-based smart cities: recent advances and challenges. IEEE Commun Mag 55(9):16–24

    Article  Google Scholar 

  2. Xu LD, He W, Li S (2014) Internet of things in industries: a survey. IEEE Trans Ind Inf 10(4):2233–2243

    Article  Google Scholar 

  3. Cecchinel C, Jimenez M, Mosser S, Riveill M (2014) An architecture to support the collection of big data in the internet of things. In: proceedings of IEEE World Congress on Services (SERVICES), pp 442–449

  4. Lin J, Yu W, Zhang N, Yang X, Zhang H, Zhao W (2017) A survey on internet of things: architecture, enabling technologies, security and privacy, and applications. IEEE Internet Things J 4(5):1125–1142

    Article  Google Scholar 

  5. Siegel JE, Kumar S, Sarma SE (2017) The future internet of things: secure, efficient, and model-based. IEEE Internet Things J PP(99):1–1

    Google Scholar 

  6. Stankovic JA (2014) Research directions for the internet of things. IEEE Internet Things J 1(1):3–9

    Article  MathSciNet  Google Scholar 

  7. Ortiz AM, Hussein D, Park S, Han SN, Crespi N (2014) The cluster between internet of things and social networks: review and research challenges. IEEE Internet Things J 1(3):206–215

    Article  Google Scholar 

  8. Nitti M, Girau R, Atzori L (2014) Trustworthiness management in the social internet of things. IEEE Trans Knowl Data Eng 26(5):1253–1266

    Article  Google Scholar 

  9. Zanella A, Bui N, Castellani A, Vangelista L, Zorzi M (2014) Internet of things for smart cities. IEEE Internet Things J 1(1):22–32

    Article  Google Scholar 

  10. Atzori L, Iera A, Morabito G (2011) Siot: giving a social structure to the internet of things. IEEE Commun Lett 15(11):1193–1195

    Article  Google Scholar 

  11. Liu J, Liu F, Ansari N (2014) Monitoring and analyzing big traffic data for large-scale cellular network with hadoop. IEEE Netw 28(4):32–39

    Article  Google Scholar 

  12. Hu H, Wen Y, Chua T-S, Li X (2014) Toward scalable systems for big data analytics: a technology tutorial. IEEE Access 2:652– 687

    Article  Google Scholar 

  13. Ranjan R (2014) Streaming big data processing in datacenter clouds. IEEE Cloud Comput 1(1):78–83

    Article  Google Scholar 

  14. Yi X, Liu F, Liu J, Jin H (2014) Building a network highway for big data: Architecture and challenges. IEEE Netw 28(4):5–13

    Article  Google Scholar 

  15. Gurumurthi S (2009) Architecting storage for the cloud computing era. IEEE Micro 29(6):68–71

    Article  Google Scholar 

  16. Suto K, Nishiyama H, Kato N, Mizutani K, Akashi O, Takahara A (2014) An overlay-based data mining architecture tolerant to physical network disruptions. IEEE Trans Emerg Top Comput 2(3):292–301

    Article  Google Scholar 

  17. Amendola S, Lodato R, Manzari S, Occhiuzzi C, Marrocco G (2014) RFID Technology for IoT-based personal healthcare in smart spaces. IEEE Internet Things J 1(2):144–152

    Article  Google Scholar 

  18. Sheng Z, Yang S, Yu Y, Vasilakos AV, Mccann JA, Leung KK (2013) A survey on the IETF protocol suite for the internet of things: standards, challenges, and opportunities. IEEE Wirel Commun 20(6):91–98

    Article  Google Scholar 

  19. Spiess J, TJoens Y, dragnea R, Spencer P, Philippart L (2014) Using big data to improve customer experience and business performance. Bell Labs Techn J 18(4):3–17

    Article  Google Scholar 

  20. Tsai C-W, Lai C-F, Chiang M-C, Yang LT (2014) Data mining for internet of things: a survey. IEEE Commun Surv Tutorials 16(1):77–97

    Article  Google Scholar 

  21. Wallace TD, Meerja KA, Shami A (2015) On-demand scheduling for concurrent multipath transfer using the stream control transmission protocol. J Netw Comput Appl 47:11–22

    Article  Google Scholar 

  22. Wallace TD, Shami A (2014) Concurrent multipath transfer using SCTP: modelling and congestion window management. IEEE Trans Mob Comput 13(11):2510–2523

    Article  Google Scholar 

  23. Dechene DJ, Shami A (2014) Energy-Aware Resource allocation strategies for LTE uplink with synchronous HARQ constraints. IEEE Trans Mob Comput 13(2):422–433

    Article  Google Scholar 

  24. Kalil M, Shami A, Al-Dweik, A (2015) QoS-Aware Power-Efficient Scheduler for LTE Uplink. IEEE Trans Mob Comput PP(99):1–1

    Google Scholar 

  25. Kotval XP, Burns MJ (2013) Visualization of entities within social media: toward understanding users needs. Bell Labs Tech J 17(4):77–102

    Article  Google Scholar 

  26. Jiang L, Xu LD, Cai H, Jiang Z, Bu F, Xu B (2014) An iot-oriented data storage framework in cloud computing platform. IEEE Trans Ind Inform 10(2):1443–1451

    Article  Google Scholar 

  27. Tao F, Cheng Y, Xu LD, Zhang L, Li BH (2014) Cciot-cmfg: cloud computing and internet of things-based cloud manufacturing service system. IEEE Trans Ind Inform 10(2):1435–1442

    Article  Google Scholar 

  28. Zheng X, Martin P, Brohman K, Xu LD (2014) Cloud service negotiation in internet of things environment: a mixed approach. IEEE Trans Ind Inform 10(2):1506–1515

    Article  Google Scholar 

  29. Zheng X, Martin P, Brohman K, Xu LD (2014) Cloudqual: a quality model for cloud services. IEEE Trans Ind Inform 10(2):1527–1536

    Article  Google Scholar 

  30. Jammal M, Singh T, Shami A, Asal R, Li Y (2014) Software-defined networking: state of the art and research challenges. Comput Netw 72(0):74–98

    Article  Google Scholar 

  31. Hawilo H, Shami A, Mirahmadi M, Asal R (2014) Nfv: state of the art, challenges and implementation in next generation mobile networks (vepc). IEEE Netw Mag 28(6):18–26

    Article  Google Scholar 

  32. Sharkh MA, Jammal M, Shami A, Ouda A (2013) Resource allocation in a network-based cloud computing environment: design challenges. IEEE Commun Mag 51(11):46–52

    Article  Google Scholar 

  33. Sai V, Mickle MH (2014) Exploring energy efficient architectures in passive wireless nodes for iot applications. IEEE Circ Syst Mag 14(2):48–54

    Article  Google Scholar 

  34. Meerja KA, Shami A, Refaey A (2015) Hailing cloud empowered radio access networks. IEEE Wirel Commun 22(1):122–129

    Article  Google Scholar 

  35. Patikirikorala T, Colman A, Han J, Wang L (2012) A systematic survey on the design of self-adaptive software systems using control engineering approaches. In: 2012 ICSE Workshop on Software Engineering for Adaptive and Self-Managing Systems (SEAMS), pp 33–42

  36. Lee G, Tolia N, Ranganathan P, Katz RH (2011) Topology-aware resource allocation for data-intensive workloads. SIGCOMM Comput Commun Rev 41(1):120–124

    Article  Google Scholar 

  37. Lama P, Zhou X (2012) Aroma: automated resource allocation and configuration of mapreduce environment in the cloud. In: Proceedings of the 9th International Conference on Autonomic Computing, pp 63–72

  38. Verma A, Cherkasova L, Campbell RH (2011) Aria: automatic resource inference and allocation for mapreduce environments. In: Proceedings of the 8th ACM International Conference on Autonomic Computing, pp 235–244

  39. Kambatla K, Pathak A, Pucha H (2009) Towards optimizing hadoop provisioning in the cloud. In: Proceedings of the 2009 Conference on Hot Topics in Cloud Computing, pp 1–5

  40. Alrokayan M, Vahid Dastjerdi A, Buyya R (2014) Sla-aware provisioning and scheduling of cloud resources for big data analytics. In: 2014 IEEE International Conference on Cloud Computing in Emerging Markets (CCEM), pp 1–8

  41. Cidon A, Stutsman R, Rumble S, Katti S, Ousterhout J, Rosenblum M (2013) Mincopysets: derandomizing replication in cloud storage. In: Proceedings of 10th USENIX Symposium NSDI, pp 1–5

  42. Shachnai H, Tamir G, Tamir T (2012) Minimal cost reconfiguration of data placement in a storage area network. Theor Comput Sci 460:42–53

    Article  MathSciNet  MATH  Google Scholar 

  43. Agarwal S, Dunagan J, Jain N, Saroiu S, Wolman A, Bhogan H (2010) Volley: automated data placement for geo-distributed cloud services. In: Proceedings of the 7th USENIX Conference on Networked Systems Design and Implementation, pp 2–2

  44. Gu L, Zeng D, Li P, Guo S (2014) Cost minimization for big data processing in geo-distributed data centers. IEEE Trans Emerg Top Comput 2(3):314–323

    Article  Google Scholar 

  45. Wang W, Zhao Y, Chen H, Zhang J, Zheng H, Lin Y, Lee Y (2017) Re-provisioning of advance reservation applications in elastic optical networks. IEEE Access 5:10959–10967

    Article  Google Scholar 

  46. Simhon E, Starobinski D (2016) A game-theoretic perspective on advance reservations. IEEE Netw 30(2):6–11

    Article  MATH  Google Scholar 

  47. Bai H, Gu F, Shaban K, Crichigno J, Khan S, Ghani N (2015) Flexible advance reservation models for virtual network scheduling. In: 2015 IEEE 40th Local Computer Networks Conference Workshops (LCN Workshops), pp 651–656

  48. Pfitzer K Sequential processing in the age of big data, http://www1.lehigh.edu/news/sequential-processing-age-big-data, [Accessed: 2017]

  49. TechTarget, Parallel processing in multiproviders, http://searchsap.techtarget.com/quiz/11-Parallel-processing-in-Multiproviders, [Accessed: 2017]

  50. Feblowitz J (2012) Unleashing the power of big data in the utilities industry, Technical report. IDC Energy Insights

  51. DOMO, The physical size of big data, https://www.domo.com/learn/infographic-the-physical-size-of-big-data, [Accessed: 2017]

  52. Beal V Revolution analytics - big data analytics software, http://www.webopedia.com/TERM/R/revolution_analytics_big_data_analytics_software.html, [Accessed: 2017]

  53. Wolfe J, Haghighi AD, Klein D (2008) Fully distributed em for very large datasets. In: Proceedings of the 25th International Conference on Machine Learning, pp 1–8

  54. Markl V (2014) Breaking the chains: On declarative data analysis and data independence in the big data era. In: Proceedings of the VLDB Endowment, vol 7, pp 1730–1733

  55. Bilmes J (2015) Summarizing large data sets, IACS Seminar Series, http://www.seas.harvard.edu/calendar/event/81901, [Accessed: 2015]

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Khalim Amjad Meerja.

Additional information

This work is partially supported by the Natural Sciences and Engineering Research Council of Canada (NSERC-STPGP 447230).

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Meerja, K.A., Naidu, P.V. & Kalva, S.R.K. Price Versus Performance of Big Data Analysis for Cloud Based Internet of Things Networks. Mobile Netw Appl 24, 1078–1094 (2019). https://doi.org/10.1007/s11036-018-1063-6

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11036-018-1063-6

Keywords

Navigation