Abstract
Many devices share their data with the online world to derive global knowledge and information that have high business value. Trillions of smart devices are connected together over the Internet, which are known as Internet-of-Things (IoT). These devices generate enormous data on daily basis, in orders of Exabytes, which is called Big Data. Since cloud services are used to handle the Big Data generated from these IoT devices, new architectures for handling smart devices are designed through cloud enabled IoT networks. In this paper, we discuss in detail the issues of handling Big Data from an operational perspective in this new cloud based IoT network architecture. We tackle the incurred price and overall efficiency for storing and analyzing data for these networks on periodical basis. We propose an optimization model that address the price versus performance while carrying out Big Data analysis in these cloud based IoT networks.
Similar content being viewed by others
References
Mehmood Y, Ahmad F, Yaqoob I, Adnane A, Imran M, Guizani S (2017) Internet-of-things-based smart cities: recent advances and challenges. IEEE Commun Mag 55(9):16–24
Xu LD, He W, Li S (2014) Internet of things in industries: a survey. IEEE Trans Ind Inf 10(4):2233–2243
Cecchinel C, Jimenez M, Mosser S, Riveill M (2014) An architecture to support the collection of big data in the internet of things. In: proceedings of IEEE World Congress on Services (SERVICES), pp 442–449
Lin J, Yu W, Zhang N, Yang X, Zhang H, Zhao W (2017) A survey on internet of things: architecture, enabling technologies, security and privacy, and applications. IEEE Internet Things J 4(5):1125–1142
Siegel JE, Kumar S, Sarma SE (2017) The future internet of things: secure, efficient, and model-based. IEEE Internet Things J PP(99):1–1
Stankovic JA (2014) Research directions for the internet of things. IEEE Internet Things J 1(1):3–9
Ortiz AM, Hussein D, Park S, Han SN, Crespi N (2014) The cluster between internet of things and social networks: review and research challenges. IEEE Internet Things J 1(3):206–215
Nitti M, Girau R, Atzori L (2014) Trustworthiness management in the social internet of things. IEEE Trans Knowl Data Eng 26(5):1253–1266
Zanella A, Bui N, Castellani A, Vangelista L, Zorzi M (2014) Internet of things for smart cities. IEEE Internet Things J 1(1):22–32
Atzori L, Iera A, Morabito G (2011) Siot: giving a social structure to the internet of things. IEEE Commun Lett 15(11):1193–1195
Liu J, Liu F, Ansari N (2014) Monitoring and analyzing big traffic data for large-scale cellular network with hadoop. IEEE Netw 28(4):32–39
Hu H, Wen Y, Chua T-S, Li X (2014) Toward scalable systems for big data analytics: a technology tutorial. IEEE Access 2:652– 687
Ranjan R (2014) Streaming big data processing in datacenter clouds. IEEE Cloud Comput 1(1):78–83
Yi X, Liu F, Liu J, Jin H (2014) Building a network highway for big data: Architecture and challenges. IEEE Netw 28(4):5–13
Gurumurthi S (2009) Architecting storage for the cloud computing era. IEEE Micro 29(6):68–71
Suto K, Nishiyama H, Kato N, Mizutani K, Akashi O, Takahara A (2014) An overlay-based data mining architecture tolerant to physical network disruptions. IEEE Trans Emerg Top Comput 2(3):292–301
Amendola S, Lodato R, Manzari S, Occhiuzzi C, Marrocco G (2014) RFID Technology for IoT-based personal healthcare in smart spaces. IEEE Internet Things J 1(2):144–152
Sheng Z, Yang S, Yu Y, Vasilakos AV, Mccann JA, Leung KK (2013) A survey on the IETF protocol suite for the internet of things: standards, challenges, and opportunities. IEEE Wirel Commun 20(6):91–98
Spiess J, TJoens Y, dragnea R, Spencer P, Philippart L (2014) Using big data to improve customer experience and business performance. Bell Labs Techn J 18(4):3–17
Tsai C-W, Lai C-F, Chiang M-C, Yang LT (2014) Data mining for internet of things: a survey. IEEE Commun Surv Tutorials 16(1):77–97
Wallace TD, Meerja KA, Shami A (2015) On-demand scheduling for concurrent multipath transfer using the stream control transmission protocol. J Netw Comput Appl 47:11–22
Wallace TD, Shami A (2014) Concurrent multipath transfer using SCTP: modelling and congestion window management. IEEE Trans Mob Comput 13(11):2510–2523
Dechene DJ, Shami A (2014) Energy-Aware Resource allocation strategies for LTE uplink with synchronous HARQ constraints. IEEE Trans Mob Comput 13(2):422–433
Kalil M, Shami A, Al-Dweik, A (2015) QoS-Aware Power-Efficient Scheduler for LTE Uplink. IEEE Trans Mob Comput PP(99):1–1
Kotval XP, Burns MJ (2013) Visualization of entities within social media: toward understanding users needs. Bell Labs Tech J 17(4):77–102
Jiang L, Xu LD, Cai H, Jiang Z, Bu F, Xu B (2014) An iot-oriented data storage framework in cloud computing platform. IEEE Trans Ind Inform 10(2):1443–1451
Tao F, Cheng Y, Xu LD, Zhang L, Li BH (2014) Cciot-cmfg: cloud computing and internet of things-based cloud manufacturing service system. IEEE Trans Ind Inform 10(2):1435–1442
Zheng X, Martin P, Brohman K, Xu LD (2014) Cloud service negotiation in internet of things environment: a mixed approach. IEEE Trans Ind Inform 10(2):1506–1515
Zheng X, Martin P, Brohman K, Xu LD (2014) Cloudqual: a quality model for cloud services. IEEE Trans Ind Inform 10(2):1527–1536
Jammal M, Singh T, Shami A, Asal R, Li Y (2014) Software-defined networking: state of the art and research challenges. Comput Netw 72(0):74–98
Hawilo H, Shami A, Mirahmadi M, Asal R (2014) Nfv: state of the art, challenges and implementation in next generation mobile networks (vepc). IEEE Netw Mag 28(6):18–26
Sharkh MA, Jammal M, Shami A, Ouda A (2013) Resource allocation in a network-based cloud computing environment: design challenges. IEEE Commun Mag 51(11):46–52
Sai V, Mickle MH (2014) Exploring energy efficient architectures in passive wireless nodes for iot applications. IEEE Circ Syst Mag 14(2):48–54
Meerja KA, Shami A, Refaey A (2015) Hailing cloud empowered radio access networks. IEEE Wirel Commun 22(1):122–129
Patikirikorala T, Colman A, Han J, Wang L (2012) A systematic survey on the design of self-adaptive software systems using control engineering approaches. In: 2012 ICSE Workshop on Software Engineering for Adaptive and Self-Managing Systems (SEAMS), pp 33–42
Lee G, Tolia N, Ranganathan P, Katz RH (2011) Topology-aware resource allocation for data-intensive workloads. SIGCOMM Comput Commun Rev 41(1):120–124
Lama P, Zhou X (2012) Aroma: automated resource allocation and configuration of mapreduce environment in the cloud. In: Proceedings of the 9th International Conference on Autonomic Computing, pp 63–72
Verma A, Cherkasova L, Campbell RH (2011) Aria: automatic resource inference and allocation for mapreduce environments. In: Proceedings of the 8th ACM International Conference on Autonomic Computing, pp 235–244
Kambatla K, Pathak A, Pucha H (2009) Towards optimizing hadoop provisioning in the cloud. In: Proceedings of the 2009 Conference on Hot Topics in Cloud Computing, pp 1–5
Alrokayan M, Vahid Dastjerdi A, Buyya R (2014) Sla-aware provisioning and scheduling of cloud resources for big data analytics. In: 2014 IEEE International Conference on Cloud Computing in Emerging Markets (CCEM), pp 1–8
Cidon A, Stutsman R, Rumble S, Katti S, Ousterhout J, Rosenblum M (2013) Mincopysets: derandomizing replication in cloud storage. In: Proceedings of 10th USENIX Symposium NSDI, pp 1–5
Shachnai H, Tamir G, Tamir T (2012) Minimal cost reconfiguration of data placement in a storage area network. Theor Comput Sci 460:42–53
Agarwal S, Dunagan J, Jain N, Saroiu S, Wolman A, Bhogan H (2010) Volley: automated data placement for geo-distributed cloud services. In: Proceedings of the 7th USENIX Conference on Networked Systems Design and Implementation, pp 2–2
Gu L, Zeng D, Li P, Guo S (2014) Cost minimization for big data processing in geo-distributed data centers. IEEE Trans Emerg Top Comput 2(3):314–323
Wang W, Zhao Y, Chen H, Zhang J, Zheng H, Lin Y, Lee Y (2017) Re-provisioning of advance reservation applications in elastic optical networks. IEEE Access 5:10959–10967
Simhon E, Starobinski D (2016) A game-theoretic perspective on advance reservations. IEEE Netw 30(2):6–11
Bai H, Gu F, Shaban K, Crichigno J, Khan S, Ghani N (2015) Flexible advance reservation models for virtual network scheduling. In: 2015 IEEE 40th Local Computer Networks Conference Workshops (LCN Workshops), pp 651–656
Pfitzer K Sequential processing in the age of big data, http://www1.lehigh.edu/news/sequential-processing-age-big-data, [Accessed: 2017]
TechTarget, Parallel processing in multiproviders, http://searchsap.techtarget.com/quiz/11-Parallel-processing-in-Multiproviders, [Accessed: 2017]
Feblowitz J (2012) Unleashing the power of big data in the utilities industry, Technical report. IDC Energy Insights
DOMO, The physical size of big data, https://www.domo.com/learn/infographic-the-physical-size-of-big-data, [Accessed: 2017]
Beal V Revolution analytics - big data analytics software, http://www.webopedia.com/TERM/R/revolution_analytics_big_data_analytics_software.html, [Accessed: 2017]
Wolfe J, Haghighi AD, Klein D (2008) Fully distributed em for very large datasets. In: Proceedings of the 25th International Conference on Machine Learning, pp 1–8
Markl V (2014) Breaking the chains: On declarative data analysis and data independence in the big data era. In: Proceedings of the VLDB Endowment, vol 7, pp 1730–1733
Bilmes J (2015) Summarizing large data sets, IACS Seminar Series, http://www.seas.harvard.edu/calendar/event/81901, [Accessed: 2015]
Author information
Authors and Affiliations
Corresponding author
Additional information
This work is partially supported by the Natural Sciences and Engineering Research Council of Canada (NSERC-STPGP 447230).
Rights and permissions
About this article
Cite this article
Meerja, K.A., Naidu, P.V. & Kalva, S.R.K. Price Versus Performance of Big Data Analysis for Cloud Based Internet of Things Networks. Mobile Netw Appl 24, 1078–1094 (2019). https://doi.org/10.1007/s11036-018-1063-6
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11036-018-1063-6