Skip to main content
Log in

Advanced centralized and distributed SVM models over different IoT levels for edge layer intelligence and control

  • Research Paper
  • Published:
Evolutionary Intelligence Aims and scope Submit manuscript

Abstract

In this era, internet-of-things (IoT) deal with billions of edge devices potentially connected to each other. Maximum applications built on these edge devices generate a massive amount of online data and also require real-time computation and decision making with low latency (e.g., robotics/ drones, self-driving cars, smart IoT, electronics/ wearable devices). To suffice the requirement, the future generation intelligent edge devices need to be capable of computing complex machine learning algorithms on live data in real-time. Considering different layers of IoT and distributed computing concept, this paper suggests three different operational models where the ML algorithm will be executed in a distributed manner between the edge and cloud layer of IoT so that the edge node can take a decision in real-time. The three models are; model 1: training and prediction both will be done locally by the edge, model 2: training at the server and decision making at the edge node, and model 3: distributed training and distributed decision making at the edge level with global shared knowledge and security. All three models have been tested using support vector machine using thirteen diverse datasets to profile their performance in terms of both training and inference time. A comparative study between the computational performance of the edge and cloud nodes is also presented here. Through the simulated experiments using the different datasets, it is observed that, the edge node inference time is approximately ten times faster than cloud time for all tested datasets for each proposed model. At the same time, the model 2 training time is approximately nine times faster than model 1 and eleven times faster than model 3.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13

Similar content being viewed by others

References

  1. (2018) 21 big data statistics and predictions on the future of big data. https://www.newgenapps.com/blog/big-data-statistics-predictions-on-the-future-of-big-data, www.newgenapps.com

  2. Bogue R (2014) Towards the trillion sensors market. Sens Rev 34(2):137–142

    Article  Google Scholar 

  3. Inc. E (2010) Ceo to shareholders: 50 billion connections 2020. https://www.ericsson.com/en/press-releases/2010/4/ceo-to-shareholders-50-billion-connections-2020

  4. Evans D (2011) The internet of things: How the next evolution of the internet is changing everything. CISCO White Pap 1(2011):1–11

    Google Scholar 

  5. Index CGC (2018) Forecast and methodology, 2016–2021 white paper. Updated: February, vol 1

  6. Linthicum D (2016) Responsive data architecture for the internet of things. IEEE Ann Hist Comput 49(10):72–75

    Article  Google Scholar 

  7. Lin J, Yu W, Zhang N, Yang X, Zhang H, Zhao W (2017) A survey on internet of things: architecture, enabling technologies, security and privacy, and applications. IEEE IoT J 4(5):1125–1142

    Google Scholar 

  8. Stankovic JA (2014) Research directions for the internet of things. IEEE IoT J 1(1):3–9

    Google Scholar 

  9. Wu J, Zhao W (2016) Design and realization of winternet: from net of things to internet of things. ACM Trans Cyber Phys Syst 1(1):1–12

    Article  Google Scholar 

  10. Yu W, Liang F, He X, Hatcher WG, Lu C, Lin J, Yang X (2017) A survey on the edge computing for the internet of things. IEEE Access 6:6900–6919

    Article  Google Scholar 

  11. Pan J, McElhannon J (2017) Future edge cloud and edge computing for internet of things applications. IEEE IoT J 5(1):439–449

    Google Scholar 

  12. Oculus (2016) Oculus rift helmet: next generation virtual reality. https://www3.oculus.com/en-us/rift/

  13. Google (2016) Nest iot devices. https://nest.com/

  14. enterprise I (2018) Edge computing and the future of machine learning. https://channels.theinnovationenterprise.com/articles/why-machine-learning-needs-edge-computing

  15. Forero PA, Cano A, Giannakis GB (2010) Consensus-based distributed support vector machines. J Mach Learn Res 11(5):28

    MathSciNet  MATH  Google Scholar 

  16. Mateos G, Bazerque JA, Giannakis GB (2010) Distributed sparse linear regression. IEEE Trans Signal Process 58(10):5262–5276

    Article  MathSciNet  Google Scholar 

  17. Hakim AE (2018) Internet of things (IoT) system architecture and technologies, pp 0–5

  18. Stolpe M, Bhaduri K, Das K (2016) Distributed support vector machines: an overview. In: Solving large scale learning tasks. Challenges and algorithms, Springer, pp 109–138

  19. Hall M, Frank E, Holmes G, Pfahringer B, Reutemann P, Witten IH (2009) The weka data mining software: an update. ACM SIGKDD Explor Newslett 11(1):10–18

    Article  Google Scholar 

  20. Dua D, Graff C (2019) Uci machine learning repository, vol 37. http://archive.ics.uci.edu/ml

  21. Patttanayak AS, Pattnaik BS, Panda BN (2014) Implementation of a smart grid system to remotely monitor, control and schedule energy sources using android based mobile devices. In: 2014 9th international conference on industrial and information systems (ICIIS). IEEE, pp 1–5

  22. Dalai I, Mudali P, Pattanayak AS, Pattnaik BS (2019) Hourly prediction of load using edge intelligence over IoT. In: 2019 11th international conference on advanced computing (ICoAC). IEEE, pp 117–121

  23. Cristianini N, Shawe-Taylor J et al (2000) An introduction to support vector machines and other kernel-based learning methods. Cambridge University Press, Cambridge

    Book  Google Scholar 

  24. Zeng Z-Q, Yu H-B, Xu H-R, Xie Y-Q, Gao J (2008) Fast training support vector machines using parallel sequential minimal optimization. In: 2008 3rd international conference on intelligent system and knowledge engineering, vol 1. IEEE, pp 997–1001

  25. Haigh KZ, Mackay AM, Cook MR, Lin LG (2015) Machine learning for embedded systems: a case study. BBN Technologies: Cambridge, MA, USA. https://www.cs.cmu.edu/afs/cs/user/khaigh/www/papers/2015-HaighTechReport-Embedded.pdf

  26. Ben-Hur A, Weston J (2010) A user’s guide to support vector machines. In: Data mining techniques for the life sciences, Springer, pp 223–239

  27. Joachims T (1999) Svmlight: support vector machine. SVM-Light Support Vector Machine, University of Dortmund, vol 19, No 4. http://svmlight.joachims.org/

  28. Chang C-C, Lin C-J (2011) Libsvm: a library for support vector machines. ACM Trans Intell Syst Technol 2(3):1–27

    Article  Google Scholar 

  29. Xu Y (2016) Recent machine learning applications to internet of things (IoT). Recent advances in networking. http://www.cse.wustl.edu/~jain/cse570-15/index.html

  30. Mahdavinejad MS, Rezvan M, Barekatain M, Adibi P, Barnaghi P, Sheth AP (2018) Machine learning for internet of things data analysis: a survey. Dig Commun Netw 4(3):161–175

    Article  Google Scholar 

  31. Moallem P, Razmjooy N, Ashourian M (2013) Computer vision-based potato defect detection using neural networks and support vector machine. Int J Robot Autom 28(2):137–145

    Google Scholar 

  32. Razmjooy N, Estrela VV, Loschi HJ (2019) A study on metaheuristic-based neural networks for image segmentation purposes. In: Data science. CRC Press, pp 25–49

  33. Razmjooy N, Mousavi BS, Soleymani F, Khotbesara MH (2013) A computer-aided diagnosis system for malignant melanomas. Neural Comput Appl 23(7–8):2059–2071

    Article  Google Scholar 

  34. Razmjooy N, Ashourian M, Karimifard M, Estrela VV, Loschi HJ, do Nascimento D, França RP Vishnevski (2020) Computer-aided diagnosis of skin cance: a review. Curr Med Imag 5:1669

    Google Scholar 

  35. Systems C (2015) Fog computing and the internet of things: extend the cloud to where the things are

  36. Vasant P, Zelinka I, Weber G-W (2020) Intelligent computing and optimization, vol 1072, Springer. https://www.springer.com/gp/book/9783030335847

  37. Rahmani AM, Gia TN, Negash B, Anzanpour A, Azimi I, Jiang M, Liljeberg P (2018) Exploiting smart e-health gateways at the edge of healthcare internet-of-things: a fog computing approach. Fut Gener Comput Syst 78:641–658

    Article  Google Scholar 

  38. Krishnamoorthy M, Suresh S, Alagappan S et al (2020) Deep learning techniques and optimization strategies in big data analytics: automated transfer learning of convolutional neural networks using enas algorithm. In: Deep learning techniques and optimization strategies in big data analytics. IGI Global, pp 142–153

  39. Vasant P, Zelinka I, Weber G-W (2019) Intelligent computing and optimization, vol 866. Springer. https://www.springer.com/gp/book/9783030009786

  40. Kargupta H, Park B-H, Pittie S, Liu L, Kushraj D, Sarkar K (2002) Mobimine: monitoring the stock market from a PDA. ACM SIGKDD Explor Newslett 3(2):37–46

    Article  Google Scholar 

  41. Kargupta H, Bhargava R, Liu K, Powers M, Blair P, Bushra S, Dull J, Sarkar K, Klein M, Vasa M, et al (2004) Vedas: a mobile and distributed data stream mining system for real-time vehicle monitoring. In: Proceedings of the 2004 SIAM international conference on data mining. SIAM, pp 300–311

  42. Gaber MM, Philip SY (2006) A holistic approach for resource-aware adaptive data stream mining. New Gener Comput 25(1):95–115

    Article  Google Scholar 

  43. Gaber MM (2009) Data stream mining using granularity-based approach. In: Foundations of computational, intelligence, vol 6, pp 47–66, Springer

  44. Gaber MM, Gomes JB, Stahl F (2014) Pocket data mining. Big data on small devices. Series: Studies in Big Data

  45. Li H, Ota K, Dong M (2018) Learning iot in edge: deep learning for the internet of things with edge computing. IEEE Netw 32(1):96–101

    Article  Google Scholar 

  46. Howard AG, Zhu M, Chen B, Kalenichenko D, Wang W, Weyand T, Andreetto M, Adam H (2017) Mobilenets: Efficient convolutional neural networks for mobile vision applications. arXiv:1704.04861

  47. Yazici MT, Basurra S, Gaber MM (2018) Edge machine learning: Enabling smart internet of things applications. Big Data Cognit Comput 2(3):26

    Article  Google Scholar 

  48. Pattanayak A, Pattnaik B, Udgata S, Panda A (2020) Development of chemical oxygen on demand (cod) soft sensor using edge intelligence. IEEE Sens J PP:1–1

    Google Scholar 

  49. Sahoo AK, Udgata SK (2020) A novel ann-based adaptive ultrasonic measurement system for accurate water level monitoring. IEEE Trans Instrum Meas 69(6):3359–3369

    Article  Google Scholar 

  50. Chauhan AA, Udgata SK (2020) Data aggregation using difference transfer for load reduction in periodic sensor networks. Springer Wireless Personal Communications. https://doi.org/10.1007/s11277-020-07640-4

  51. Üstün B, Melssen WJ, Buydens LM (2006) Facilitating the application of support vector regression by using a universal pearson vii function based kernel. Chemometr Intell Lab Syst 81(1):29–40

    Article  Google Scholar 

  52. Nguyen L, Riquelme C, Schmit S (2015) Cascading vector machines cme 323 project. https://web.stanford.edu/~rezab/classes/cme323/S15/projects/cascading_vector_machines_report.pdf

  53. Richardson L, Ruby S (2008) RESTful web services. O’Reilly Media Inc, London

    Google Scholar 

Download references

Acknowledgements

This research is partially supported by WOS-A of Department of Science and Technology, DST, Govt. of India

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Ajit Kumar Panda.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Pattnaik, B.S., Pattanayak, A.S., Udgata, S.K. et al. Advanced centralized and distributed SVM models over different IoT levels for edge layer intelligence and control. Evol. Intel. 15, 481–495 (2022). https://doi.org/10.1007/s12065-020-00524-3

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12065-020-00524-3

Keywords

Navigation