Skip to main content

Advertisement

SpringerLink
Log in

Decision-making for the anomalies in IIoTs based on 1D convolutional neural networks and Dempster–Shafer theory (DS-1DCNN)

  • Published:
The Journal of Supercomputing Aims and scope Submit manuscript

Abstract

The main motivation of the Internet of Things (IoT) is to enable everyday physical objects to sense and process data and communicate with other objects. Its applications in industry are called industrial Internet of Things (IIoTs) or Industry 4.0. One of the main goals of the IIoT is to automatically monitor and detect unexpected events, changes, and alterations to the collected data. Anomaly detection includes all techniques that identify data patterns deviating from the expected behavior. Deep learning (DL) can search for a specific relationship in billions of corporate IoT data and reach a meaningful goal by analyzing and classifying collected data, leading to making the right decisions. The realization of the IoT is entirely dependent on making the proper decisions. However, the conventional methods for processing voluminous IIoT data are not qualified. Hence, DL is indispensable for making the intended inferences through big IIoT data. Likewise, due to the advancement of sensor technology, various sensor resources such as sound, vibration, and current can be used to obtain appropriate inferences. Accordingly, the decision fusion theory can be used to make optimal decisions when there are multiple sources of information. Therefore, this paper proposes a method that combines one-dimensional convolution neural networks (1DCNNs) and the Dempster–Shafer (DS) decision-fusion method (DS-1DCNN) for decision-making on IIoT anomalies. According to obtained simulation results, this proposed method increases the decision accuracy and significantly decreases uncertainty. The proposed method was compared with long short-term memory, random forest and CNN models, which obtained better performance than these algorithms. The proposed method on the Mill dataset got an average recall of 0.9763 and an average precision of 0.9899, which is an acceptable and reliable result for decision-making.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others

References

  1. Al-Fuqaha A, Guizani M, Mohammadi M, Aledhari M, Ayyash M (2015) Internet of things: a survey on enabling technologies, protocols, and applications. IEEE Commun Surv Tutor 17(4):2347–2376

    Article  Google Scholar 

  2. Khalil RA, Saeed N, Masood M, Fard YM, Alouini M-S, Al-Naffouri TY (2021) Deep learning in the industrial internet of things: potentials, challenges, and emerging applications. IEEE Internet Things J 8(14):11016–11040

    Article  Google Scholar 

  3. Liang F, Yu W, Liu X, Griffith D, Golmie N (2020) Toward edge-based deep learning in industrial Internet of Things. IEEE Internet Things J 7(5):4329–4341

    Article  Google Scholar 

  4. Neagu G, Ianculescu M, Alexandru A, Florian V, Rădulescu CZ (2019) Next generation IoT and its influence on decision-making. An illustrative case study. Procedia Comput Sci 162:555–561

    Article  Google Scholar 

  5. Ma M, Wang P, Chu C-H, (2013) "Data management for internet of things: Challenges, approaches and opportunities," In: 2013 IEEE International conference on green computing and communications and IEEE Internet of Things and IEEE cyber, physical and social computing, : IEEE, pp. 1144-1151

  6. Daugherty P, Banerjee P, Negm W, Alter AE (2015) "Driving unconventional growth through the industrial internet of things," accenture technology,

  7. Kamat P, Sugandhi R(2020) "Anomaly detection for predictive maintenance in industry 4.0-A survey," in E3S web of conferences, , vol. 170: EDP Sciences, p. 02007

  8. Lee C-H, Lin J-W, Chen P-H, Chang Y-C (2019) Deep learning-constructed joint transmission-recognition for internet of things. IEEE Access 7:76547–76561

    Article  Google Scholar 

  9. Liang Y, Wang S, Li W, Lu X (2019) Data-driven anomaly diagnosis for machining processes. Engineering 5(4):646–652

    Article  Google Scholar 

  10. Chen B, Wan J( 2019) "Emerging trends of ml-based intelligent services for industrial internet of things (iiot)," In: 2019 Computing, Communications and IoT Applications (ComComAp), : IEEE, pp. 135-139

  11. Lade P, Ghosh R, Srinivasan S(2017) "Manufacturing Analytics and Industrial Internet of Things," (in English), IEEE Intelligent Systems, Article vol. 32, no. 3, pp. 74-79, May-Jun 2017

  12. Saeed N, Nam H, Haq MIU, Muhammad Saqib DB (2018) A survey on multidimensional scaling. ACM Comput Surv (CSUR) 51(3):1–25

    Article  Google Scholar 

  13. Al-Turjman F, Alturjman S (2018) Context-sensitive access in industrial internet of things (IIoT) healthcare applications. IEEE Trans Industr Inf 14(6):2736–2744

    Article  Google Scholar 

  14. Liu CH, Lin Q, Wen S (2018) Blockchain-enabled data collection and sharing for industrial IoT with deep reinforcement learning. IEEE Trans Industr Inf 15(6):3516–3526

    Article  Google Scholar 

  15. Weyrich M, Ebert C (2015) Reference architectures for the internet of things. IEEE Softw 33(1):112–116

    Article  Google Scholar 

  16. Mangai UG, Samanta S, Das S, Chowdhury PR (2010) A survey of decision fusion and feature fusion strategies for pattern classification. IETE Tech Rev 27(4):293–307

    Article  Google Scholar 

  17. Lei Y, Yang B, Jiang X, Jia F, Li N, Nandi AK (2020) Applications of machine learning to machine fault diagnosis: a review and roadmap. Mech Syst Signal Process 138:106587

    Article  Google Scholar 

  18. Diez-Olivan A, Del Ser J, Galar D, Sierra B (2019) Data fusion and machine learning for industrial prognosis: trends and perspectives towards Industry 4.0. Inf Fusion 50:92–111

    Article  Google Scholar 

  19. Dasarathy BV(2000) "Industrial applications of multi-sensor multi-source information fusion," In: Proceedings of IEEE International Conference on Industrial Technology 2000 (IEEE Cat. No. 00TH8482), 2000, vol. 2: IEEE, pp. 5-11

  20. Tong Y, Bai J, Chen X(2020) "Research on Multi-sensor Data Fusion Technology," In: Journal of Physics: Conference Series, , vol. 1624, no. 3: IOP Publishing, p. 032046

  21. Meng T, Jing X, Yan Z, Pedrycz W (2020) A survey on machine learning for data fusion. Inf Fusion 57:115–129

    Article  Google Scholar 

  22. Çavdar T, Ebrahimpour N (2019) Decision-making for small industrial Internet of Things using decision fusion. Turk J Elect Eng Comput Sci 27(6):4134–4150

    Article  Google Scholar 

  23. Li X, Zhang W, Ding Q, Sun J-Q (2020) Intelligent rotating machinery fault diagnosis based on deep learning using data augmentation. J Intell Manuf 31(2):433–452

    Article  Google Scholar 

  24. Bin G, Gao J, Li X, Dhillon B (2012) Early fault diagnosis of rotating machinery based on wavelet packets-Empirical mode decomposition feature extraction and neural network. Mech Syst Signal Process 27:696–711

    Article  Google Scholar 

  25. Tian Z (2012) An artificial neural network method for remaining useful life prediction of equipment subject to condition monitoring. J Intell Manuf 23(2):227–237

    Article  Google Scholar 

  26. Zhang X, Liang Y, Zhou J (2015) A novel bearing fault diagnosis model integrated permutation entropy, ensemble empirical mode decomposition and optimized SVM. Measurement 69:164–179

    Article  Google Scholar 

  27. Yang B-S, Di X, Han T (2008) Random forests classifier for machine fault diagnosis. J Mech Sci Technol 22(9):1716–1725

    Article  Google Scholar 

  28. Shah G, Tiwari A(2018) "Anomaly detection in iiot: A case study using machine learning," In: Proceedings of the ACM India Joint International Conference on Data Science and Management of Data, 2018, pp. 295-300

  29. Marín G, Casas P, Capdehourat G (2018) "Rawpower: Deep learning based anomaly detection from raw network traffic measurements," In Proceedings of the ACM SIGCOMM 2018 Conference on Posters and Demos, , pp. 75-77

  30. Al-Garadi MA, Mohamed A, Al-Ali AK, Du X, Ali I, Guizani M (2020) A survey of machine and deep learning methods for internet of things (IoT) security. IEEE Commun Surv Tutor 22(3):1646–1685

    Article  Google Scholar 

  31. Zhan P et al (2021) Temporal anomaly detection on IIoT-enabled manufacturing. J Intell Manuf 32(6):1669–1678

    Article  Google Scholar 

  32. Liu Y, Kumar N, Xiong Z, Lim WYB, Kang J , Niyato D (2020) "Communication-efficient federated learning for anomaly detection in industrial internet of things," In GLOBECOM 2020-2020 IEEE Global Communications Conference, : IEEE, pp. 1-6

  33. Elbasani E, Kim J-D (2021) "LLAD: Life-log anomaly detection based on recurrent neural network LSTM," J Healthcare Eng, 2021

  34. Mozaffari MH and Tay L-L (2020) "A Review of 1D Convolutional Neural Networks toward Unknown Substance Identification in Portable Raman Spectrometer," arXiv preprint arXiv:2006.10575

  35. Hinton GE, Salakhutdinov RR (2006) Reducing the dimensionality of data with neural networks. Science 313(5786):504–507

    Article  MathSciNet  MATH  Google Scholar 

  36. Kiranyaz S, Avci O, Abdeljaber O, Ince T, Gabbouj M, Inman DJ (2021) 1D convolutional neural networks and applications: a survey. Mech Syst Signal Process 151:107398

    Article  Google Scholar 

  37. Srinivasamurthy RS (2018) Understanding 1D Convolutional Neural Networks Using Multiclass Time-Varying Signalss, Clemson University

  38. Sentz K and Ferson S (2002) Combination of evidence in Dempster-Shafer theory. Citeseer

  39. Liggins II M, Hall D, and Llinas J (2017) Handbook of multisensor data fusion: theory and practice. CRC press

  40. Sun S, Cao Z, Zhu H, Zhao J (2019) A survey of optimization methods from a machine learning perspective. IEEE Trans Cybern 50(8):3668–3681

    Article  Google Scholar 

  41. Zaheer R, Shaziya H (2019), "A study of the optimization algorithms in deep learning," In: 2019 Third International Conference on Inventive Systems and Control (ICISC), : IEEE, pp. 536-539

  42. Olson DL (2008) Delen D (2008) Advanced data mining techniques. Springer Science & Business Media

  43. Vasilev I, Slater D, Spacagna G, Roelants P, Zocca V (2019)Python Deep Learning: Exploring deep learning techniques and neural network architectures with Pytorch, Keras, and TensorFlow. Packt Publishing Ltd

Download references

Author information

Authors and Affiliations

  1. Department of Computer Engineering, Karadeniz Technical University, 61080, Trabzon, Turkey

    Tuğrul Çavdar

  2. Papilon Savunma, 06570, Ankara, Turkey

    Nader Ebrahimpour

  3. Department of Computer Engineering, Osmaniye Korkut Ata University, 80000, Osmaniye, Turkey

    Muhammet Talha Kakız

  4. Department of Computer Engineering, Atatürk University, 25050, Erzurum, Turkey

    Faruk Baturalp Günay

Authors
  1. Tuğrul Çavdar
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Nader Ebrahimpour
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Muhammet Talha Kakız
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Faruk Baturalp Günay
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Nader Ebrahimpour.

Ethics declarations

Data availability

The authors confirm that the data (Nasa Milling Dataset) supporting this study’s findings are publicly available at https://www.kaggle.com/datasets/vinayak123tyagi/milling-data-set-prognostic-data.

Conflict of interest

The authors have no conflicts of interest to declare. There is no financial interest in the paper. The authors certify that the submission is original work and is not under review at any other publication.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Çavdar, T., Ebrahimpour, N., Kakız, M.T. et al. Decision-making for the anomalies in IIoTs based on 1D convolutional neural networks and Dempster–Shafer theory (DS-1DCNN). J Supercomput 79, 1683–1704 (2023). https://doi.org/10.1007/s11227-022-04739-2

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11227-022-04739-2

Keywords

Search

Navigation