Skip to main content
SpringerLink
Log in

Efficient mining of IoT based data streams for advanced computer vision systems

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

With emergence of Internet of Things (IoT) and subsequent technologies, smart devices are being increasingly used in various domains such as smart homes, smart parking, intelligent transportation etc. Vast amount of image and video data has been produced by IoT based systems in the form of continuous and possibly infinite image and video streams. This demands the development of advanced predictive vision systems which exploits stream mining concepts for intelligent processing of visual data streams. Among other challenges faced by visual data streams, a major challenge is concept drift, which is caused by overtime change in data distribution. In the presence of skewed data, the detection of concept drift becomes more challenging. When analyzing the data generated from smart devices and other performance critical wireless sensors, concept drift affects data integrity and accuracy of prediction results. EWMA for Concept Drift Detection (ECDD) has been proposed in the literature for detecting data streams. However, ECDD has a high prediction error rate which makes it less useful for performance critical data streams generated by imaging and video data streams. In this paper, Vision based Drift Detection Method (VisDDM) is proposed, which systematically handles abrupt and gradual concept drift in data streams. Experiments have been performed using synthetic and real world datasets from different application domains. Our proposed VisDDM algorithm is able to handle abrupt and gradual drift types and outperformed the existing drift detection methods in terms of accuracy and mean evaluation time.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12

Similar content being viewed by others

References

  1. Manuel Baena-García, Campo-Ávila J, Fidalgo-Merino R, Bifet A, Gavald R, Morales-Bueno R Early drift detection method. In: Proceedings of the fourth international workshop on knowledge discovery from data streams, pp 77–86

  2. Barros RSM, Cabral DRL, Gonçalves PM, Santos SGTC (2017) RDDM: reactive drift detection method. Expert Syst Appl 90:344–355

    Article  Google Scholar 

  3. Demšar J, Bosnić Z (2018) Detecting concept drift in data streams using model explanation. Expert Syst Appl 92:546–559

    Article  Google Scholar 

  4. Duda P, Jaworski M, Rutkowski L (2017) On ensemble components selection in data streams scenario with reoccurring concept-drift. IEEE Symposium Series on Computational Intelligence (SSCI), pp 1–7

  5. Escovedo T, Koshiyama A, da Cruz AA, Vellasco M (2018) DetectA: abrupt concept drift detection in non-stationary environments. Appl Soft Comput 62:119–133

    Article  Google Scholar 

  6. Frías-Blanco I, Campo-Ávila JD, Ramos-Jiménez G, Morales-Bueno R, Ortiz-Díaz A, Caballero-Mota Y Online and non-parametric drift detection methods based on Hoeffding’s bounds. IEEE Trans Knowl Data Eng 27(3):810–823

  7. Huang DTJ, Koh YS, Dobbie G, Pears R (2014) Detecting volatility shift in data streams. IEEE International Conference on Data Mining, Shenzhen, pp 863–868

  8. Karkanis S, Magoulas GD, Theofanous N (2000) Image recognition and neuronal networks: Intelligent systems for the improvement of imaging information. Minimally Invasive Therapy & Allied Technologies 9(3–4):225–230. https://doi.org/10.1080/13645700009169652

  9. Kim Y, Hee Park C (2017) An efficient concept drift detection method for streaming data under limited labeling. IEICE Transactions on Information and Systems, pp 2537–2546

  10. Kithulgoda CI, Pears R (2016) Staged Online learning: a new approach to classification in high speed data streams. International Joint Conference on Neural Networks (IJCNN), Vancouver, BC, pp 1–8

  11. Kithulgoda CI, Pears R, Naeem MA (2018) The incremental Fourier classifier: leveraging the discrete Fourier transform for classifying high speed data streams. Expert Syst Appl 97:1–17

    Article  Google Scholar 

  12. Liu S, Lin F, Wu J, Hou G, Han G (2017) Concept drift detection for data stream learning based on angle optimized global embedding and principal component analysis in sensor networks. Comput Electric Eng 58:327–336

    Article  Google Scholar 

  13. Liu A, Lu J, Liu F, Zhang G (2018) Accumulating regional density dissimilarity for concept drift detection in data streams. Pattern Recogn 76:256–272

    Article  Google Scholar 

  14. Lughofer E, Weigl E, Heidl W, Eitzinger C, Radauer T (2016) Recognizing input space and target concept drifts in data streams with scarcely labeled and unlabelled instances. Inf Sci 355–356:127–151

    Article  Google Scholar 

  15. Maciel BIF, Santos SGTC, Barros RSM (2015) A lightweight concept drift detection ensemble. IEEE 27th International Conference on Tools with Artificial Intelligence (ICTAI), Vietri sul Mare, pp 1061–1068

  16. Mesejo P, Pizarro D, Abergel A, Rouquette O, Beorchia S, Poincloux L, Bartoli A (2016) Computer-aided classification of gastrointestinal lesions in regular colonoscopy. IEEE Trans Med Imaging 35(9):2051–2063

    Article  Google Scholar 

  17. Nishida K, Yamauchi K (2007) Detecting concept drift using statistical testing. Discovery Science, Berlin, pp 264–269

    Google Scholar 

  18. Pears R, Sakthithasan S, Koh YS (2014) Detecting concept change in dynamic data streams. Mach Learn 97:259–293

    Article  MathSciNet  Google Scholar 

  19. Ross GJ, Adams NM, Tasoulis DK, Hand JD (2012) Exponentially weighted moving average charts for detecting concept drift. Pattern Recognit Lett 33(2):191–198

    Article  Google Scholar 

  20. Sakthithasan S, Pears R, Koh YS (2013) One pass concept change detection for data streams. In: Pei J, Tseng VS, Cao L, Motoda H, Xu G (eds.), Advances in knowledge discovery and data mining. PAKDD 2013. Lecture Notes in Computer Science, vol 7819. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-37456-2_39

  21. Sakthithasan S, Pears R, Bifet A, Pfahringer B (2015) Use of ensembles of Fourier spectra in capturing recurrent concepts in data streams. International Joint Conference on Neural Networks, pp 1–8

  22. Sethi TS, Kantardzic M (2017) On the reliable detection of concept drift from streaming unlabeled data. Exp Syst Appl 82:77–99

    Article  Google Scholar 

  23. Sun Y, Tang K, Minku LL, Wang S, Yao X (2016) Online ensemble learning of data streams with gradually evolved classes. IEEE Trans Knowl Data Eng 28:1532–1545

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Computer Science, Shaheed Zulfikar Ali Bhutto Institute of Science and Technology, Islamabad, Pakistan

    Affan Ahmed Toor, Muhammad Usman & Farah Younas

  2. College of Computing and Informatics, Saudi Electronic University, Riyadh, Saudi Arabia

    Mohamed Habib

  3. Faculty of Engineering, Port Said University, Port Fuad City, Egypt

    Mohamed Habib

  4. Western Michigan University, Kalamazoo, MI, USA

    A. C. M Fong

Authors
  1. Affan Ahmed Toor
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Muhammad Usman
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Farah Younas
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Mohamed Habib
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. A. C. M Fong
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to A. C. M Fong.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Toor, A.A., Usman, M., Younas, F. et al. Efficient mining of IoT based data streams for advanced computer vision systems. Multimed Tools Appl 83, 15027–15042 (2024). https://doi.org/10.1007/s11042-020-09175-z

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-020-09175-z

Keywords

Search

Navigation