Skip to main content

Advertisement

Log in

Fft-asvr: an adaptive approach for accurate prediction of IoT data streams

  • Published:
The Journal of Supercomputing Aims and scope Submit manuscript

Abstract

In IoT applications, prediction models have fundamental challenges such as real-time processing, producing results with considerable/without delay, and taking action against pattern drift. While existing models can excel when data statistics remain relatively stable, real-time systems may encounter difficulties, particularly when confronted with dynamic shifts in data behavior. Analyzing data streams generated by different IoT applications and detecting complex pattern on the fly has become an open area of research. Complex event processing with adaptivity is a must to get desired features in such models. To address this issue, a comprehensive model for prediction has been proposed in this paper. It consists of two phases: (1) the basic model is constructed using historical data, (2) a fast Fourier transform-based adaptive support vector regression (FFT-ASVR) approach is proposed to predict events embedded in IoT data streams. FFT-ASVR predicts abnormal events by experiencing a change in data streams with real-time model updation. The performance of FFT-ASVR with a similar existing method SVM-RBF is presented using real-time traffic data of Madrid city. The proposed approach has significant improvement in terms of mean absolute percentage error (MAPE) for prediction, is adaptive in nature, and is also capable of handling the issue of pattern drift.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Algorithm 1
Algorithm 2
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9

Similar content being viewed by others

Availability of data and materials

Madrid traffic dataset: https://informo.madrid.es/#/realtime?panel=live.

Code availability

Not applicable.

Notes

  1. https://informo.madrid.es/#/realtime?panel=live.

References

  1. Kumar M, Singh PK, Maurya MK, Shivhare A (2023) A survey on event detection approaches for sensor based iot. Internet Things 22:100720. https://doi.org/10.1016/j.iot.2023.100720

    Article  Google Scholar 

  2. Kumar M, Singh T, Maurya MK, Shivhare A, Raut A, Singh PK (2023) Quality assessment and monitoring of river water using iot infrastructure. IEEE Internet Things J. https://doi.org/10.1109/JIOT.2023.3238123

  3. Younan M, Elhoseny M, Ali AE-MA, Houssein EH (2021) Data reduction model for balancing indexing and securing resources in the internet-of-things applications. IEEE Internet Things J 8(7):5953–5972. https://doi.org/10.1109/JIOT.2020.3035248

    Article  Google Scholar 

  4. Lepenioti K, Bousdekis A, Apostolou D, Mentzas G (2020) Prescriptive analytics: Literature review and research challenges. Int J Inf Manage 50:57–70

    Article  Google Scholar 

  5. Akbar A, Khan A, Carrez F, Moessner K (2017) Predictive analytics for complex iot data streams. IEEE Internet Things J 4(5):1571–1582. https://doi.org/10.1109/JIOT.2017.2712672

    Article  Google Scholar 

  6. Mwaffaq Abu-Alhaija NMT (2022) Automated learning of ECG streaming data through machine learning internet of things. Intell Autom Soft Comput 32(1):45–53. https://doi.org/10.32604/iasc.2022.021426

    Article  Google Scholar 

  7. Cugola G, Margara A (2012) Processing flows of information: from data stream to complex event processing. ACM Comput Surv (CSUR) 44(3):1–62

    Article  Google Scholar 

  8. Tsai C-W, Lai C-F, Chiang M-C, Yang LT (2013) Data mining for internet of things: a survey. IEEE Commun Surv Tutor 16(1):77–97

    Article  Google Scholar 

  9. Fülöp LJ, Beszédes Á, Tóth G. Demeter H, Vidács L, Farkas L (2012) Predictive complex event processing: a conceptual framework for combining complex event processing and predictive analytics. In: Proceedings of the 5th Balkan Conference in Informatics, pp 26–31

  10. Wang Y, Cao K (2014) A proactive complex event processing method for large-scale transportation internet of things. Int J Distrib Sens Netw 10(3):159052. https://doi.org/10.1155/2014/159052

    Article  Google Scholar 

  11. Moon TK (1996) The expectation-maximization algorithm. IEEE Signal Process Mag 13(6):47–60

    Article  Google Scholar 

  12. Nechifor S, Târnaucă B, Sasu L, Puiu D, Petrescu A, Teutsch J, Waterfeld W, Moldoveanu F (2014) Autonomic monitoring approach based on cep and ml for logistic of sensitive goods. In: IEEE 18th International Conference on Intelligent Engineering Systems INES 2014. IEEE, pp 67–72

  13. Christ M, Krumeich J, Kempa-Liehr AW (2016) Integrating predictive analytics into complex event processing by using conditional density estimations. In: 2016 IEEE 20th International Enterprise Distributed Object Computing Workshop (EDOCW), pp 1–8 . https://doi.org/10.1109/EDOCW.2016.7584363

  14. Gupta A, Maurya MK, Goyal N, Chaurasiya VK (2023) ISTGCN: Integrated spatio-temporal modeling for traffic prediction using traffic graph convolution network. Appl Intell 53(23):29153–29168

    Article  Google Scholar 

  15. Kumar SS, Chandra R, Agarwal S (2023) A real-time approach for smart building operations prediction using rule-based complex event processing and sparql query. arXiv preprint arXiv:2309.10822

  16. Emerson RJ, Hossen J, Ervina E, Tawsif K, Jesmeen M (2020) Broadband network fault prediction using complex event processing and predictive analytics techniques. J Eng Sci Technol 15(4):2289–2300

    Google Scholar 

  17. Roudjane M, Rebaïne D, Khoury R, Hallé S (2019) Predictive analytics for event stream processing. In: 2019 IEEE 23rd International Enterprise Distributed Object Computing Conference (EDOC). IEEE, pp 171–182

  18. Simsek MU, Yildirim Okay F, Ozdemir S (2021) A deep learning-based cep rule extraction framework for iot data. J Supercomput 77:8563–8592

    Article  Google Scholar 

  19. Brazález E, Macià H, Díaz G, Baeza_Romero M, Valero E, Valero V, (2022) Fume: an air quality decision support system for cities based on cep technology and fuzzy logic. Appl Soft Comput 129:109536

  20. Ortiz G, Caravaca JA, García-de-Prado A, Boubeta-Puig J (2019) Real-time context-aware microservice architecture for predictive analytics and smart decision-making. IEEE Access 7:183177–183194

    Article  Google Scholar 

  21. Thomas B, Jose F, Jordi S, Almudena A, Wolfgang T (2013) Real time traffic forecast. Atos Sci White Pap 2013

  22. Widmer G, Kubat M (1996) Learning in the presence of concept drift and hidden contexts. Mach Learn 23(1):69–101

    Article  Google Scholar 

  23. Valsamis A, Tserpes K, Zissis D, Anagnostopoulos D, Varvarigou T (2017) Employing traditional machine learning algorithms for big data streams analysis: the case of object trajectory prediction. J Syst Softw 127:249–257

    Article  Google Scholar 

  24. Bifet A, Holmes G, Pfahringer B, Kranen P, Kremer H, Jansen T, Seidl T (2010) Moa: Massive online analysis, a framework for stream classification and clustering. In: Proceedings of the 1st Workshop on Applications of Pattern Analysis. PMLR, pp 44–50

  25. Cugola G, Margara A (2012) Processing flows of information: from data stream to complex event processing. ACM Comput Surv (CSUR) 44(3):1–62

    Article  Google Scholar 

  26. Dias JP, Restivo A, Ferreira HS (2022) Designing and constructing internet-of-things systems: an overview of the ecosystem. Internet Things 19:100529

    Article  Google Scholar 

  27. Raptis TP, Passarella A (2023) A survey on networked data streaming with apache Kafka. IEEE Access 11:85333–85350

    Article  Google Scholar 

  28. Bayram F, Ahmed BS, Kassler A (2022) From concept drift to model degradation: an overview on performance-aware drift detectors. Knowl-Based Syst 245:108632. https://doi.org/10.1016/j.knosys.2022.108632

    Article  Google Scholar 

  29. Melchior C, Zanini RR, Guerra RR, Rockenbach DA (2021) Forecasting Brazilian mortality rates due to occupational accidents using autoregressive moving average approaches. Int J Forecast 37(2):825–837

    Article  Google Scholar 

  30. Deif MA, Solyman AA, Hammam RE (2021) Arima model estimation based on genetic algorithm for covid-19 mortality rates. Int J Inf Technol Dec Mak 20(06):1775–1798

    Article  Google Scholar 

Download references

Funding

Not applicable.

Author information

Authors and Affiliations

Authors

Contributions

All authors contributed to the writing and read and approved the final manuscript. Manish Kumar Maurya and Vivek Kumar Singh gave his contribution to the construction of the overall model, the design and exploration of related experiments, and completed the writing of the manuscript. Sandeep Kumar Shaw participated in exploration of experimental results, and review of the first manuscript. Manish Kumar provided the idea through constructive discussions and gave the formulation of the overall research goals.

Corresponding authors

Correspondence to Manish Kumar Maurya or Vivek Kumar Singh.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Ethical approval

Not applicable.

Consent to participate

Not applicable.

Consent for publication

Not applicable.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Maurya, M.K., Singh, V.K., Shaw, S.K. et al. Fft-asvr: an adaptive approach for accurate prediction of IoT data streams. J Supercomput 80, 13976–13999 (2024). https://doi.org/10.1007/s11227-024-05961-w

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11227-024-05961-w

Keywords

Navigation