Abstract
In IoT applications, prediction models have fundamental challenges such as real-time processing, producing results with considerable/without delay, and taking action against pattern drift. While existing models can excel when data statistics remain relatively stable, real-time systems may encounter difficulties, particularly when confronted with dynamic shifts in data behavior. Analyzing data streams generated by different IoT applications and detecting complex pattern on the fly has become an open area of research. Complex event processing with adaptivity is a must to get desired features in such models. To address this issue, a comprehensive model for prediction has been proposed in this paper. It consists of two phases: (1) the basic model is constructed using historical data, (2) a fast Fourier transform-based adaptive support vector regression (FFT-ASVR) approach is proposed to predict events embedded in IoT data streams. FFT-ASVR predicts abnormal events by experiencing a change in data streams with real-time model updation. The performance of FFT-ASVR with a similar existing method SVM-RBF is presented using real-time traffic data of Madrid city. The proposed approach has significant improvement in terms of mean absolute percentage error (MAPE) for prediction, is adaptive in nature, and is also capable of handling the issue of pattern drift.
Similar content being viewed by others
Availability of data and materials
Madrid traffic dataset: https://informo.madrid.es/#/realtime?panel=live.
Code availability
Not applicable.
References
Kumar M, Singh PK, Maurya MK, Shivhare A (2023) A survey on event detection approaches for sensor based iot. Internet Things 22:100720. https://doi.org/10.1016/j.iot.2023.100720
Kumar M, Singh T, Maurya MK, Shivhare A, Raut A, Singh PK (2023) Quality assessment and monitoring of river water using iot infrastructure. IEEE Internet Things J. https://doi.org/10.1109/JIOT.2023.3238123
Younan M, Elhoseny M, Ali AE-MA, Houssein EH (2021) Data reduction model for balancing indexing and securing resources in the internet-of-things applications. IEEE Internet Things J 8(7):5953–5972. https://doi.org/10.1109/JIOT.2020.3035248
Lepenioti K, Bousdekis A, Apostolou D, Mentzas G (2020) Prescriptive analytics: Literature review and research challenges. Int J Inf Manage 50:57–70
Akbar A, Khan A, Carrez F, Moessner K (2017) Predictive analytics for complex iot data streams. IEEE Internet Things J 4(5):1571–1582. https://doi.org/10.1109/JIOT.2017.2712672
Mwaffaq Abu-Alhaija NMT (2022) Automated learning of ECG streaming data through machine learning internet of things. Intell Autom Soft Comput 32(1):45–53. https://doi.org/10.32604/iasc.2022.021426
Cugola G, Margara A (2012) Processing flows of information: from data stream to complex event processing. ACM Comput Surv (CSUR) 44(3):1–62
Tsai C-W, Lai C-F, Chiang M-C, Yang LT (2013) Data mining for internet of things: a survey. IEEE Commun Surv Tutor 16(1):77–97
Fülöp LJ, Beszédes Á, Tóth G. Demeter H, Vidács L, Farkas L (2012) Predictive complex event processing: a conceptual framework for combining complex event processing and predictive analytics. In: Proceedings of the 5th Balkan Conference in Informatics, pp 26–31
Wang Y, Cao K (2014) A proactive complex event processing method for large-scale transportation internet of things. Int J Distrib Sens Netw 10(3):159052. https://doi.org/10.1155/2014/159052
Moon TK (1996) The expectation-maximization algorithm. IEEE Signal Process Mag 13(6):47–60
Nechifor S, Târnaucă B, Sasu L, Puiu D, Petrescu A, Teutsch J, Waterfeld W, Moldoveanu F (2014) Autonomic monitoring approach based on cep and ml for logistic of sensitive goods. In: IEEE 18th International Conference on Intelligent Engineering Systems INES 2014. IEEE, pp 67–72
Christ M, Krumeich J, Kempa-Liehr AW (2016) Integrating predictive analytics into complex event processing by using conditional density estimations. In: 2016 IEEE 20th International Enterprise Distributed Object Computing Workshop (EDOCW), pp 1–8 . https://doi.org/10.1109/EDOCW.2016.7584363
Gupta A, Maurya MK, Goyal N, Chaurasiya VK (2023) ISTGCN: Integrated spatio-temporal modeling for traffic prediction using traffic graph convolution network. Appl Intell 53(23):29153–29168
Kumar SS, Chandra R, Agarwal S (2023) A real-time approach for smart building operations prediction using rule-based complex event processing and sparql query. arXiv preprint arXiv:2309.10822
Emerson RJ, Hossen J, Ervina E, Tawsif K, Jesmeen M (2020) Broadband network fault prediction using complex event processing and predictive analytics techniques. J Eng Sci Technol 15(4):2289–2300
Roudjane M, Rebaïne D, Khoury R, Hallé S (2019) Predictive analytics for event stream processing. In: 2019 IEEE 23rd International Enterprise Distributed Object Computing Conference (EDOC). IEEE, pp 171–182
Simsek MU, Yildirim Okay F, Ozdemir S (2021) A deep learning-based cep rule extraction framework for iot data. J Supercomput 77:8563–8592
Brazález E, Macià H, Díaz G, Baeza_Romero M, Valero E, Valero V, (2022) Fume: an air quality decision support system for cities based on cep technology and fuzzy logic. Appl Soft Comput 129:109536
Ortiz G, Caravaca JA, García-de-Prado A, Boubeta-Puig J (2019) Real-time context-aware microservice architecture for predictive analytics and smart decision-making. IEEE Access 7:183177–183194
Thomas B, Jose F, Jordi S, Almudena A, Wolfgang T (2013) Real time traffic forecast. Atos Sci White Pap 2013
Widmer G, Kubat M (1996) Learning in the presence of concept drift and hidden contexts. Mach Learn 23(1):69–101
Valsamis A, Tserpes K, Zissis D, Anagnostopoulos D, Varvarigou T (2017) Employing traditional machine learning algorithms for big data streams analysis: the case of object trajectory prediction. J Syst Softw 127:249–257
Bifet A, Holmes G, Pfahringer B, Kranen P, Kremer H, Jansen T, Seidl T (2010) Moa: Massive online analysis, a framework for stream classification and clustering. In: Proceedings of the 1st Workshop on Applications of Pattern Analysis. PMLR, pp 44–50
Cugola G, Margara A (2012) Processing flows of information: from data stream to complex event processing. ACM Comput Surv (CSUR) 44(3):1–62
Dias JP, Restivo A, Ferreira HS (2022) Designing and constructing internet-of-things systems: an overview of the ecosystem. Internet Things 19:100529
Raptis TP, Passarella A (2023) A survey on networked data streaming with apache Kafka. IEEE Access 11:85333–85350
Bayram F, Ahmed BS, Kassler A (2022) From concept drift to model degradation: an overview on performance-aware drift detectors. Knowl-Based Syst 245:108632. https://doi.org/10.1016/j.knosys.2022.108632
Melchior C, Zanini RR, Guerra RR, Rockenbach DA (2021) Forecasting Brazilian mortality rates due to occupational accidents using autoregressive moving average approaches. Int J Forecast 37(2):825–837
Deif MA, Solyman AA, Hammam RE (2021) Arima model estimation based on genetic algorithm for covid-19 mortality rates. Int J Inf Technol Dec Mak 20(06):1775–1798
Funding
Not applicable.
Author information
Authors and Affiliations
Contributions
All authors contributed to the writing and read and approved the final manuscript. Manish Kumar Maurya and Vivek Kumar Singh gave his contribution to the construction of the overall model, the design and exploration of related experiments, and completed the writing of the manuscript. Sandeep Kumar Shaw participated in exploration of experimental results, and review of the first manuscript. Manish Kumar provided the idea through constructive discussions and gave the formulation of the overall research goals.
Corresponding authors
Ethics declarations
Conflict of interest
The authors declare that they have no conflict of interest.
Ethical approval
Not applicable.
Consent to participate
Not applicable.
Consent for publication
Not applicable.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Maurya, M.K., Singh, V.K., Shaw, S.K. et al. Fft-asvr: an adaptive approach for accurate prediction of IoT data streams. J Supercomput 80, 13976–13999 (2024). https://doi.org/10.1007/s11227-024-05961-w
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11227-024-05961-w