Abstract
With the development of 5G networks, cellular wireless networks are becoming more diverse and intelligent. As an important part of intelligent network management, wireless network traffic prediction has attracted more attention. Meanwhile, low delay communication is also an important part of the prediction task that needs to be considered. However, traditional deep learning models have many drawbacks in traffic prediction, such as excessive running time and computing resources. To address these issues, especially jointly considering effectiveness and efficiency, we propose a stacked broad learning system with multitask learning method for traffic flow prediction, called MTL-SBLS. Specifically, we use related tasks with similar change patterns as input to the prediction model and share more relevant features through multi-task learning. The multi-layer stacking structure of stacking broad learning system can effectively capture the traffic data features and ensure high prediction performance. When stacking new blocks, the fixed structure and weight of the underlying basic broad learning system blocks ensure that the newly generated stacking broad learning system still has a low computational cost. Finally, the experiments on three real data sets demonstrate that the MTL-SBLS model outperforms the other existing prediction methods (93.38% prediction accuracy on average). Furthermore, the MTL-SBLS model can maintain a running time of less than 10 sec on all three datasets, indicating that it is efficient. Thus, the MTL-SBLS model is proved to improve the accuracy of traffic flow prediction while maintaining low complexity and running time.
Similar content being viewed by others
Data availability statement
The datasets analyzed during this study are available in by Telecom Italia. The MathorCup database are available in 2018 MathorCup Modeling Challenge database.
References
Agyapong PK, Iwamura M, Staehle D, Kiess W, Benjebbour A (2014) Design considerations for a 5g network architecture. IEEE Commun Mag 52(11):65–75
Andrews JG, Buzzi S, Choi W et al (2014) What Will 5G Be? IEEE J Sel Areas Commun 32(6):1065–1082
Barlacchi G, Nadai MD, Larcher R, Casella A, Chitic C, Torrisi G (2015) A multi-source dataset of urban life in the city of Milan and the province of Trentino. Sci Data 2:15–55
Caruana R (1997) Multitask learning. Mach Learn 28(1):41–75
Chen CLP (2017) Broad learning system: a new learning paradigm and system without going deep. In: 2017 32nd youth academic annual conference of Chinese association of automation (YAC), Hefei, China, pp 1271–1276
Chen CLP, Liu ZL (2018) Broad learning system: an effective and efficient incremental learning system without the need for deep architecture. IEEE Trans Neural Netw Learn Syst 29(1):10–24
Chen Q, Zhang Y, Feng Z (2018) Spatio-temporal wireless traffic prediction with recurrent neural network. IEEE Wirel Commun Lett 7(4):554–557
Chen L, Yang D, Zhang D (2018) Deep mobile traffic forecast and complementary base station clustering for C-RAN optimization. J Netw Comput Appl 121(11):59–69
Chen CLP, Liu ZL, Feng S (2019) Universal approximation capability of broad learning system and its structural variations. IEEE Trans Neural Netw Learn Syst 30(4):1194–1204
Chen M, Wei X, Gao, Y, Huang L, Kang B (2020) Deep-broad Learning System for Traffic Flow Prediction toward 5G Cellular Wireless Network. In: 2020 international wireless communications and mobile computing (IWCMC), IEEE
Chinchali S, Hu P, Chu T, Sharma M, Bansal M, Misra R, Pavone M, Katti S (2018) Cellular network traffic scheduling with deep reinforcement learning. In: Thirty-Second AAAI conference on artificial intelligence
Collobert R, Weston J (2008) A unified architecture for natural language processing: deep neural networks with multitask learning. In: Processing 25th international conference machine learning, pp 160–167
Deng D, Shahabi C, Demiryurek U, Zhu L (2017) Situation aware multitask learning for traffic prediction. In: Processing IEEE internet conference data mining (ICDM), pp 81–90
Feng H, Shu Y (2005) Study on network traffic prediction techniques. In: Proceedings. 2005 international conference on wireless communications, networking and mobile computing, IEEE, 2:1041–1044
Global mobile data traffic forecast update, 2016–2021 (2017) VNI Cisco. White Paper 1454457600805266
Gupta BB, Agrawal DP, Yamaguchi S et al (2020) Soft computing techniques for big data and cloud computing. Soft Comput 24:5483–5484
Hochreiter S, Schmidhuber J (1997) Long short-term memory. Neural Comput 9(8):1735–1780
Huang CW, Chiang CT, Li Q (2018) A study of deep learning networks on mobile traffic forecasting. In: 2017 IEEE 28th annual international symposium on personal, indoor, and mobile radio communications (PIMRC) pp 1–6
Huang W, Song G, Hong H, Xie K (2014) Deep architecture for traffic flow prediction: deep belief networks with multitask learning. IEEE Trans Intell Transp Syst 15(5):2191–2201
Jie F, Chen X, Gao R et al (2018) DeepTP: an end-to-end neural network for mobile cellular traffic prediction. IEEE Netw 32(6):108–115
Jing W, Jian T, Xu Z (2017) Spatiotemporal modeling and prediction in cellular networks: a big data enabled deep learning approach. In: IEEE INFOCOM 2017-IEEE conference on computer communications, pp 1–9
Junsong W, Jiukun W, Maohua Z (2009) Prediction of internet traffic based on Elman neural network. In: 2009 Chinese control and decision conference. IEEE, pp 1248–1252
Katsaros D, Manolopoulos Y (2009) Prediction in wireless networks by Markov chains. IEEE Wirel Commun 16(2):56–64
Kumar SV, Vanajakshi L (2015) Short-term traffic flow prediction using seasonal ARIMA model with limited input data. Springer 7(3):1–9
Lecun Y, Bengio Y, Hinton G (2015) Deep learning. Nature 521(7553):436–444
Li R, Zhao Z, Zhou X (2014) The prediction analysis of cellular radio access network traffic: from entropy theory to networking practice. IEEE Commun Mag 52(6):234–240
Li X, Li S, Zhou P, Chen G (2022) Forecasting network interface flow using a broad learning system based on the sparrow search algorithm. Entropy. https://doi.org/10.3390/e24040478
Lian C, Zhu L, Zeng Z et al (2018) Constructing prediction intervals for landslide displacement using bootstrapping random vector functional link networks selective ensemble with neural networks switched. Neurocomputing 291(may24):1–10
Liu ZL, Chen CLP, Feng S, Feng QY, Zhang T (2021) Stacked broad learning system: from incremental flatted structure to deep model. IEEE Trans Syst Man Cybern Syst 51(1):209–222
Lv Y, Dua Y, Kang W, Li Z, Wang F (2015) Traffic flow prediction with big data: a deep learning approach. IEEE Trans Intell Transp Syst 16(2):865–873
Mukherjee A, Dey N, Mondal A et al (2021) iSocialDrone: QoS aware MQTT middleware for social internet of drone things in 6G-SDN slice. Soft Comput. https://doi.org/10.1007/s00500-021-06055-y
Pao YH, Park GH, Sobajic DJ (1994) Learning and generalization characteristics of the random vector Functional-link net. Neurocomputing 6(2):163–180
Sapankevych NI, Sankar R (2009) Time series prediction using support vector machine. IEEE Comput Intell Mag 4(2):24–38
Sciancalepore V, Samdanis K, Costa-Perez X, Bega D, Gramaglia M, Banchs A (2017) Mobile traffic forecasting for maximizing 5G network slicing resource utilization. In: IEEE INFOCOM 2017-IEEE conference on computer communications, IEEE, pp 1–9
Su H, Zhang H, Liang X et al (2020) Decentralized event-triggered online adaptive control of unknown large-scale systems over wireless communication networks. IEEE Trans Neural Netw Learn Syst 99:1–13
Sultan K, Ali H, Zhang Z (2018) Call detail records driven anomaly detection and traffic prediction in mobile cellular networks. IEEE Access 6:41728–41737
Van Der Voort M, Dougherty M, Watson S (1996) Combining Kohonen maps with ARIMA time series models to forecast traffic flow. Transp Res Part Emerg Technol 4(5):307–318
Wang J (2021) Edge artificial intelligence-based affinity task offloading under resource adjustment in a 5G network. Appl Intell. https://doi.org/10.1007/s10489-021-02786-5
Wang X, Zhou Z, Xiao F, Xing K, Yang Z, Liu Y, Peng C (2019) Spatio-temporal analysis and prediction of cellular traffic in metropolis. IEEE Trans Mob Comput 18(9):2190–2202
Williams BM, Hoel LA (2003) Modeling and forecasting vehicular traffic flow as a seasonal ARIMA process: theoretical basis and empirical results. J Transp Eng 129(6):664–672
Xu F, Lin Y, Huang J et al (2016) Big data driven mobile traffic understanding and forecasting: a time series approach. IEEE Trans Serv Comput 9(5):796–805
Xu Y, Yin F, Xu W, Lin J, Cui S (2019) Wireless traffic prediction with scalable gaussian process: framework, algorithms, and verification. IEEE J Sel Areas Commun 37:1291–1306
Yao C, Yang C, Chih-Lin I (2017) Data-driven resource allocation with traffic load prediction. J Commun Inf Netw 2(1):52–65
Zhang D, Shen D (2012) Multi-modal multi-task learning for joint prediction of multiple regression and classification variables in Alzheimer’s disease. Neuroimage 59:895–907
Zhang C, Zhang H, Yuan D, Zhang M (2018) Citywide cellular traffic prediction based on densely connected convolutional neural networks. IEEE Commun Lett 22:1656–1659
Zhang K, Zhao X, Li X, You X, Zhu Y (2021) network traffic prediction via deep graph-sequence spatiotemporal modeling based on mobile virtual reality technology. Wirel Communn Mob Comput. https://doi.org/10.1155/2021/2353875
Zhang C, Patras P (2018) Long-term mobile traffic forecasting using deep spatio-temporal neural networks. In: Proceedings of the eighteenth ACM international symposium on mobile Ad Hoc networking and computing, pp 231–240
Zhao Z, Chen W, Wu X, Chen PCY, Liu J (2017) LSTM network: a deep learning approach for short-term traffic forecast. IET Intel Transp Syst 11(2):68–75
Zhou Y, Fadlullah ZM, Mao B (2018) A deep-learning-based radio resource assignment technique for 5G ultra dense networks. IEEE Netw 32(6):28–34
Zhu L, Lian C, Zeng Z, Su Y (2020) A broad learning system with ensemble and classification methods for multi-step-ahead wind speed prediction. Cogn Comput 12(4):654–666
Acknowledgements
The work described in this paper is supported by the National Natural Science Foundation of China (No.U1936122), the Primary Research & Development Plan of Hubei Province (No.2020BA B101), and the Primary Research & Development Plan of Hubei Province (No.2020BAA003).
Funding
The authors have not disclosed any funding.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that there are no conflicts of interest regarding the publication of this paper.
Ethical approval
This article does not contain any studies with human participants or animals performed by any of the authors.
Additional information
Communicated by Oscar Castillo.
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Zhu, L., Zhao, B. & An, Y. A stacked broad learning system with multitask learning method for cellular wireless network traffic prediction. Soft Comput 27, 13445–13460 (2023). https://doi.org/10.1007/s00500-022-07718-0
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00500-022-07718-0