Han Hu
ABSTRACT
Nowadays, the interest of real-time video streaming reaches a peak. To deal with the problem of packet loss and optimize users' Quality of Experience (QoE), Forward error correction (FEC) has been studied and applied extensively. The performance of FEC depends on whether the future loss pattern is precisely predicted, while the previous researches have not provided a robust packet loss prediction method. In this work, we propose LightFEC to make accurate and fast prediction of packet loss pattern. By applying long short-term memory (LSTM) networks, clustering algorithms and model compression methods, LightFEC is able to accurately predict packet loss in various network conditions without consuming too much time. According to the results of well-designed experiments, we find out that LightFEC outperforms other schemes on prediction accuracy, which improves the packet recovery ratio while keeping the redundancy ratio at a low level.
- Daron Acemoglu, Vasco M Carvalho, Asuman Ozdaglar, and Alireza Tahbaz-Salehi. 2012. The network origins of aggregate fluctuations. Econometrica, Vol. 80, 5 (2012), 1977--2016.Google Scholar
Cross Ref
- Ender Ayanoglu, Richard D Gitlin, Thomas F La Porta, Sanjoy Paul, and Krishan K Sabnani. 1997. Adaptive forward error correction system. US Patent 5,600,663.Google Scholar
- Peter L Bartlett. 1998. The sample complexity of pattern classification with neural networks: the size of the weights is more important than the size of the network. IEEE transactions on Information Theory, Vol. 44, 2 (1998), 525--536. Google ScholarDigital Library
- Monica Bianchini and Franco Scarselli. 2014. On the complexity of neural network classifiers: A comparison between shallow and deep architectures. IEEE transactions on neural networks and learning systems, Vol. 25, 8 (2014), 1553--1565.Google Scholar
- Jill M Boyce and Robert D Gaglianello. 1998. Packet loss effects on MPEG video sent over the public Internet. In Proceedings of the sixth ACM international conference on Multimedia. ACM, 181--190. Google ScholarDigital Library
- Colin Campbell. 1997. Constructive learning techniques for designing neural network systems. (1997).Google Scholar
- Sheng Cheng, Han Hu, Xinggong Zhang, and Zongming Guo. 2020. DeepRS: Deep-learning Based Network-Adaptive FEC for Real-Time Video Communications. arXiv preprint arXiv:2001.07852 (2020).Google Scholar
- Cisco. 2019. "Cisco Visual Networking Index: Forecast and Trends, 2017--2022 White Paper'. https://www.cisco.com/c/en/us/ solutions/collateral/service-provider/visual-networking-index-vni/white-paper-c11--741490.html.Google Scholar
- Alan D Clark, Ph D Fellow Iee, et almbox. 2001. Modeling the effects of burst packet loss and recency on subjective voice quality. (2001).Google Scholar
- Paulin Coulibaly, Francois Anctil, Ramon Aravena, and Bernard Bobée. 2001. Artificial neural network modeling of water table depth fluctuations. Water resources research, Vol. 37, 4 (2001), 885--896.Google Scholar
- M Argollo De Menezes and A-L Barabási. 2004. Fluctuations in network dynamics. Physical review letters, Vol. 92, 2 (2004), 028701.Google Scholar
- M. Ester. 1996. A Density-Based Algorithm for Discovering Clusters in Large Spatial Databases with Noise. Proc.int.conf.knowledge Discovery & Data Mining (1996). Google ScholarDigital Library
- Venkat Raju Gandikota, Bheemajun Reddy Tamma, and C Siva Ram Murthy. 2008. Adaptive FEC-based packet loss resilience scheme for supporting voice communication over ad hoc wireless networks. IEEE Transactions on Mobile Computing, Vol. 7, 10 (2008), 1184--1199. Google ScholarDigital Library
- Felix A Gers, Jürgen Schmidhuber, and Fred Cummins. 1999. Learning to forget: Continual prediction with LSTM. (1999). Google ScholarDigital Library
- Alex Graves and Jürgen Schmidhuber. 2005. Framewise phoneme classification with bidirectional LSTM and other neural network architectures. Neural networks, Vol. 18, 5--6 (2005), 602--610. Google ScholarDigital Library
- Klaus Greff, Rupesh K Srivastava, Jan Koutník, Bas R Steunebrink, and Jürgen Schmidhuber. 2016. LSTM: A search space odyssey. IEEE transactions on neural networks and learning systems, Vol. 28, 10 (2016), 2222--2232.Google Scholar
- Song Han, Huizi Mao, and William J Dally. 2015. Deep compression: Compressing deep neural networks with pruning, trained quantization and huffman coding. arXiv preprint arXiv:1510.00149 (2015).Google Scholar
- Yang He, Ping Liu, Ziwei Wang, Zhilan Hu, and Yi Yang. 2019. Filter pruning via geometric median for deep convolutional neural networks acceleration. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 4340--4349.Google ScholarCross Ref
- Sepp Hochreiter and Jürgen Schmidhuber. 1997. Long Short-Term Memory. Neural Computation, Vol. 9, 8 (1997), 1735--1780. Google ScholarDigital Library
- Wenyu Jiang and Henning Schulzrinne. 2000. Modeling of packet loss and delay and their effect on real-time multimedia service quality. In Proc. NOSSDAV.Google Scholar
- Michael Luby, Lorenzo Vicisano, Jim Gemmell, Luigi Rizzo, M Handley, and Jon Crowcroft. 2002. The use of forward error correction (FEC) in reliable multicast. Technical Report. RFC 3453, December. Google Scholar
- Jian-Hao Luo, Jianxin Wu, and Weiyao Lin. 2017. Thinet: A filter level pruning method for deep neural network compression. In Proceedings of the IEEE international conference on computer vision. 5058--5066.Google ScholarCross Ref
- Anthony J McAuley. 1990. Reliable broadband communication using a burst erasure correcting code. In ACM SIGCOMM Computer Communication Review, Vol. 20. ACM, 297--306. Google ScholarDigital Library
- Pavlo Molchanov, Arun Mallya, Stephen Tyree, Iuri Frosio, and Jan Kautz. 2019. Importance Estimation for Neural Network Pruning. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 11264--11272.Google ScholarCross Ref
- Abdelhamid Nafaa, Tarik Taleb, and Liam Murphy. 2008. Forward error correction strategies for media streaming over wireless networks. IEEE Communications Magazine, Vol. 46, 1 (2008), 72--79. Google ScholarDigital Library
- Chinmay Padhye, Kenneth J Christensen, and Wilfrido Moreno. 2000. A new adaptive FEC loss control algorithm for voice over IP applications. In Conference Proceedings of the 2000 IEEE International Performance, Computing, and Communications Conference (Cat. No. 00CH37086). IEEE, 307--313.Google ScholarCross Ref
- Kihong Park and Wei Wang. 1998. AFEC: An adaptive forward error correction protocol for end-to-end transport of real-time traffic. In Proceedings 7th International Conference on Computer Communications and Networks (Cat. No. 98EX226). IEEE, 196--205. Google ScholarDigital Library
- Rohit Puri and Kannan Ramchandran. 1999. Multiple description source coding using forward error correction codes. In Conference Record of the Thirty-Third Asilomar Conference on Signals, Systems, and Computers (Cat. No. CH37020), Vol. 1. IEEE, 342--346.Google ScholarCross Ref
- Madhu Sudan. 1997. Decoding of Reed Solomon codes beyond the error-correction bound. Journal of complexity, Vol. 13, 1 (1997), 180--193. Google ScholarDigital Library
- Kiri Wagstaff, Claire Cardie, Seth Rogers, Stefan Schrödl, et almbox. 2001. Constrained k-means clustering with background knowledge. In Icml, Vol. 1. 577--584. Google ScholarDigital Library
- Stephen B Wicker and Vijay K Bhargava. 1999. Reed-Solomon codes and their applications. John Wiley and Sons. Google ScholarDigital Library
- SHI Xingjian, Zhourong Chen, Hao Wang, Dit-Yan Yeung, Wai-Kin Wong, and Wang-chun Woo. 2015. Convolutional LSTM network: A machine learning approach for precipitation nowcasting. In Advances in neural information processing systems. 802--810. Google ScholarDigital Library
- M. Zhu and S. Gupta. 2017. To prune, or not to prune: exploring the efficacy of pruning for model compression. (2017).Google Scholar
Index Terms
- LightFEC: Network Adaptive FEC with a Lightweight Deep-Learning Approach
Recommendations
Bayesian traffic dynamics and packet loss prediction for video over IP networks
Designing good network-adaptive, error resilient video coders for IP networks is a challenging task. Video data packets can be lost as a consequence of congestion in the network, causing a degradation in video quality at the receiver side. Predicting ...
The analysis of packet loss prediction for Gilbert-model with loss rate uplink
In this paper the analysis of packet loss prediction for Gilbert-model with loss rate uplink is performed. Based on the loss rate uplinks, an iterative algorithm has been derived to compute a new loss probability function, which can adapt to the channel ...
Packet Loss Rate Prediction Using the Sparse Basis Prediction Model
The quality of multimedia communicated through the Internet is highly sensitive to packet loss. In this letter, we develop a time-series prediction model for the end-to-end packet loss rate (PLR). The estimate of the PLR is needed in several ...
Comments