Skip to main content
Log in

A Testbed for Evaluating Video Streaming Services in LTE

  • Published:
Wireless Personal Communications Aims and scope Submit manuscript

Abstract

With the deployment of the first commercial long term evolution (LTE) networks, mobile operators need to understand how quality of service (QoS) network indicators and codec parameters affect subjective quality in video streaming services as perceived by customers. In this paper, the development of a testbed for evaluating the quality of experience (QoE) of 3D video streaming service over LTE is described. The proposed system consists of three elements: a streaming server, an internet protocol-level mobile network emulator, based on NetEm tool, and a streaming client. The main contribution of this testbed is the modification of NetEm code to model the impact of time correlation between packet arrivals on the packet delay in a video stream. In the testbed, different network conditions are configured by setting network emulator parameters based on the results obtained by a system-level LTE simulator. Results show how average network load and user position inside a cell have a strong impact on the QoS and QoE perceived by the end video user.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11

Similar content being viewed by others

References

  1. Ericsson Mobility Report, Ericsson, 2015. http://www.ericsson.com/res/docs/2015/mobility-report/ericsson-mobility-report-nov-2015.pdf.

  2. Banerjee, A. (2014). Revolutionizing CEM with subscriber-centric network operations and QoE strategy, White paper, Heavy Reading.

  3. Top 10 Technologies for mobile broadband traffic management. Disruptive Analysis, (2010).

  4. Rescorla, E. (2001). SSL and TLS: Designing and building secure systems. Reading, MA: Addison-Wesley Pub Co.

    Google Scholar 

  5. Sodagar, I. (2011). The MPEG-DASH standard for multimedia streaming over the internet. IEEE MultiMedia, 18(4), 62–67.

    Article  Google Scholar 

  6. QUIC protocol official website, https://www.chromium.org/quic. Accessed April 03, 2015.

  7. Fiedler, M., Hossfeld, T., & Tran-Gia, P. (2010). A generic quantitative relationship between quality of experience and quality of service. IEEE Network, 24(2), 36–41.

    Article  Google Scholar 

  8. Opinion model for video-telephony applications. ITU-T Recommendation G.1070, (2012).

  9. Objective perceptual video quality measurement techniques for digital cable television in the presence of a full reference. ITU-T Recommendation J.144, (2004).

  10. Rahrer, T., Fiandra, R., & Wright, S. (2006). Triple-play services quality of experience (QoE) requirements. DSL Forum TR-126.

  11. Erman, B., & Matthews, E. P.(2008). Analysis and realization of IPTV service quality. Bell Labs Technical Journal, 12(4), 195–212. http://dx.doi.org/10.1002/bltj.20276.

  12. Methodology for the subjective assessment of the quality of television pictures. ITU-R Rec. BT. 500-11, (2002)

  13. Pinson, M. H., Wolf, S., & Cermak, G. (2010). HDTV subjective quality of H.264 vs. MPEG-2, with and without packet loss. IEEE Transactions on Broadcasting, 56(1), 86–91.

    Article  Google Scholar 

  14. Kulik, I., & Trinh, T. A. (2011). Ch. Investigation of quality of experience for 3D streams in gigabit passive optical network. In Energy-aware communications: Proceedings of the 17th International workshop, EUNICE 2011, Dresden, Germany (pp. 157–168). Berlin: Springer, September 5–7, 2011.

  15. Liu, Z., Qiao, Y., Lee, B., Fallon, E., AK, K., Zhang, C., & Zhang, S. (2011) Experimental evaluation of H.264/multiview video coding over IP networks, Irish Signal and Systems Conference (ISSC), Trinity College Dublin.

  16. Jean, C., Melo, A., Douglas, A., Abelém, A., Cerqueira, E., Neto, A., Riker, A., & Curado, M. (2012). QoE-based packet drop control for 3D-video streaming over wireless networks. In Proceedings of the 7th Latin American networking conference, LANC ’12, ACM, New York, NY, USA (pp. 59–66).

  17. Singh, S., Oyman, O., Papathanassiou, A., Chatterjee, D., & Andrews, J. G.(2012) Video capacity and QoE enhancements over LTE. In 2012 IEEE international conference on communications (ICC) (pp. 7071–7076).

  18. Barakovic, S., & Skorin-Kapov, L. (2013). Survey and challenges of QoE management issues in wireless networks. Journal of Computer Networks and Communications, 2013, 28.

    Article  Google Scholar 

  19. Palomo, I., Solera, M.,Toril, M., Poncela-Gonzalez, J., & Gomez, G. (2014). Maqueta de sistema para la evaluacin del servicio de video streaming 3D sobre LTE. In URSI 2014, Valencia (Spain).

  20. Gomez, G., Poncela-Gonzalez, J., Aguayo-Torres, M.C., & Entrambasaguas, J. T. (2009). Ch. A real-time end-to-end testbed for evaluating the performance of multimedia services. In Proceedings of the future multimedia networking: Second international workshop, FMN 2009, Coimbra, Portugal (pp. 212–217). Berlin: Springer, June 22–23, 2009.

  21. Uppu, S. P. (2013). QoE of video streaming over LTE network. MS Thesis.

  22. Linux fundation website, http://www.linuxfoundation.org/collaborate/workgroups/networking/netem. Accessed March, 2016.

  23. Vetro, A., Tourapis, A. M., Muller, K., & Chen, T. (2011). 3D-TV content storage and transmission. IEEE Transactions on Broadcasting, 57(2), 384–394.

    Article  Google Scholar 

  24. ITU-T and ISO/IEC JTC 1 (2010). Advanced video coding for generic audiovisual services, ITU-T Recommendation H.264 and ISO/IEC 14496-10 (MPEG-4 AVC).

  25. Tech, G., Chen, Y., Mller, K., Ohm, J. R., Vetro, A., & Wang, Y. K. (2016). Overview of the multiview and 3d extensions of high efficiency video coding. IEEE Transactions on Circuits and Systems for Video Technology, 26(1), 35–49. doi:10.1109/TCSVT.2015.2477935.

    Article  Google Scholar 

  26. Tech, G., Wegner, K., Chen, Y., Hannuksela, M., & Boyce, J. (2014). MV-HEVC Draft Text 9. ISO/IEC JTC1/SC29/WG11, MPEG/m34571, JCT3V-I1002, Sapporo, Japan.

  27. Tech, G., Wegner, K., Chen, Y., Yea, S. (2015). 3D-HEVC Draft Text 7. ISO/IEC JTC1/SC29/WG11, MPEG/m36127, JCT3V-K1001, Geneva, Switzerland.

  28. Gurler, C. G., Gorkemli, B., Saygili, G., & Tekalp, A. M. (2011). Flexible transport of 3-D video over networks. Proceedings of the IEEE, 99(4), 694–707.

    Article  Google Scholar 

  29. Videolan website, http://www.videolan.org/vlc/. Accessed March, 2016.

  30. Wireshark website, https://www.wireshark.org/. Accessed March, 2016.

  31. Hemminger, S. (2005) Network emulation with netem. Open source development lab.

  32. Jurgelionis, A., Laulajainen, J. P., Hirvonen, M., & Wang, A. I. (2011). An empirical study of netem network emulation functionalities. In Proceedings of 20th international conference on computer communications and networks (ICCCN) (pp. 1–6).

  33. Sliwinski, J., Beben, A., & Krawiec, P. (2010) Empath: Tool to emulate packet transfer characteristics in IP network. In Proceedings of the second international conference on traffic monitoring and analysis, TMA’10, Springer, Berlin (pp. 46–58).

  34. Gomez, G., Morales-Jimenez, D., Sanchez-Sanchez, J. J., & Entrambasaguas, J. T. (2010). A next generation wireless simulator based on MIMO-OFDM: LTE case study. EURASIP Journal on Wireless Communication and Networking 2010, 15(1–15), 12.

    Google Scholar 

  35. 3D Bullinger video. http://sp.cs.tut.fi/mobile3dtv/video-plus-depth/.

  36. How to create NetEm distribution tables. http://piao-tech.blogspot.com.es/2009/10/how-to-create-netem-distribution-tables.html.

  37. Pinson, M. H., Barkowsky, M., & Le Callet, P. (2013). Selecting scenes for 2d and 3d subjective video quality tests. EURASIP Journal on Image and Video Processing, 2013(1), 50. doi:10.1186/1687-5281-2013-50.

    Article  Google Scholar 

  38. 3GPP TS 23.203, v13.6.0 (2015) Policy and charging control architecture.

  39. HHI Fraunhofer Institute. Developer group of JM 18.5 coding/decoding tool, http://iphome.hhi.de/suehring/tml/download/.

  40. IETF, RFC 3550. (2003). RTP: A transport protocol for real-time applications.

  41. ffmpeg website, https://www.ffmpeg.org/. Accessed March, 2016.

Download references

Acknowledgements

This work was funded by the Spanish Ministry of Economy and Competitiveness (Grants TEC2015-69982-R and TEC2013-44442-P). In addition, the authors wish to acknowledge the collaboration of Almudena Sanchez Martinez and Francisco Blanquez Casado in carrying out the experiments.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to M. Solera.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Solera, M., Toril, M., Palomo, I. et al. A Testbed for Evaluating Video Streaming Services in LTE. Wireless Pers Commun 98, 2753–2773 (2018). https://doi.org/10.1007/s11277-017-4999-0

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11277-017-4999-0

Keywords

Mathematics Subject Classification

Navigation