Skip to main content
SpringerLink
Log in

Network Performance Testing System Integrating Models for Automatic QoE Evaluation of Popular Services: YouTube and Facebook

  • Published:
Wireless Personal Communications Aims and scope Submit manuscript

Abstract

Smartphones have significantly changed the traffic pattern usage of mobile subscribers. In addition to the classical file sharing and web browsing usage, social networking applications and access to video content are now a significant percentage of the typical user data traffic consumption. As the change in usage pattern affects the performance of mobile networks, operators need methods to estimate how well the network behaves. The metrics to use for the evaluation of the quality of experience (QoE) are only well documented for traditional applications. In this paper a novel QoE system that automatically captures and processes the metrics needed to evaluate two commonly used applications, the social networking application Facebook and the video download application YouTube, is presented. The system uses a test application developed for Android phones, which report the results to a centralized platform capable of processing and presenting the results in different formats. The system has been used to test those two services over 3G/LTE network technologies. In the case of the YouTube services, performance results show a subjective score very similar for the 3G and LTE because of the automatic adaptation of the video coding rate to the network conditions. Testing of the Facebook application has led to the proposal of a new MOS expression that takes into account the content type being posted, which provides more reasonable MOS estimations than the generic web browsing models available in the literature and commonly used to estimate Facebook QoE.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15

Similar content being viewed by others

References

  1. Cisco Systems Inc.,(2013). Cisco visual networking index: Forecast and methodology, 2013–2018. http://www.cisco.com. Accessed Oct 2014.

  2. YouTube Press Room. (2014). Statistics. https://www.youtube.com/yt/press/statistics.html. Accessed Oct 2014.

  3. Experian Hitwise US. (2014). Social media trends. http://www.experian.com/hitwise/online-trends-social-media.html. Accessed Oct 2014.

  4. ITU-T, Recommendation. (1996). P.800. Methods for subjective determination of transmission quality. Available at http://www.itu.int/rec/T-REC-P.800-199608-I/en

  5. Begen, A., Akgul, T., & Baugher, M. (2011). Watching video over the web: Part 1: Streaming protocols. IEEE Internet Computing, 15(2), 54.

    Article  Google Scholar 

  6. Ameigeiras, P., Ramos-Munoz, J. J., Navarro-Ortiz, J., & Lopez-Soler, J. (2012). Analysis and modelling of youtube traffic. Transactions on Emerging Telecommunications Technologies, 23(4), 360.

    Article  Google Scholar 

  7. Gonzlez, R., & Wintz, P. (1987). Digital image processing (2nd ed.). London: Addison-Wesley Publishing Co.

    Google Scholar 

  8. Wang, Z., Lu, L., & Bovik, A. (2002). Video quality assessment using structural distortion measurement. In Proceedings on the 2002 International Conference on Image Processing, vol. 3, pp. 65–68.

  9. ITU-T, Recommendation. (2008). J.247. Objective perceptual multimedia video quality measurement in the presence of a full reference. Available at http://www.itu.int/rec/T-REC-J.247-200808-I/en

  10. ITU-T, Recommendation. (2004). J.144. Objective perceptual video quality measurement techniques for digital cable television in the presence of a full reference. Available at http://www.itu.int/rec/T-REC-J.144-200403-I/en

  11. Mok, R., Chan, E., & Chang, R. (2011). Measuring the quality of experience of http video streaming. In Integrated Network Management (IM), 2011 IFIP/IEEE International Symposium on, pp. 485–492.

  12. Gómez, G., Hortigüela, L., Pérez, Q., Lorca, J., García, R., & Aguayo-Torres, M.C. (2014). Youtube qoe evaluation tool for android wireless terminals. EURASIP Journal on Wireless Communications and Networking 2014, 2014, 164.

  13. Facebook Inc., (2014). Facebook developers. https://developers.facebook.com/. Accessed Oct 2014.

  14. Jung, I., Kim, H., Hong, D.K., & Ju, H. (2013). Protocol reverse engineering to facebook messages. In 2013 4th International conference on intelligent systems modelling simulation (ISMS), pp. 539–542.

  15. Casas, P., Sackl, A., Egger, S., & Schatz, R. (2012). Youtube and facebook quality of experience in mobile broadband networks. In IEEE Globecom Workshops, pp. 1269–1274.

  16. Ameigeiras, P., Ramos-Munoz, J. J., Navarro-Ortiz, J., Mogensen, P., & Lopez-Soler, J. M. (2010). QoE oriented cross-layer design of a resource allocation algorithm in beyond 3G systems. Computer Communications, 33(5), 571.

    Article  Google Scholar 

Download references

Acknowledgments

This work has been partly supported by the Spanish Government and FEDER under Grant TEC2013-44442-P, the Junta de Andalucía (Spain) under Grant 760423, and the European Union (European Regional Development Fund) and Corporación Tecnológica de Andalucía under Grant 13/680.

The authors would like to thank Iban Serrano Caballero, Rubén Reina Cuenca, Sergio Quintana Domínguez, Plácido López Gámez, Noelia Díaz Bernal, Noelia Guerra Melgares and Rafael Molina Jimena for their help in programming and testing both the Android App and the web application.

Author information

Authors and Affiliations

  1. Departamento de Ingeniería de Comunicaciones, Universidad de Málaga, Campus de Teatinos, 29071, Málaga, Spain

    Francisco Lozano, Gerardo Gómez, Mari-Carmen Aguayo-Torres, Janie Baños-Polglase & Javier Poncela

  2. Performance testing solutions, AT4 wireless, Parque Tecnológico de Andalucía, C/ Severo Ochoa, 2, 29590, Málaga, Spain

    Carlos Cárdenas, Antonio Plaza & Antonio Garrido

Authors
  1. Francisco Lozano
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Gerardo Gómez
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Mari-Carmen Aguayo-Torres
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Carlos Cárdenas
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Antonio Plaza
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Antonio Garrido
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Janie Baños-Polglase
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Javier Poncela
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Francisco Lozano.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Lozano, F., Gómez, G., Aguayo-Torres, MC. et al. Network Performance Testing System Integrating Models for Automatic QoE Evaluation of Popular Services: YouTube and Facebook. Wireless Pers Commun 81, 1377–1397 (2015). https://doi.org/10.1007/s11277-015-2479-y

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11277-015-2479-y

Keywords

Search

Navigation