Abstract
Multimedia applications have recently been challenging existing mobile access networks and are raising the bar for next generation mobile networks (NGMN), both in terms of network traffic as well as in the expectations of end users. At the same time, the network and server landscape sees changes due to the advent of virtualization and split-architecture networks like OpenFlow. In this heterogeneous environment, quantitative measurement and prediction of the user’s Quality of Experience (QoE) require testbeds capable of studying these effects combined as well as in isolation, in a controlled and reproducible manner. In this paper, we present the design and architecture of QoE-Lab, a multi-purpose heterogeneous testbed that supports a variety of networking conditions to evaluate QoE in future Internet scenarios. QoE-Lab includes 1) NGMN networks, 2) access/backbone network emulation, and 3) virtualization. It provides services like traffic generation, topology emulation and high-precision cross-layer monitoring. The experiments are provisioned, orchestrated and analyzed by a tool called ExpAuto. We analyze the experimental results for relationships between network performance and user perception. We report initial results from our studies, qualitatively indicating that each of the discussed components has a significant impact on the QoE.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
VMware vSphere HypervisorTM (ESXi), http://goo.gl/Eyhqe
Cisco.com: Cisco Visual Networking Index: Global Mobile Data Traffic Forecast Update (2009-2014), http://goo.gl/xxLT
Mobile TV Market: Analysis and Opportunities (2010-2015), http://goo.gl/XBUWm
NetFPGA, http://netfpga.org/
OpenWrt Wireless Freedom, http://openwrt.org/
TCPDUMP, http://www.tcpdump.org/
Tcpreplay, http://tcpreplay.synfin.net/
The Linux Foundation, Network Emulation, http://goo.gl/YvN9
Definition of Quality of Experience. In: ITU-T: Appendix I to P.10/G.100 (2007)
Barham, P., Dragovic, B., Fraser, K., Hand, S., Harris, T., Ho, A., Neugebauer, R., Pratt, I., Warfield, A.: XEN and the art of virtualization. In: Proceedings of ACM SOSP (2003)
Beheshti, N., Ganjali, Y., Ghobadi, M., McKeown, N., Salmon, G.: Experimental study of router buffer sizing. In: Proceedings of ACM IMC (2008)
Belmudez, B., Möller, S., Lewcio, B., Raake, A., Mehmood, A.: Audio and video channel impact on perceived audio-visual quality in different interactive contexts. In: Proceedings of IEEE MMSP (October 2009)
Carson, M., Santay, D.: NISTNet: A Linux-based network emulation tool. In: Proceedings of ACM CCR, vol. 33 (2003)
Gude, N., Koponen, T., Pettit, J., Pfaff, B., Casado, M., McKeown, N., Shenker, S.: NOX: towards an operating system for networks. In: Proceedings of ACM CCR, vol. 38 (July 2008)
ITU-T Rec. G.107. The E-model, a Computational Model for Use in Transmission Planning. ITU (2009)
ITU-T Rec. P.800. Methods of Subjective Determination of Transmission Quality. ITU (1996)
ITU-T Rec. P.862. Perceptual Evaluation of Speech Quality(PESQ): An Objective Method for End-to-End Speech Quality Assessment of Narrow-Band Telephone Networks and Speech Codecs. ITU (2001)
Kivity, A., Kamay, Y., Laor, D., Lublin, U., Liguori, A.: KVM: the Linux Virtual Machine Monitor. In: Proceedings of the Linux Symposium (2007)
Levin, D., Wundsam, A., Mehmood, A., Feldmann, A.: Berlin: The Berlin Experimental Router Laboratory for Innovative Networking. In: Magedanz, T., Gavras, A., Thanh, N.H., Chase, J.S. (eds.) TridentCom 2010. LNICST, vol. 46, pp. 602–604. Springer, Heidelberg (2011)
Lewcio, B., Wältermann, M., Möller, S., Vidales, P.: E-model supported switching between narrowband and wideband speech quality. In: Proceedings of QoMEX, San Diego, CA, United States (2009)
Maier, G., Schneider, F., Feldmann, A.: A First Look at Mobile Hand-Held Device Traffic. In: Krishnamurthy, A., Plattner, B. (eds.) PAM 2010. LNCS, vol. 6032, pp. 161–170. Springer, Heidelberg (2010)
McKeown, N., Anderson, T., Balakrishnan, H., Parulkar, G., Peterson, L., Rexford, J., Shenker, S., Turner, J.: OpenFlow: Enabling innovation in campus networks. In: Proceedings of ACM CCR, vol. 38 (2008)
Mehmood, M.A., Lewcio, B., Vidales, P., Möller, S.: Understanding Signal-Based Speech Quality Prediction in Future Mobile Communications. In: Proceedings of IEEE International Conference on Communications, ICC (2010)
Mehmood, M.A., Sengul, C., Sarrar, N., Feldmann, A.: Understanding Cross-Layer Effects on Quality of Experience for Video over NGMN. In: Proceedings of IEEE International Conference on Communications, ICC (2011)
Kim, T. T.: PlanetLab. Princeton University, http://www.planet-lab.org/
Raake, A., Garcia, M.-N., Möller, S., Berger, J., Kling, F., List, P., Johann, J., Heidemann, C.: T-V-Model: Parameter-based Prediction of IPTV Quality. In: Proceedings of the IEEE ICASSP 2008 (2008)
Rizzo, L.: Dummynet: A Simple Approach to the Evaluation of Network Protocols. In: Proceedings of ACM CCR, vol. 27 (1997)
Soldani, D.: Bridging QoE and QoS for Mobile Broadband Networks. In: ETSI Workshop on QoS, QoE and User Experience Focusing on Speech, Multimedia Conference Tools (2010)
Sommers, J., Barford, P.: Self-configuring network traffic generation. In: Proceedings of ACM IMC (2004)
Vidales, P., Kirschnick, N., Steuer, F., Lewcio, B., Wältermann, M., Möller, S.: Mobisense Testbed: Merging User Perception and Network Performance. In: Proceedings of TridentCom (2008)
Yoo, J., Huhn, T., Kim, J.: Active capture of wireless traces: overcome the lack in protocol analysis. In: Proceedings of WiNTECH (2008)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 ICST Institute for Computer Science, Social Informatics and Telecommunications Engineering
About this paper
Cite this paper
Mehmood, M.A., Wundsam, A., Uhlig, S., Levin, D., Sarrar, N., Feldmann, A. (2012). QoE-Lab: Towards Evaluating Quality of Experience for Future Internet Conditions. In: Korakis, T., Li, H., Tran-Gia, P., Park, HS. (eds) Testbeds and Research Infrastructure. Development of Networks and Communities. TridentCom 2011. Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering, vol 90. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-29273-6_22
Download citation
DOI: https://doi.org/10.1007/978-3-642-29273-6_22
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-29272-9
Online ISBN: 978-3-642-29273-6
eBook Packages: Computer ScienceComputer Science (R0)