Abstract
Introduction and penetration of high-speed and innovative mobile data services including social media and video services have been increasing significantly across the globe. This growth is driven by deployment and availability of capable and affordable mobile networks and smartphones. These trends have also been observed in Ethiopia as the country’s sole incumbent operator ethio telecom has expanded coverage and capacity of its mobile data network, especially for universal mobile telecommunications system (UMTS) network. The successful provision of these innovative services requires mobile operators to have continuous monitoring of the quality of their networks and customer satisfaction. To that end, this monitoring allows the operator to make timely network optimization, marketing and other relevant decisions that enhance service quality. Traditionally measurement and analysis of network quality of service (QoS) is performed using data from network management system (NMS) and drive/walk test (DT/WT). In recent times, the usage QoS data from crowdsourcing (CS) is also emerging as useful monitoring tool. However, all these methods do not fully capture users’ quality of experience (QoE), which is a function of not only network QoS but also other factors including subjective users’ technical literacy and opinion. As a result, operators have recently provided attention not only for QoS but also QoE. Yet, most quality related analyses are performed using data from only subjective survey, NMS, DT/WT, or CS. It is not straightforward to find quality investigation based on data from all the methods. More importantly, such quality investigation has not been made in the context of Ethiopia’s mobile market. In this paper, we perform QoS and QoE evaluation for UMTS mobile data service based on quality data from all NMS, WT, CS and subjective survey for a business area in Addis Ababa. The evaluation is made using downlink user throughput and mean opinion score (MOS) metrics. The obtained 50th percentile throughput results from NMS, WT and CS are good enough for web browsing and offline video streaming but not for high definition (HD) video calls and live HD video streaming. Furthermore, CS provides optimistic results compared to NMS and WT and its 90th percentile throughput is very good even for live HD video streaming. Moreover, the obtained MOS results from subjective survey almost fit to the QoS results, thus indicating that the network QoS is a significant contributor to users’ perceived QoE.
Keywords
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Cisco: Visual Networking Index: Global Mobile Data Traffic Forecast Update, 2016–2021, White Paper (2017)
HOT TELECOM: 4 Keys to Shaping Quality of Experience (2015)
Ethio telecom: 2011 EC first half business performance report (2019)
Haile, B.B., Bulti, D.A., Zerihun. B.M.: On the relevance of capacity enhancing 5G technologies for Ethiopia. In: CONFERENCE 2017, EICTC, Addis Ababa (2017)
Lakhtaria, K.I.: Enhancing QoS and QoE in IMS enabled next generation networks. Int. J. Appl. Graph Theor. Wirel. Ad Hoc Netw. Sens. Netw. 2(2), 61–71 (2010)
Schatz, R., Egger, S.: Vienna surfing – assessing mobile broadband quality in the field. In: Proceedings of the First ACM SIGCOMM Workshop on Measurements Up the Stack, Toronto, pp. 19–24 (2011)
Lin, H.Y., Hsieh, S.H., Chen, K.H., Wu, T.C.: Large-scale mobile internet performance measurement in Taiwan. In: 2014 6th International Conference on Ubiquitous and Future Networks, Shanghai, pp. 516–519 (2014)
Streijl, R.C., Winkler, S., Hands, D.S.: Mean Opinion Score (MOS) revisited: methods and applications, limitations and alternatives. Multimed. Syst. 22, 213–227 (2016)
Pedro, C., Raimund, S.: Quality of experience in cloud services: survey and measurements. Comput. Netw. 68, 149–165 (2018)
Universal Mobile Telecommunications System (UMTS): 3G Telecom Management: Principles and high level requirements, ETSI TS 132 101 V3.4.0 (2001)
Casas, P., Gardlo, B., Seufert, M., Wamser, F., Schatz R.: Taming QoE in cellular networks: from subjective lab studies to measurements in the Field. In: 2015 11th International Conference on Network and Service Management, Barcelona, pp. 237–245 (2015)
Reason to Complain Research, Ofcom Fieldwork (2016)
Customer Satisfaction Survey – Mobile Results, CICRA 16/10 (2016)
Ayele, J.: Quality of service evaluation of voice over UMTS network: the case of Addis Ababa. M.Sc. dissertation, Department of Electrical and Computer Engineering, Addis Ababa Institute of Technology, Addis Ababa (2017)
Alemayehu, B.: Evaluation of user side quality of service measurement techniques for Addis Ababa LTE data service. M.Sc. dissertation, Department of Electrical and Computer Engineering, Addis Ababa Institute of Technology, Addis Ababa (2018)
Ken’s Tech Tips. https://kenstechtips.com/index.php/download-speeds-2g-3g-and-4g-actual-meaning. Accessed 01 Aug 2018
Rodriguez, D.Z., Rosa, R., Nunes, R.D., Affonso, E.T.: Assessment of quality-of-experience in telecommunication services. Int. J. Dig. Inf. Wirel. Commun. 6(4), 241–259 (2016)
Wang, Y., Zhou, W., Zhang, P.: QoE Management in Wireless Networks. Springer, Heidelberg (2017)
Massam, P.: Intelligent CEM Making the NPS Connection, A Huawei White Paper, Huawei (2015)
Gupta, S., Garg, R.: Taxonomy of tools and techniques for network monitoring and quality assurance in 3G networks. Int. J. Comput. Appl. 120(21), 34–41 (2015)
Afroz, F., Subramanian, R., Heidary, R., Sandrasegaran, K., Ahmed, S.: SINR, RSRP, RSSI and RSRQ measurements in long term evolution networks. Int. J. Wirel. Mob. Netw. 7(4), 113–123 (2015)
Palazon, J.A., Sepulcre, M., Gozalvez, J., Orozco, J., Lopez, O.: Heterogeneous wireless connectivity for fixed and mobile sensing applications in industrial environments. In: Proceedings of the 16th IEEE International Conference on Emerging Technologies and Factory Automation, Toulouse, pp. 1–8 (2011)
BEREC Preliminary report in view of a common position on monitoring mobile coverage. BEREC BoR (17), 186 (2017)
Lipenbergs, E., Bobrovs, V., Ivanovs, G.: Investigation of service quality of measurement reference points for the internet services on mobile networks. Latvian J. Phys. Tech. Sci. 5, 64–73 (2016)
Kousias, K., Lutu, A., Midoglu, C., Argyriou, A., Alay, O., Riegler, M.: The same, only different: contrasting mobile operator behavior from crowdsourced dataset. In: IEEE 28th Annual International Symposium on Personal, Indoor, and Mobile Radio Communications, Montreal, pp. 1–6 (2017)
Khatouni, A.S., et al.: Speedtest-like measurements in 3G/4G networks: the MONROE experience. In: IEEE 2017 29th International Teletraffic Congress (ITC 29), Genoa, pp. 169–177 (2017)
Elkotob, M., Grandlund, D., Andersson, K., Ahlund, C.: Multimedia QoE optimized management using prediction and statistical learning. In: 35th Annual IEEE Conference on Local Computer Networks, Denver, pp. 324–327 (2010)
Acknowledgment
This research work is undertaken by the MSc. Telecom Engineering program jointly developed and implemented by ethio telecom and Addis Ababa Institute of Technology. To attain relevant research data, we are supported by staffs of ethio telecom (Departments of Service Management Center, Engineering and Customer Service Front Office).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Reesom Bisrat, A., Haile, B.B., Mutafungwa, E., Hämäläinen, J. (2019). Quality Evaluation for Indoor Mobile Data Customers in Addis Ababa Business Area Using Data from Network Management System, Walk Test, Crowdsourcing and Subjective Survey. In: Mekuria, F., Nigussie, E., Tegegne, T. (eds) Information and Communication Technology for Development for Africa. ICT4DA 2019. Communications in Computer and Information Science, vol 1026. Springer, Cham. https://doi.org/10.1007/978-3-030-26630-1_14
Download citation
DOI: https://doi.org/10.1007/978-3-030-26630-1_14
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-26629-5
Online ISBN: 978-3-030-26630-1
eBook Packages: Computer ScienceComputer Science (R0)