Abstract
The rapid spread of smartphones and tablets in the last years has created a new software industry whose fast growth has propitiated numerous low-quality applications to be revised and improved. The main aim of this paper is to develop a tool to assess the Quality of Experience (QoE) of mobile Health (mHealth) applications in order to improve the quality of the existing apps and the ones to be released. Firstly, a review of the applications of mHealth has been done in order to obtain a general classification. Secondly, the tool for measuring the QoE is developed in the form of a survey with the help of psychologists. Finally, this tool is evaluated using a sample of applications selected with the aid of the classification obtained. A survey with 21 questions using the Likert scale and destined to users has been successfully created, and its evaluation has been positive, resulting in a good method for measuring the QoE of the different features that the applications in the field of health care usually have. The tool created can be very useful for developers in order to assess the quality of their health care apps, indicating their positive aspects and the ones which must be revised and improved, avoiding the releasing of low-quality apps.


Similar content being viewed by others
Abbreviations
- QoE:
-
Quality of experience
- mHealth:
-
Mobile health
- MOS:
-
Mean opinion score
References
Rai, A., Chen, L., Pye, J., and Baird, A., Understanding determinants of consumer mobile health usage intentions, assimilation, and channel preferences. J. Med. Internet Res. 15(8):e149, 2013.
Kumar, S., Nilsen, W. J., Abernethy, A., Atienza, A., Patrick, K., Pavel, M., et al., Mobile health technology evaluation: The mHealth evidence workshop. Am. J. Prev. Med. 45(2):228–236, 2013.
Fiordelli, M., Diviani, N., and Schulz, P. J., Mapping mHealth research: A decade of evolution. J. Med. Internet Res. 15(5):e95, 2013.
IDC, Press Release: Strong Demand for Smartphones and Heated Vendor Competition Characterize the Worldwide Mobile Phone Market at the End of 2012. http://www.idc.com/getdoc.jsp?containerId=prUS23916413#.UVBKiRdhWCn. Accessed 27 June 2013, 2013.
IDC, IDC Raises its Worldwide Tablet Forecast on Continued Strong Demand and Forthcoming New Product Launches. http://www.idc.com/getdoc.jsp?containerId=prUS23696912#.US9x86JhWCl. Accessed 27 June 2013, 2012.
Rowinski, D., The Data Doesn’t Lie: iOS Apps Are Better Than Android. Readwrite Mobile. http://readwrite.com/2013/01/30/the-data-doesnt-lie-ios-apps-are-better-quality-than-android. Accessed 27 June 2013, 2013
Jones, C., Apple and Google Continue to Gain US Smartphone Market Share. Forbes. http://www.forbes.com/sites/chuckjones/2013/01/04/apple-and-google-continue-to-gain-us-smartphone-market-share/. Accessed 27 June 2013, 2013.
Google, Google Play. https://play.google.com/store. Accessed 27 June 2013, 2013.
Apple, iTunes. http://www.apple.com/itunes/. Accessed 27 June, 2013.
Laghari, K. U. R., and Connelly, K., Toward total quality of experience: A QoE model in a communication ecosystem. Commun. Mag. IEEE 50(4):58–65, 2012.
Oyman, O., and Singh, S., Quality of experience for HTTP adaptive streaming services. Commun. Mag. IEEE 50(4):20–27, 2012.
Balachandran, A., Sekar, V., Akella, A., Seshan, S., Stoica, I., Zhang, H., A quest for an Internet video quality-of-experience metric. In: Proceedings of the 11th ACM Workshop on Hot Topics in Networks (HotNets-XI). New York, NY, USA: ACM 97–102, 2012. doi:10.1145/2390231.2390248.
Vissers, P. A., Thong, M. S., Pouwer, F., Zanders, M. M., Coebergh, J. W., van de Poll-Franse, L. V. The impact of comorbidity on health-related quality of life among cancer survivors: analyses of data from the PROFILES registry. J. Cancer Surviv. 2013 Aug 6. doi:10.1007/s11764-013-0299-1.
Agboma, F., and Liotta, A., Quality of experience management in mobile content delivery systems. Telecommun. Syst. 49(1):85–98, 2012.
Ickin, S., Wac, K., Fiedler, M., Janowski, L., Jin-Hyuk, H., and Dey, A. K., Factors influencing quality of experience of commonly used mobile applications. Commun. Mag. IEEE 50(4):48–56, 2012.
BlackBerry, BlackBerry World. http://appworld.blackberry.com/webstore/product/1/. Accessed 27 June 2013, 2013.
International Telecommunication Union, P.800.1: Mean Opinion Score (MOS) Terminology. International Telecommunication Union, Geneva, 2006.
Rahrer, T., Fiandra, R., Wright, S., Technical Report TR-126 Triple-play Services Quality of Experience (QoE) Requirements. Digital Subscriber Line Forum. http://www.broadband-forum.org/technical/download/TR-126.pdf. 2006.
Equalter, mobiCeliac (Scanner). Google Play. https://play.google.com/store/apps/details?id=equalter.mobiceliacreader&feature=search_result#?t=W251bGwsMSwyLDEsImVxdWFsdGVyLm1vYmljZWxpYWNyZWFkZXIiXQ. Accessed June 2013, 2013.
iBoo Mobile, Meds On Time. Google Play. https://play.google.com/store/apps/details?id=com.iboomobile.medsontime&feature=search_result#?t=W251bGwsMSwyLDEsImNvbS5pYm9vbW9iaWxlLm1lZHNvbnRpbWUiXQ.. Accessed 27 June 2013, 2012.
MEED COMMUNICATION, SCORE Cardio Test. Google Play. https://play.google.com/store/apps/details?id=com.meed.meed_cardio&feature=search_result#?t=W251bGwsMSwyLDEsImNvbS5tZWVkLm1lZWRfY2FyZGlvIl0. Accessed 27 June 2013, 2013.
mikecaroline2008, Hearing Tests. Google Play. https://play.google.com/store/apps/details?id=com.kk.tones&feature=search_result#?t=W251bGwsMSwxLDEsImNvbS5ray50b25lcyJd. Accessed 27 June 2013, 2012.
Azumio Inc, Instant Heart Rate. Google Play. https://play.google.com/store/apps/details?id=si.modula.android.instantheartrate&feature=search_result#?t=W251bGwsMSwxLDEsInNpLm1vZHVsYS5hbmRyb2lkLmluc3RhbnRoZWFydHJhdGUiXQ.. Accessed 27 June 2013, 2012.
Corusen LLC, Accupedo Pedometer. Google Play. https://play.google.com/store/apps/details?id=com.corusen.accupedo.te&feature=search_result#?t=W251bGwsMSwxLDEsImNvbS5jb3J1c2VuLmFjY3VwZWRvLnRlIl0. Accessed 27 June 2013, 2013.
Castillo, P. A., Reanimación Cardiorespiratoria. Google Play. https://play.google.com/store/apps/details?id=com.pacv.rcp&feature=search_result#?t=W251bGwsMSwxLDEsImNvbS5wYWN2LnJjcCJd. Accessed 27 June 2013, 2012.
Doctoralia, Doctoralia. Google Play. https://play.google.com/store/apps/details?id=com.doctoralia&feature=search_result#?t=W251bGwsMSwyLDEsImNvbS5kb2N0b3JhbGlhIl0. Accessed 27 June 2013, 2013.
Lo-mo Corp, Prospectos. Google Play. https://play.google.com/store/apps/details?id=com.lomocorp.prospectos&feature=search_result#?t=W251bGwsMSwxLDEsImNvbS5sb21vY29ycC5wcm9zcGVjdG9zIl0. Accessed 27 June 2013, 2011.
Tantor Systems, DAS28 - Rheumatod Artritis. Google Play. https://play.google.com/store/apps/details?id=tantor.systems.das28&feature=search_result#?t=W251bGwsMSwxLDEsInRhbnRvci5zeXN0ZW1zLmRhczI4Il0. Accessed 27 June 2013, 2012.
Vikas Shah, Anesthesiologist. Google Play. https://play.google.com/store/apps/details?id=com.shahlab.anesthesiologist&feature=search_result#?t=W251bGwsMSwxLDEsImNvbS5zaGFobGFiLmFuZXN0aGVzaW9sb2dpc3QiXQ. Accessed 27 June 2013, 2013.
Romo, J. M. A., Valores de laboratorio. Google Play. https://play.google.com/store/apps/details?id=com.medciclopedia.valoresdelaboratorio&feature=search_result#?t=W251bGwsMSwxLDEsImNvbS5tZWRjaWNsb3BlZGlhLnZhbG9yZXNkZWxhYm9yYXRvcmlvIl0. Accessed 27 June 2013, 2013.
Foundation Internet Services, MedCalc 3000 Complete. Google Play. https://play.google.com/store/apps/details?id=com.medcalc3000.complete&feature=search_result#?t=W251bGwsMSwxLDEsImNvbS5tZWRjYWxjMzAwMC5jb21wbGV0ZSJd. Accessed 27 June 2013, 2012.
IBM, IBM SPSS Statistics. http://www-01.ibm.com/software/analytics/spss/products/statistics/. Accessed 27 June 2013, 2013.
McLeod, S., Likert Scale. Simply Psychology. http://www.simplypsychology.org/likert-scale.html. Accessed 27 June 2013, 2008.
Acknowledgments
This research has been partially supported by Ministerio de Economía y Competitividad, Spain.
Conflicts of Interest
The authors declare that they have no conflict of interest.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Martínez-Pérez, B., de la Torre-Díez, I., Candelas-Plasencia, S. et al. Development and Evaluation of Tools for Measuring the Quality of Experience (QoE) in mHealth Applications. J Med Syst 37, 9976 (2013). https://doi.org/10.1007/s10916-013-9976-x
Received:
Accepted:
Published:
DOI: https://doi.org/10.1007/s10916-013-9976-x