Skip to main content
SpringerLink
Log in

A virtualization mechanism for real-time multimedia-assisted mobile food recognition application in cloud computing

  • Published:
Cluster Computing Aims and scope Submit manuscript

Abstract

The integration of multimedia-assisted healthcare systems with could-computing services and mobile technologies has led to increased accessibility for healthcare providers and patients. Utilizing cloud computing infrastructures and virtualization technologies allows for the transformation of traditional healthcare systems that demand manual care and monitoring to more salient, automatic and cost effective systems. The goal of this paper is to develop a multimedia-assisted mobile healthcare application using cloud-computing virtualization technologies. We consider calorie measurement as an example healthcare application that can benefit from cloud-computing virtualization technology. The key functionalities of our application entail image segmentation, image processing and deep learning algorithms for food classification and recognition. Client side devices (e.g. smartphones, tablets etc.) have limitations in handling time sensitive and computationally intensive algorithms pertained to our application. Image processing and deep learning algorithms, used in food recognition and calorie measurement, consume devices’ batteries quickly, which is inconvenient for the user. It is also very challenging for client side devices to scale for large number of data and images, as needed for food recognition. The entire process is time-consuming and inefficient and discomforting from users’ perspective and may deter them from using the application. In this paper, we address these challenges by proposing a virtualization mechanism in cloud computing that utilizes the Android architecture. Android allows for parting an application into activities run by the front-end user and services run by the back-end tasks. In the proposed virtualization mechanism, we use both the hosted and the hypervisor models to publish our Android-based food recognition and calorie measurement application in the cloud. By so doing, the users of our application can control their virtual smartphone operations through a dedicated client application installed on their smartphones, while the processing of the application continue to run on the virtual Android image even if the user is disconnected due to any unexpected event. We have performed several experiments to validate our mechanism. Specifically, we have run our deep learning and image processing algorithms for food recognition on different configuration platforms on both the cloud and local server connected to the mobile. The results show that the accuracy of the system with the virtualization mechanism is more than 94.33 % compared to 87.16 % when we run the application locally. Also, with our virtualization mechanism the results are processed 49 % faster than the case of running the application locally.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others

References

  1. Bamiah M., Brohi S., Chprat S., AB Manan J.L. : A study on significance of adopting cloud computing paradigm in healthcare sector. In: IEEE International Conference on Cloud Computing Technology, Applications and Management (ICCTAM), pp. 65–68, (2012)

  2. Seoyoung, K., Jok-Soo, K., Soonwook, H., Yoonhee, K.: Towards effective sceince cloud provisioning for a large-scale high-throughput computing. Clust. Comput. J. 17(4), 1157–1169 (2014). doi:10.1007/s10586-014-0371-2

    Article  Google Scholar 

  3. Myoungjin, K., Seungho, H., Yun, C., Hanku, L., Hogyeon, C., Sungdae, H.: CloudDMSS robust hadoop-based multimedia streaming service architecture for a cloud computing environment. Clust. Comput. J. 17(3), 605–628 (2014)

    Article  Google Scholar 

  4. Pouladzadeh P., Bharat Peddi S.V., Kuhad P., Yassine A., Shirmohammadi S.: Mobile cloud based food calorie measurement. In: IEEE International Confernce on Multimedia and Expo Workshops (ICMEW), pp. 1–6, Chengdu, China (2014)

  5. Pouladzadeh, P., Shirmohammadi, S., Bakirov, A., Bulut, A., Yassine, A.: Cloud-Based SVM for food categorization. Springer’s J. Multimed. Tools Appl. (2014). doi:10.1007/s11042-014-2116-x

  6. Pouladzadeh P., Shirmohammadi S., Yassine A.: Using graph cut segmentation for food calorie measurement. In: IEEE International Symposium on Medical Measurements and applications, pp. 1–6, Lisbon, (2014)

  7. Hlavacek J., Bestak R.: Configuration of live migration for VoIP applications. In: MECHATRONIKA, 15th International Symposium, 5–7 Dec. pp. 1–4 (2012)

  8. VMware “Understanding full virtualization, para- virtualization, and hardware Assist” White Paper Available at http://www.vmware.com/resources/techresources/1008. Accessed 14 Sept 2014

  9. Kato Y., Suzuki T., Kobayashi K., Nakauchi Y.: A web application for an obesity prevention system based on individual lifestyle analysis. In: IEEE International conference on Systems, Man, and Cybernetics (SMC), pp. 1718–1723, Seoul (2012)

  10. Chen H.C., Jia W., Li Z., Sun Y., Sun M.: 3D/2D model-to-image registration for quantitative dietary assessment. In: Bioengineering Conference (NEBEC), 38th Annual Northeast, pp. 95–96, 16–18 March (2012)

  11. Sun M., Liu Q., Schmidt K., Yang J., Yao N., Fernstrom J.D., Fernstrom M.H., DeLany J.P., Sclabassi R.J.: IEEE International EMBS Conference on Determination of Food Portion Size by Image Processing, pp. 871–874, (2008)

  12. Saeki, Y., Takeda, F.: Proposal of food intake measuring system in medical use and its discussion of practical capability. Knowl.-based Intell. Inf. Eng. Syst. 3683, 1266–1273 (2005)

    Google Scholar 

  13. Martin, C.K., Kaya, S., Gunturk, B.K.: Quantification of food intake using food image analysis. Int. Conf. IEEE Eng. Med. Biol. Soc. 2009, 6869–6872 (2009)

    Google Scholar 

  14. Zhua F., Mariappana A., Bousheyb C.J., Kerrd D., Lutesc K.D., Eberta D.S., Delp E.J.: Technology-assisted dietary assessment. Computational Imaging VI, Proceedings of SPIE-IS&T Electronic Imaging, SPIE vol. 6814, p. 681411 (2008)

  15. Sobhy D., El-Sonbaty Y., Abou Elnasr M.: MedCloud heathcare cloud computing system. In: IEEE International Conference on Internet Technology and Secured Transactions, pp. 161–166 (2012)

  16. Doan B.H. and Chen L.: Mobile cloud for assistive healthcare. IEEE Asia-Pacific Serices Computing Conference APSCC, pp. 325–332, (2010)

  17. Yong, W.A., Cheng, A.M.K., Baek, J., Jo, M., Chen, H.: An auto-scaling mechinam for virtual resources to support mobile, pervasive, real-time healthcare applications in cloud computing. IEEE Netw. 27(5), 62–68 (2013)

    Article  Google Scholar 

  18. Harini M., Bhairavi K., Gopicharan R., Kirupa G., Vaidehi V.: Virtualization of healthcare sensors in cloud. IEEE International Conference on Recent Trends in Information Technology, pp. 663–667, (2013)

  19. Hossain, M.S., Muhammad, G.: Cloud-based collaborative media service framework for health-care. Int. J. Distrib.Sens. Netw. (2014)

  20. Hossain, M.S., Muhammad, G.:Cloud-assisted speech and face recognition framework for health monitoring. Mob. Netw. Appl., pp. 1–9 (2015)

  21. Skurski, A., Swiercz, B.: VNC-based remote control for symbian OS smartphones. In: 16th International Conference on Mixed Design of Integrated Circuit and Systems, June 25–27, Lodi, Poland, MIXDES (2009)

  22. Kemp, R., Palmer,N., Kielmann, T., Bal, H.: Cuckoo: a computation offloading framework for smartphones. In: Proceedings of The Second International Conference on Mobile Computing, Applications, and Services, MobiCASE’10 (2012)

  23. Van Nieuwpoort, R., Maassen, J., Wrzesińska, G., Hofman, R., Jacobs, C., Kielmann, T., Bal, H.: Ibis: a flexible and efficient java based grid programming environment. Concurr. Comput. 17, 1079–1107 (2005)

    Article  Google Scholar 

  24. Chen, E.Y., Itoh, M.: Virtual smartphone over IP. In: IEEE International Symposium on World of Wireless Mobile and Multimedia Networks (WoWMoM) (2010)

  25. Kemp, R., Palmer, N., Kielmann, T., Seinstra, F., Drost, N., Maassen, J., Bal, H.E.: EyeDentify : multimedia cyber foraging from a smartphone. In: IEEE International Symposium on Multimedia (2009)

  26. Alamri, A., Hassan, M.M., Hossain, M.A., Al-Qurishi, M., Aldukhayyil, Y., Shamim, M.: Evaluating the impact of a cloud-based serious game on obese people. Comput. Hum. Behav. 30, 468–475 (2014)

    Article  Google Scholar 

  27. Krizhevsky, A., Sutskever, I., Hinton, G.: ImageNet classification with deep convolutional neural networks. Adv. Neural Inf. Process. Syst. (NIPS) (2012)

  28. Srivastava, N., Salakhutdinov, R.: Multimodal learning with deep Boltzmann machines. In: Proceedings Neural Information and Processing System (2012)

  29. Pouladzadeh, P., Shirmohammadi, S., Almaghrabi, R.: Measuring calorie and nutrition from food image. IEEE Trans. Instrum. Meas 63(8), 1947–1956 (2014)

  30. Matusiak, K., Skulimowski, P., Strumillo, P.: Object recognition in a mobile phone application for visually impaired users. In: The 6th International Conference on Human System Interaction (HSI), pp. 479–484, 6–8 June (2013)

  31. Kemp, R., Palmer, N., Kielmann, T., Seinstra, F., Drost, N., Maassen, J., Bal, H.: eyeDentify: 11th IEEE International Symposium on Multimedia Cyber Foraging from a Smartphone, pp. 392–399, 14–16 Dec. (2009)

  32. Okamoto, K., Yanai, K.: Real-time eating action recognition system on a smartphone. In: IEEE International Conference on Multimedia and Expo Workshops (ICMEW), pp. 1–6, 14–18 July 2014 doi:10.1109/ICMEW.2014.6890718

  33. Hoashi, H., Joutou, T., Yanai, K.: Image recognition of 85 food categories by feature fusion. In: IEEE International Symposium on Multimedia (ISM), pp. 296–301, 13–15 Dec. 2010 doi:10.1109/ISM.2010.51

  34. Yang, S., Chen, M., Pomerleau, D., Sukthankar, R.: Food recognition using statistics of pairwise local features. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 2249–2256, 13–18 June (2010)

  35. Zong, Z., Nguyen, D.T., Ogunbona, P., Li, W.: On the combination of local texture and global structure for food classification. In: IEEE International Symposium on Multimedia (ISM), pp. 204–211, 13–15 Dec. (2010)

Download references

Author information

Authors and Affiliations

  1. Distributed and Collaborative Virtual Environments Research Laboratory, University of Ottawa, Ottawa, Canada

    Parisa Pouladzadeh, Sri Vijay Bharat Peddi, Pallavi Kuhad, Abdulsalam Yassine & Shervin Shirmohammadi

  2. Colleges of Engineering and Natural Sciences, Istanbul şehir University, Istanbul, Turkey

    Parisa Pouladzadeh, Sri Vijay Bharat Peddi, Pallavi Kuhad, Abdulsalam Yassine & Shervin Shirmohammadi

Authors
  1. Parisa Pouladzadeh
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Sri Vijay Bharat Peddi
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Pallavi Kuhad
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Abdulsalam Yassine
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Shervin Shirmohammadi
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Parisa Pouladzadeh.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Pouladzadeh, P., Peddi, S.V.B., Kuhad, P. et al. A virtualization mechanism for real-time multimedia-assisted mobile food recognition application in cloud computing. Cluster Comput 18, 1099–1110 (2015). https://doi.org/10.1007/s10586-015-0468-2

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10586-015-0468-2

Keywords

Search

Navigation