Skip to main content
SpringerLink
Log in

A health management tool based smart phone

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Nowadays smart phones are becoming more and more popular with the development of mobile technology. Phones are made more stronger and take more data related with user and it is also easier to collect information from smart phones than before. In the article, the tool we proposed aims to achieve the ability to predict and prevent complex diseases by mining multiple type of data that is collected by smart phones. It provides patients with health recommendations based on their daily diets and physiological information using Multimodal data based Health Recommendations module. In turn, users can interact with the smart phones to gain suggestions from historical results. The paper introduces the following: (i) Collecting users’ physiological information to provide disease prediction; (ii) Analyzing diet images to obtain users’ eating habits; (iii) Health recommendations based on the results of (i) and (ii).

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

Similar content being viewed by others

Notes

  1. http://www.boohee.com.

  2. http://www.boohee.com.

  3. https://keras.io/

  4. http://www.deeplearning.net/software/theano/.

References

  1. Abdel-Hamid O, Mohamed A, Jiang H, Li D, Penn G, Dong Y (2014) Convolutional neural networks for speech recognition. IEEE/ACM Trans Audio Speech Lang Process 22(10):1533–1545

    Article  Google Scholar 

  2. Bosch M., Zhu F, Khanna N, Boushey CJ, Delp E J (2011) Combining global and local features for food identification in dietary assessment. In: Image processing (ICIP), pp 1789–1792

  3. Bossard L, Guillaumin M, Gool LV (2014) Food-101 – mining discriminative components with random forests, pp 446–461

  4. Chen MY, Yang YH, Ho CJ, Wang SH, Liu SM, Chang E, Yeh CH, Ming O (2012) Automatic chinese food identification and quantity estimation. In: SIGGRAPH Asia 2012 technical briefs, pp 1–4

  5. Cheplygina V, Tax D M J, Loog M (2013) Combining instance information to classify bags. Multiple Class Syst:13–24

  6. Dahl G E, Dong Y, Li D, Acero A (2012) Context-dependent pre-trained deep neural networks for large-vocabulary speech recognition. IEEE Transon Audio Speech Lang Process 20(1):30–42

    Article  Google Scholar 

  7. Deng J, Dong W, Socher R, Li LJ (2009) Imagenet: a large-scale hierarchical image database, pp 248–255

  8. Dong H Y, Zhu J, Tang Y, Xu C H, Ding R (2015) Ubs: a novel news recommendation system based on user behavior sequence. KSEM, online first

  9. General Chair-Brush A, General Chair-Friday A, Program Chair-Kientz J, Program Chair-Scott J, Program Chair-Song J (2014) Proceedings of the 2014 acm international joint conference on pervasive and ubiquitous computing: Adjunct publication. In: ACM International joint conference on pervasive and ubiquitous computing: adjunct publication, pp 423–429

  10. Girshick R, Donahue J, Darrell T, Malik J (2014) Rich feature hierarchies for accurate object detection and semantic segmentation. Comput Sci:580–587

  11. He K, Zhang X, Ren S, Sun J (2014) Spatial pyramid pooling in deep convolutional networks for visual recognition. IEEE Trans Pattern Anal Mach Intell 37 (9):1904–1916

    Article  Google Scholar 

  12. Hoashi H, Joutou T, Yanai K (2010) Image recognition of 85 food categories by feature fusion. In: Ism 2010, IEEE International symposium on multimedia. Taichung, pp 296–301

  13. Kagaya H, Aizawa K, Ogawa M (2014) Food detection and recognition using convolutional neural network. In: ACM multimedia, pp 1085–1088

  14. Kawano Y, Foodcam KY (2014) A real-time food recognition system on a smartphone. Multimed Tools Appl 74(14):1–25

    Google Scholar 

  15. Krizhevsky A, Sutskever I, Hinton GE (2012) Imagenet classification with deep convolutional neural networks. Adv Neural Inf Process Syst 25(2):2012

    Google Scholar 

  16. Lawrence S, Giles C L, Tsoi A C, Back A D (1997) Face recognition: a convolutional neural-network approach. IEEE Transa Neural Netw 8(1):98–113

    Article  Google Scholar 

  17. Li J, Liu C, Bo L, Mao R, Wang Y, Chen S, Yang J-J, Pan H, Wang Q (2015) Diversity-aware retrieval of medical records. Comput Ind 69:81–91

    Article  Google Scholar 

  18. Liu F, Lin G, Shen C (2015) Crf learning with cnn features for image segmentation. Pattern Recog 48(10):2983–2992

    Article  Google Scholar 

  19. Liu C, Cao Yu, Luo Y, Chen G, Vokkarane V, Ma Yunsheng (2016) Deepfood: deep learning-based food image recognition for computer-aided dietary assessment

  20. Lowe DG (2004) Distinctive image features from scale-invariant keypoints. Int J Comput Vis 60(60):91–110

    Article  Google Scholar 

  21. Pouladzadeh P, Shirmohammadi S, Al-Maghrabi R (2014) Measuring calorie and nutrition from food image. IEEE Trans Instrum Measur 63(8):1947–1956

    Article  Google Scholar 

  22. Pouladzadeh P, Yassine A, Shirmohammadi S (2015) Foodd: food detection dataset for calorie measurement using food images. Lect Notes Comput Sci:441–448

  23. Schafer JB, Dan F, Herlocker J, Sen S (2007) Collaborative filtering recommender systems, pp 46–45

  24. Schmidhuber J (2014) Deep learning in neural networks: an overview, vol 61

  25. Shaw P A, Heiland P, Tillmann RW, Maas HJ (2015) Context-based recommendation system

  26. Shi XY, Ye HW, Gong SJ (2008) A personalized recommender integrating item-based and user-based collaborative filtering, pp 264–267

  27. Shimoda W, Yanai K (2015) Cnn-based food image segmentation without pixel-wise annotation, pp 449–457

  28. Simonyan K, Zisserman A (2014) Very deep convolutional networks for large-scale image recognition. Comput Sci

  29. Springenberg JT, Dosovitskiy A, Brox T, Riedmiller M (2014) Striving for simplicity: the all convolutional net. Eprint Arxiv

  30. Wang J, Huang JZ, Guo J, Lan Y (2015) Recommending high-utility search engine queries via a query-recommending model. Neurocomputing 167:195–208

    Article  Google Scholar 

  31. Wang K, Kong Y Diagnosis of heart disease via cnns

  32. Wen W, Yang J (2009) Fast food recognition from videos of eating for calorie estimation, pp 1210–1213

  33. Yanai K, Kawano Y (2015) Food image recognition using deep convolutional network with pre-training and fine-tuning. In: IEEE International conference on multimedia & expo workshops, pp 1–6

  34. Zhao ZD, Shang M (2010) User-based collaborative-filtering recommendation algorithms on hadoop. In: International conference on knowledge discovery and data mining, Wkdd 2010. Phuket, pp 478–481

  35. Zheng K, Huang Z, Zhou X, et al. (2011) Discovering the most influential sites over uncertain data: a rank based approach. IEEE Trans Knowledge Data Eng 99:1–1

    Google Scholar 

  36. Zheng K, Zhou X, Fung PC, Xie K (2012) Spatial query processing for fuzzy objects. VLDB J:1–23

  37. Zhu J, Yang Y, Xie Q, Wang L W, Hassan S (2014) Robust hybrid name disambiguation framework for large databases. Scientometrics 98(3):2255–2274

    Article  Google Scholar 

  38. Zhu X, Suk H I, Lee S W, Shen D (2015) Subspace Regularized Sparse Multi-Task Learning for Multi-Class Neurodegenerative Disease Identification 63 (3):607–618

  39. Zhu X, Zhang L, Huang Z (2014) A sparse embedding and least variance encoding approach to hashing. IEEE Transactions on Image Processing A Publication of the IEEE Signal Processing Society 23(9):3737–50

    Article  MathSciNet  Google Scholar 

  40. Zhu X, Zhang S, Zhang J, Zhang C (2007) Cost-Sensitive Imputing Missing Values with Ordering. AAAI Conference on Artificial Intelligence. Vancouver, British Columbia, Canada, pp 1922–1923

Download references

Acknowledgments

This work was supported by the Natural Science Foundation of Guangdong Province, China (No.2015A030310509), the National Science Foundation of China (61370229, 61272067, 61303049, 61402313), and the S&T Projects of Guangdong Province (2015A030401087, 2015B010110002, No.2016A030303055, No.2016B030305004, 2016B010109008).

Author information

Authors and Affiliations

  1. Computer Science, South China Normal University, NO.55, West ZhongShan Avenue, Tianhe District, Guangzhou City, Guangdong Province, China

    Chuanhua Xu, Jia Zhu & Jin Huang

  2. School of Computer Science and Technology, Soochow University, Soochow, China

    Zhixu Li

  3. Department of Systems Engineering and Engineering Management, The Chinese University of Hong Kong, Hong Kong, China

    Gabriel Pui Cheong Fung

Authors
  1. Chuanhua Xu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jia Zhu
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Jin Huang
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Zhixu Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Gabriel Pui Cheong Fung
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding authors

Correspondence to Jia Zhu or Jin Huang.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Xu, C., Zhu, J., Huang, J. et al. A health management tool based smart phone. Multimed Tools Appl 76, 17541–17558 (2017). https://doi.org/10.1007/s11042-016-4220-6

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-016-4220-6

Keywords

Search

Navigation