Skip to main content
Springer Nature Link
Log in

A Speech-Based Mobile App for Restaurant Order Recognition and Low-Burden Diet Tracking

  • Conference paper
  • First Online:
Smart Health (ICSH 2015)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 9545))

Included in the following conference series:

  • 2507 Accesses

Abstract

Obesity is a public health problem in the US. Diet tracking helps control obesity but manual entry is tedious. Proposed solutions such as food recognition from photographs and scanning barcodes have limitations. We investigate the use of speech recognition for diet recording. We improved the accuracy of food order recognition at restaurants by (1) limiting words in the speech recognizer’s corpus to only items on the menus of nearby restaurants (2) implementing an acoustic model to recognize the speaking style of the smartphone owner. Building on these mechanisms, we propose DietRecord, a smartphone application that automatically recognizes and records restaurant orders. Results of our user studies to evaluate DietRecord were encouraging.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. National Center for Health Statistics. http://www.cdc.gov/nchs/

  2. Kong, F., Tan, J.: DietCam: regular shape food recognition with a camera phone. In: Proceedings of the BSN. IEEE (2011)

    Google Scholar 

  3. Food Research and Action Center (FRAC), Overweight and Obesity in the US. http://frac.org/initiatives/hunger-and-obesity/obesity-in-the-us/

  4. Rozzi, W.A., Stern, R.M.: Speaker adaptation in cont. speech recognition via estimation of correlated mean vectors. In: IEEE Proceedings of the ICASSP 1991 (1991)

    Google Scholar 

  5. Jyothi, P., et al.: Distributed discriminative language models for Google voice-search. In: Proceedings of the ICASSP. IEEE (2012)

    Google Scholar 

  6. Huggins-Daines, D., et al.: Pocketsphinx: a free, real- time cont. speech recognition system for hand-held devices. In: Proceedings of the IEEE ICASSP (2006)

    Google Scholar 

  7. Vertanen, K., Kristenssen, P.: Parakeet: a cont. speech recognition system for mobile touch-screen devices. In: Proceedings of the ACM IUI 2009 (2009)

    Google Scholar 

  8. Andrew, A.H., Boriello, G., Fogarty, J.: Simplifying mobile phone food diaries. In: Proceedings of the Pervasive Health 2013 (2013)

    Google Scholar 

  9. Hsu, H.H., Min-Ho, C., Neil, Y.Y.: A health man- agement application with QR-code input and rule inference. In: Proceedings of the ISIC. IEEE (2012)

    Google Scholar 

  10. Ohbuchi, E., Hiroshi, H., Lim, A.H.: Barcode readers using the camera device in mobile phones. In: Proceedings of the International Conference Cyberwords (2004)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Computer Science Department, Worcester Polytechnic Institute, Worcester, MA, USA

    Xiaochen Huang & Emmanuel Agu

Authors
  1. Xiaochen Huang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Emmanuel Agu
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Emmanuel Agu .

Editor information

Editors and Affiliations

  1. Institute of Automation,Bldg.1004, Chinese Academy of Sciences, Beijing, China

    Xiaolong Zheng

  2. University of Arizona, Tucson, Arizona, USA

    Daniel Dajun Zeng

  3. University of Arizona, Phoenix, USA

    Hsinchun Chen

  4. Mayo Clinic, Scottsdale, USA

    Scott J. Leischow

Rights and permissions

Reprints and permissions

Copyright information

© 2016 Springer International Publishing Switzerland

About this paper

Cite this paper

Huang, X., Agu, E. (2016). A Speech-Based Mobile App for Restaurant Order Recognition and Low-Burden Diet Tracking. In: Zheng, X., Zeng, D., Chen, H., Leischow, S. (eds) Smart Health. ICSH 2015. Lecture Notes in Computer Science(), vol 9545. Springer, Cham. https://doi.org/10.1007/978-3-319-29175-8_31

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-29175-8_31

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-29174-1

  • Online ISBN: 978-3-319-29175-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics