Takashi Hamatani
Abstract
Water is the most vital nutrient in the human body accounting for about 60% of the body weight. To maintain optimal health, it is important for humans to consume a sufficient amount of fluids daily. Therefore, tracking the amount of human daily fluid intake has a myriad of health applications like dehydration prevention.
In this paper, we present FluidMeter: a ubiquitous and unobtrusive system to track the amount of fluid intake leveraging the inertial sensors embedded in smartwatches. To achieve this, FluidMeter first separates the drinking activities from other human activities (playing, running, eating, etc.). Thereafter, it analyzes the sampled sensors data during the extracted drinking episodes to recognize the sequence of micro-activities (lift the bottle, sip, release the bottle) that constitute the drinking activity. Finally, it applies some machine learning algorithms on some features extracted from sampled sensor data during the sipping period to gauge the amount of fluid intake in the designated drinking episode.
FluidMeter is evaluated by collecting more than 260 hours of different human activities by 70 different participants using different smartwatch models. The results show that FluidMeter can recognize the drinking activity and its micro-activities accurately which is comparable to that achieved by the state-of-the-art techniques. Finally, FluidMeter can estimate the overall amount of fluid intake in grams accurately with a estimation error limited to 15%, highlighting its promise as a ubiquitous health service.
- Ahmad Akl and Shahrokh Valaee. 2010. Accelerometer-based gesture recognition via dynamic-time warping, affinity propagation, 8 compressive sensing. In Acoustics Speech and Signal Processing (ICASSP), 2010 IEEE International Conference on. IEEE, 2270--2273.Google Scholar
Cross Ref
- Oliver Amft, David Bannach, Gerald Pirkl, Matthias Kreil, and Paul Lukowicz. 2010. Towards wearable sensing-based assessment of fluid intake. In Proceedings of 2010 8th IEEE International Conference on Pervasive Computing and Communications Workshops (PERCOM Workshops). IEEE, 298--303.Google ScholarCross Ref
- Oliver Amft and Gerhard Troster. 2009. On-body sensing solutions for automatic dietary monitoring. IEEE pervasive computing 8, 2 (2009), 62--70. Google ScholarDigital Library
- Abdelkareem Bedri, Richard Li, Malcolm Haynes, Raj Prateek Kosaraju, Ishaan Grover, Temiloluwa Prioleau, Min Yan Beh, Mayank Goel, Thad Starner, and Gregory Abowd. 2017. EarBit: Using Wearable Sensors to Detect Eating Episodes in Unconstrained Environments. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 1, 3, Article 37 (Sept. 2017), 20 pages. Google ScholarDigital Library
- Chongguang Bi, Guoliang Xing, Tian Hao, Jina Huh, Wei Peng, and Mengyan Ma. 2017. FamilyLog: A mobile system for monitoring family mealtime activities. In Proceedings of 2017 IEEE International Conference on Pervasive Computing and Communications (PerCom). IEEE, 21--30.Google Scholar
- Jia-Luen Chua, Yoong Choon Chang, Mohamed Hisham Jaward, Jussi Parkkinen, and Kok-Sheik Wong. 2014. Vision-based hand grasping posture recognition in drinking activity. In Intelligent Signal Processing and Communication Systems (ISPACS), 2014 International Symposium on. IEEE, 185--190.Google ScholarCross Ref
- Yujie Dong, Jenna Scisco, Mike Wilson, Eric Muth, and Adam Hoover. 2014. Detecting periods of eating during free-living by tracking wrist motion. IEEE journal of biomedical and health informatics 18, 4 (2014), 1253--1260.Google Scholar
- Isabelle Guyon and André Elisseeff. 2003. An introduction to variable and feature selection. Journal of machine learning research 3, Mar (2003), 1157--1182. Google ScholarDigital Library
- Hidrate. 2015. Hidrate Spark. (2015). http://hidratespark.com/.Google Scholar
- Chih-Wei Hsu, Chih-Chung Chang, Chih-Jen Lin, et al. 2003. A practical guide to support vector classification. (2003).Google Scholar
- IDC. 2017. SmartWatch Sales. (2017). https://www.idc.com/getdoc.jsp?containerId=prUS43058317.Google Scholar
- Institute of Medicine (Ed.). 2004. Dietary Reference Intakes for Water, Potassium, Sodium, Chloride, and Sulfate. Washington, DC: National Academies Press.Google Scholar
- Azusa Kadomura, Cheng-Yuan Li, Koji Tsukada, Hao-Hua Chu, and Itiro Siio. 2014. Persuasive technology to improve eating behavior using a sensor-embedded fork. In Proceedings of the 2014 acm international joint conference on pervasive and ubiquitous computing. ACM, 319--329. Google ScholarDigital Library
- Haik Kalantarian, Nabil Alshurafa, and Majid Sarrafzadeh. 2016. Detection of gestures associated with medication adherence using smartwatch-based inertial sensors. IEEE Sensors Journal 16, 4 (2016), 1054--1061.Google ScholarCross Ref
- Haik Kalantarian and Majid Sarrafzadeh. 2015. Audio-based detection and evaluation of eating behavior using the smartwatch platform. Computers in biology and medicine 65 (2015), 1--9. Google ScholarDigital Library
- W Larry Kenney and Percy Chiu. 2001. Influence of age on thirst and fluid intake. Medicine and science in sports and exercise 33, 9 (2001), 1524--1532.Google Scholar
- Simon Lacoste-Julien, Martin Jaggi, Mark Schmidt, and Patrick Pletscher. 2012. Block-coordinate Frank-Wolfe optimization for structural SVMs. arXiv preprint arXiv:1207.4747 (2012). Google ScholarDigital Library
- Yehenew Mengistu, Minh Pham, Ha Manh Do, and Weihua Sheng. 2016. AutoHydrate: A wearable hydration monitoring system. In Proceedings of 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). IEEE, 1857--1862.Google ScholarCross Ref
- Christopher Merck, Christina Maher, Mark Mirtchouk, Min Zheng, Yuxiao Huang, and Samantha Kleinberg. 2016. Multimodality sensing for eating recognition. In Proceedings of the 10th EAI International Conference on Pervasive Computing Technologies for Healthcare. ICST (Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering), 130--137. Google ScholarDigital Library
- Mark Mirtchouk, Drew Lustig, Alexandra Smith, Ivan Ching, Min Zheng, and Samantha Kleinberg. 2017. Recognizing Eating from Body-Worn Sensors: Combining Free-living and Laboratory Data. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 1, 3, Article 85 (Sept. 2017), 20 pages. Google ScholarDigital Library
- Mark Mirtchouk, Christopher Merck, and Samantha Kleinberg. 2016. Automated estimation of food type and amount consumed from body-worn audio and motion sensors. In Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing. ACM, 451--462. Google ScholarDigital Library
- MOFILY. 2015. YoCam: The World's Most Versatile Waterproof Life Camera. (2015). http://www.getyocam.com/.Google Scholar
- Temiloluwa Prioleau, Elliot Moore II, and Maysam Ghovanloo. 2017. Unobtrusive and wearable systems for automatic dietary monitoring. IEEE Transactions on Biomedical Engineering 64, 9 (2017), 2075--2089.Google ScholarCross Ref
- Tauhidur Rahman, Alexander Travis Adams, Mi Zhang, Erin Cherry, Bobby Zhou, Huaishu Peng, and Tanzeem Choudhury. 2014. BodyBeat: a mobile system for sensing non-speech body sounds.. In MobiSys, Vol. 14. 2--13. Google ScholarDigital Library
- Giovanni Schiboni and Oliver Amft. 2018. Automatic Dietary Monitoring Using Wearable Accessories. In Seamless Healthcare Monitoring. Springer, 369--412.Google Scholar
- Yiru Shen, James Salley, Eric Muth, and Adam Hoover. 2017. Assessing the Accuracy of a Wrist Motion Tracking Method for Counting Bites Across Demographic and Food Variables. IEEE journal of biomedical and health informatics 21, 3 (2017), 599--606.Google Scholar
- Edison Thomaz, Irfan Essa, and Gregory D Abowd. 2015. A practical approach for recognizing eating moments with wrist-mounted inertial sensing. In Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing. ACM, 1029--1040. Google ScholarDigital Library
- TRAGO. 2015. Trago Cap. (2015). https://trago.co/pages/trago-cap.Google Scholar
- Douglas L Vail, Manuela M Veloso, and John D Lafferty. 2007. Conditional random fields for activity recognition. In Proceedings of the 6th international joint conference on Autonomous agents and multiagent systems. ACM, 235. Google ScholarDigital Library
- Tri Vu, Feng Lin, Nabil Alshurafa, and Wenyao Xu. 2017. Wearable food intake monitoring technologies: A comprehensive review. Computers 6, 1 (2017), 4.Google ScholarCross Ref
- Phillip Watson, Andrew Whale, Stephen A Mears, Louise A Reyner, and Ronald J Maughan. 2015. Mild hypohydration increases the frequency of driver errors during a prolonged, monotonous driving task. Physiology 8 behavior 147 (2015), 313--318.Google Scholar
Index Terms
- FluidMeter: Gauging the Human Daily Fluid Intake Using Smartwatches
Recommendations
WagTag: a dog collar accessory for monitoring canine activity levels
UbiComp '13 Adjunct: Proceedings of the 2013 ACM conference on Pervasive and ubiquitous computing adjunct publicationTechnological advancements are leading to the emergence of wearable computing devices as a major consumer category. Several companies have developed, or are developing, wearable accessories to monitor human activity. But the health and wellness ...
Aerobic activity monitoring: towards a long-term approach
With recent progress in wearable sensing, it becomes reasonable for individuals to wear different sensors all day, and thus, global activity monitoring is establishing. The goals in global activity monitoring systems are among others to tell the type of ...
HASC Challenge: gathering large scale human activity corpus for the real-world activity understandings
AH '11: Proceedings of the 2nd Augmented Human International ConferenceUnderstandings of human activity through wearable sensors will enable the next-generation human-oriented computing. However, most of researches on the activity recognition so far are based on small number of test subjects, and not well adapted for real ...
Comments