Abstract
This paper presents chewing data analysis based on the new approach of chewing detection for diet monitoring applications. The proposed approach is based on chewing detection using a proximity sensor in capturing the temporalis muscle movement during chewing. The aim is to support the development of non-contact-based chewing detection. A wearable device of eyeglass is used with the sensor mounted at the right side of the eyeglass temple using a 3D printed housing. The main activity involved in this study is resting and eating, three test food that represents different food hardness (carrot, banana, and apple) with a portion of one spoonful. Several upper cut-off frequencies (fc2) of bandpass filters were used during the analyses. The signals were evaluated using accuracy and F1-score for classification and the absolute mean of error for chewing count estimation. In the classification stage, using the setting of a 10-fold cross-validation method and a 3 s segmented window, fc2 of 6 Hz gives the highest accuracy with 97.6%, while, 2.5 Hz gives the lowest accuracy of 92.6%. However, in the chewing count estimation stage, which is based on a 240 s segmented window, 2.4 Hz able to give a smaller percentage absolute error of 2.69%, compare to 6 Hz with 12.11%. It can be concluded that the chewing frequency was under 2.5 Hz, but, the self-reporting labeling approach used in this study reduced the accuracy of the system as fc2 equal to 2.5 Hz is used. Further analysis of chewing count shows that might in relating the total chewing count with different food hardness.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Subhi, M.A., Ali, S.M.: A deep convolutional neural network for food detection and recognition. In: 2018 IEEE-EMBS Conference on Biomedical Engineering and Sciences (IECBES), pp. 284–287 (2018)
Subhi, M.A., Ali, S.H., Mohammed, M.A.: Vision-based approaches for automatic food recognition and dietary assessment: a survey. IEEE Access 7, 35370–35381 (2019)
Bi, S., et al.: Auracle: detecting eating episodes with an ear-mounted sensor. In: Proceedings of the ACM on Interactive, Mobile, Wearable, and Ubiquitous Technologies, vol. 2, no. 3, p. 27 (2018)
Farooq, M., Sazonov, E.: A novel wearable device for food intake and physical activity recognition. Sensors (Switz.) 16(1067), 13 (2016)
Zhang, R., Amft, O.: Monitoring chewing and eating in free-living using smart eyeglasses. IEEE J. Biomed. Heal. Informatics 22(1), 23–32 (2018)
Farooq, M., Sazonov, E.: Accelerometer-based detection of food intake in free-living individuals. IEEE Sens. J. 18(9), 3752–3758 (2018)
Hossain, D., Imtiaz, M.H., Sazonov, E.: Comparison of wearable sensors for estimation of chewing strength. IEEE Sens. J. 1748, 9 (2020)
Zhang, R., Bernhart, S., Amft, O.: Diet eyeglasses: recognising food chewing using EMG and smart eyeglasses. In: BSN 2016-13th Annual Body Sensor Networks Conference, pp. 7–12 (2016)
Wang, S., et al.: Eating detection and chews counting through sensing mastication muscle contraction. Smart Heal. 9–10, 179–191 (2018)
Papapanagiotou, V., Diou, C., Zhou, L., Van Den Boer, J., Mars, J., Delopoulos, A.: A novel approach for chewing detection based on a wearable PPG sensor. In: Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS, pp. 6485–6488 (2016)
Taniguchi, K., Chiaki, H., Kurosawa, M., Nishikawa, A.: A novel earphone type sensor for measuring mealtime: consideration of the method to distinguish between running and meals. Sensors (Switz.) 17(252), 14 (2017)
Chun, K.S., Bhattacharya, S., Thomaz, E.: Detecting eating episodes by tracking jawbone movements with a non-contact wearable sensor. In: Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, vol. 2, no. 1, p. 21 (2018)
Zhang, S., et al.: NeckSense: a multi-sensor necklace for detecting eating activities in free-living conditions. In: Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, vol. 1, no. 1 (2019)
Lee, K.: Food intake detection using ultrasonic doppler sonar. IEEE Sens. J. 17(18), 6056–6068 (2017)
Farooq, M., Sazonov, E.: Detection of chewing from piezoelectric film sensor signals using ensemble classifiers. In: Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS, pp. 4929–4932 (2016)
Po, J.M.C., Kieser, J.A., Gallo, L.M., Tésenyi, A.J., Herbison, P., Farella, M.: Time-frequency analysis of chewing activity in the natural environment. J. Dent. Res. 90(10), 1206–1210 (2011)
Sazonov, E.S., Fontana, J.M.: A sensor system for automatic detection of food intake through non-invasive monitoring of chewing. IEEE Sens. J. 12(5), 1340–1348 (2012)
Selamat, N.A., Ali, S.H.M.: Automatic food intake monitoring based on chewing activity: a survey. IEEE Access 8, 48846–48869 (2020)
Chung, J., Chung, J., Oh, W., Yoo, Y., Lee, W.G., Bang, H.: A glasses-type wearable device for monitoring the patterns of food intake and facial activity. Sci. Rep. 7, 8 (2017)
Nyamukuru, M.T., Odame, K.M.: Tiny eats: eating detection on a microcontroller. In: 2020 IEEE Second Workshop on Machine Learning on Edge in Sensor Systems (SenSys-ML), p. 5 (2020)
Farooq, M., Sazonov, E.: Automatic measurement of chew count and chewing rate during food intake. Electronics 5(62), 14 (2016)
Farooq, M., Sazonov, E.: Real time monitoring and recognition of eating and physical activity with a wearable device connected to the eyeglass. In: Proceedings of the International Conference on Sensing Technology, ICST, p. 6 (2017)
Papapanagiotou, V., Diou, C., Delopoulos, A.: Chewing detection from an in-ear microphone using convolutional neural networks. In: Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS, pp. 1258–1261 (2017)
Fontana, J.M., Sazonov, E.S.: A robust classification scheme for detection of food intake through non-invasive monitoring of chewing. In: Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS, pp. 4891–4894, August 2012
Farooq, M., Sazonov, E.: Comparative testing of piezoelectric and printed strain sensors in characterization of chewing. In: Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS, pp. 7538–7541 (2015)
Farooq, M., Sazonov, E.: Linear regression models for chew count estimation from piezoelectric sensor signals. In: 2016 Tenth International Conference on Sensing Technology Linear, p. 5 (2016)
Farooq, M., Sazonov, E.: Segmentation and characterization of chewing bouts by monitoring temporalis muscle using smart glasses with piezoelectric sensor. IEEE J. Biomed. Heal. Informatics 21(6), 1495–1503 (2017)
Acknowledgment
This work was supported by Universiti Kebangsaan Malaysia and Ministry of Education Malaysia, under the Grant Code FRGS/1/2018/TK04/UKM/02/2 and Universiti Teknikal Malaysia Melaka (UTeM).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this paper
Cite this paper
Selamat, N.A., Ali, S.H.M. (2021). Analysis of Chewing Signals Based on Chewing Detection Using Proximity Sensor for Diet Monitoring. In: Del Bimbo, A., et al. Pattern Recognition. ICPR International Workshops and Challenges. ICPR 2021. Lecture Notes in Computer Science(), vol 12665. Springer, Cham. https://doi.org/10.1007/978-3-030-68821-9_48
Download citation
DOI: https://doi.org/10.1007/978-3-030-68821-9_48
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-68820-2
Online ISBN: 978-3-030-68821-9
eBook Packages: Computer ScienceComputer Science (R0)
