skip to main content
research-article

BabyNutri: A Cost-Effective Baby Food Macronutrients Analyzer Based on Spectral Reconstruction

Published: 28 March 2023 Publication History

Abstract

The physical and physiological development of infants and toddlers requires the proper amount of macronutrient intake, making it an essential problem to estimate the macronutrient in baby food. Nevertheless, existing solutions are either too expensive or poor performing, preventing the widespread use of automatic baby nutrient intake logging. To narrow this gap, this paper proposes a cost-effective and portable baby food macronutrient estimation system, BabyNutri. BabyNutri exploits a novel spectral reconstruction algorithm to reconstruct high-dimensional informative spectra from low-dimensional spectra, which are available from low-cost spectrometers. We propose a denoising autoencoder for the reconstruction process, by which BabyNutri can reconstruct a 160-dimensional spectrum from a 5-dimensional spectrum. Since the high-dimensional spectrum is rich in light absorption features of macronutrients, it can achieve more accurate macronutrient estimation. In addition, considering that baby food contains complex ingredients, we also design a CNN nutrition estimation model with good generalization performance over various types of baby food. Our extensive experiments over 88 types of baby food show that the spectral reconstruction error of BabyNutri is only 5.91%, reducing 33% than the state-of-the-art baseline with the same time complexity. In addition, the nutrient estimation performance of BabyNutri not only obviously outperforms state-of-the-art and cost-effective solutions but also is highly correlated with the professional spectrometer, with the correlation coefficients of 0.81, 0.88, 0.82 for protein, fat, and carbohydrate, respectively. However the price of our system is only one percent of the commercial solution. We also validate that BabyNutri is robust regarding various factors, e.g., ambient light, food volume, and even unseen baby food samples.

References

[1]
DaeHan Ahn, Ji-Young Choi, Hee-Chul Kim, Jeong-Seok Cho, Kwang-Deog Moon, and Taejoon Park. 2019. Estimating the composition of food nutrients from hyperspectral signals based on deep neural networks. Sensors 19, 7 (2019), 1560.
[2]
amu. [n.d.]. AS7421 Hyperspectral NIR Sensor. https://ams.com/as7421.
[3]
Boaz Arad and Ohad Ben-Shahar. 2016. Sparse recovery of hyperspectral signal from natural RGB images. In European Conference on Computer Vision. Springer, 19--34.
[4]
MN Aulia, ML Khodra, and AP Koesoema. 2020. Predicting macronutrient of baby food using near-infrared spectroscopy and deep learning approach. In IOP Conference Series: Materials Science and Engineering, Vol. 803. IOP Publishing, 012019.
[5]
Alessandra Borin, Marco Flores Ferrao, Cesar Mello, Danilo Althmann Maretto, and Ronei Jesus Poppi. 2006. Least-squares support vector machines and near infrared spectroscopy for quantification of common adulterants in powdered milk. Analytica chimica acta 579, 1 (2006), 25--32.
[6]
Justin Chan, Ananditha Raghunath, Kelly E Michaelsen, and Shyamnath Gollakota. 2022. Testing a Drop of Liquid Using Smartphone LiDAR. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 6, 1 (2022), 1--27.
[7]
Jingjing Chen and Chong-Wah Ngo. 2016. Deep-Based Ingredient Recognition for Cooking Recipe Retrieval. In Proceedings of the 24th ACM international conference on Multimedia.
[8]
Jing-jing Chen, Chong-Wah Ngo, and Tat-Seng Chua. 2017. Cross-Modal Recipe Retrieval with Rich Food Attributes. In Proceedings of the 25th ACM international conference on Multimedia.
[9]
Shuo Chen and Quan Liu. 2012. Modified Wiener estimation of diffuse reflectance spectra from RGB values by the synthesis of new colors for tissue measurements. Journal of Biomedical optics 17, 3 (2012), 030501.
[10]
Yuan-Yuan Chen and Zhi-Bin Wang. 2019. End-to-end quantitative analysis modeling of near-infrared spectroscopy based on convolutional neural network. Journal of Chemometrics 33, 5 (2019), e3122.
[11]
Xian-guang Fan, Long Liu, Zhe-ming Kang, Ying-jie Zeng, Yu-liang Zhi, Ying-jie Xu, Jia-jie Zhang, and Xin Wang. 2020. Fast reconstruction of Raman spectra based on global weighted linear regression. Chemometrics and Intelligent Laboratory Systems 203 (2020), 104073.
[12]
Hideaki Haneishi, Takayuki Hasegawa, Asako Hosoi, Yasuaki Yokoyama, Norimichi Tsumura, and Yoichi Miyake. 2000. System design for accurately estimating the spectral reflectance of art paintings. Applied Optics 39, 35 (2000), 6621--6632.
[13]
Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. 2016. Deep residual learning for image recognition. In Proceedings of the IEEE conference on computer vision and pattern recognition. 770--778.
[14]
Haibo Huang, Haiyan Yu, Huirong Xu, and Yibin Ying. 2008. Near infrared spectroscopy for on/in-line monitoring of quality in foods and beverages: A review. Journal of food engineering 87, 3 (2008), 303--313.
[15]
Qianyi Huang, Zhice Yang, and Qian Zhang. 2018. Smart-U: smart utensils know what you eat. In IEEE INFOCOM 2018-IEEE Conference on Computer Communications. IEEE, 1439--1447.
[16]
Yongzhi Huang, Kaixin Chen, Lu Wang, Yinying Dong, Qianyi Huang, and Kaishun Wu. 2021. Lili: liquor quality monitoring based on light signals. In Proceedings of the 27th Annual International Conference on Mobile Computing and Networking. 256--268.
[17]
Ocean Insight. [n.d.]. NIRQUEST+1.7 Spectrometer. https://www.oceaninsight.com/products/spectrometers/near-infrared/nirquest1.7/?qty=1.
[18]
FrieslandCampina Institute. [n. d.]. Macronutrients for toddlers: recommendations and role in growth and development. https://www.frieslandcampinainstitute.com/ng/health/child-nutrition/macronutrients-toddlers-recommendations-role-growth-development/.
[19]
Ine L Jernelv, Dag Roar Hjelme, Yuji Matsuura, and Astrid Aksnes. 2020. Convolutional neural networks for classification and regression analysis of one-dimensional spectral data. arXiv preprint arXiv:2005.07530 (2020).
[20]
Weiwei Jiang, Gabriele Marini, Niels van Berkel, Zhanna Sarsenbayeva, Zheyu Tan, Chu Luo, Xin He, Tilman Dingler, Jorge Goncalves, Yoshihiro Kawahara, et al. 2019. Probing sucrose contents in everyday drinks using miniaturized near-infrared spectroscopy scanners. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 3, 4 (2019), 1--25.
[21]
Hidenori Matsui, Takahiro Hashizume, and Koji Yatani. 2018. Al-light: An alcohol-sensing smart ice cube. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 2, 3 (2018), 1--20.
[22]
Austin Meyers, Nick Johnston, Vivek Rathod, Anoop Korattikara, Alex Gorban, Nathan Silberman, Sergio Guadarrama, George Papandreou, Jonathan Huang, and Kevin P Murphy. 2015. Im2Calories: Towards an Automated Mobile Vision Food Diary. In Proceedings of the IEEE International Conference on Computer Vision.
[23]
Inc MyFitnessPal. [n. d.]. MyFitnessPal. https://www.myfitnesspal.com/.
[24]
World Health Organization et al. 2009. Infant and young child feeding: model chapter for textbooks for medical students and allied health professionals. World Health Organization.
[25]
Brian G Osborne. 2006. Near-infrared spectroscopy in food analysis. Encyclopedia of analytical chemistry: applications, theory and instrumentation (2006).
[26]
Tauhidur Rahman, Alexander T. Adams, Perry Schein, Aadhar Jain, David Erickson, and Tanzeem Choudhury. 2016. Nutrilyzer: A Mobile System for Characterizing Liquid Food with Photoacoustic Effect. In Proceedings of the 14th ACM Conference on Embedded Network Sensor Systems CD-ROM.
[27]
MJ Sáiz-Abajo, B-H Mevik, VH Segtnan, and T Næs. 2005. Ensemble methods and data augmentation by noise addition applied to the analysis of spectroscopic data. Analytica chimica acta 533, 2 (2005), 147--159.
[28]
Amaia Salvador, Nicholas Hynes, Yusuf Aytar, Javier Marin, Ferda Ofli, Ingmar Weber, and Antonio Torralba. 2017. Learning Cross-Modal Embeddings for Cooking Recipes and Food Images. In Proceedings of the IEEE conference on computer vision and pattern recognition.
[29]
SCiO. [n. d.]. SCiO Mini. https://shop.consumerphysics.com/.
[30]
Hui-Liang Shen, Pu-Qing Cai, Si-Jie Shao, and John H Xin. 2007. Reflectance reconstruction for multispectral imaging by adaptive Wiener estimation. Optics express 15, 23 (2007), 15545--15554.
[31]
Hui-Liang Shen and John H Xin. 2006. Spectral characterization of a color scanner based on optimized adaptive estimation. JOSA A 23, 7 (2006), 1566--1569.
[32]
Hui-Liang Shen, John H Xin, and Si-Jie Shao. 2007. Improved reflectance reconstruction for multispectral imaging by combining different techniques. Optics express 15, 9 (2007), 5531--5536.
[33]
UNITE FOR SIGHT. [n. d.]. Module 4: Overnutrition. http://www.uniteforsight.org/hunger/module4.
[34]
Tarek Stiebel, Simon Koppers, Philipp Seltsam, and Dorit Merhof. 2018. Reconstructing spectral images from rgb-images using a convolutional neural network. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops. 948--953.
[35]
Donald F Swinehart. 1962. The beer-lambert law. Journal of chemical education 39, 7 (1962), 333.
[36]
Yoke Jia Thong, Thuong Nguyen, Qing Zhang, Mohan Karunanithi, and Lei Yu. 2017. Predicting food nutrition facts using pocket-size near-infrared sensor. In 2017 39th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).
[37]
Johan Trygg and Svante Wold. 1998. PLS regression on wavelet compressed NIR spectra. Chemometrics and Intelligent Laboratory Systems 42, 1--2 (1998), 209--220.
[38]
WHO. [n. d.]. Infant and young child feeding. https://www.who.int/news-room/fact-sheets/detail/infant-and-young-child-feeding.
[39]
Fumihito Yasuma, Tomoo Mitsunaga, Daisuke Iso, and Shree K Nayar. 2010. Generalized assorted pixel camera: postcapture control of resolution, dynamic range, and spectrum. IEEE transactions on image processing 19, 9 (2010), 2241--2253.
[40]
Chen Yuanyuan and Wang Zhibin. 2018. Quantitative analysis modeling of infrared spectroscopy based on ensemble convolutional neural networks. Chemometrics and Intelligent Laboratory Systems 181 (2018), 1--10.
[41]
Wei-Feng Zhang and Dao-Qing Dai. 2008. Spectral reflectance estimation from camera responses by support vector regression and a composite model. JOSA A 25, 9 (2008), 2286--2296.
[42]
Xiaolei Zhang, Jinfan Xu, Jie Yang, Li Chen, Haibo Zhou, Xiangjiang Liu, Haifeng Li, Tao Lin, and Yibin Ying. 2020. Understanding the learning mechanism of convolutional neural networks in spectral analysis. Analytica Chimica Acta 1119 (2020), 41--51.
[43]
Xiaolei Zhang, Jie Yang, Tao Lin, and Yibin Ying. 2021. Food and agro-product quality evaluation based on spectroscopy and deep learning: A review. Trends in Food Science & Technology 112 (2021), 431--441.
[44]
Yuzhi Zhao, Lai-Man Po, Qiong Yan, Wei Liu, and Tingyu Lin. 2020. Hierarchical Regression Network for Spectral Reconstruction From RGB Images. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) Workshops.

Cited By

View all
  • (2024)airTac: A Contactless Digital Tactile Receptor for Detecting Material and Roughness via Terahertz SensingProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36785868:3(1-37)Online publication date: 9-Sep-2024
  • (2024)ChromaFlash: Snapshot Hyperspectral Imaging Using Rolling Shutter CamerasProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36785828:3(1-31)Online publication date: 9-Sep-2024
  • (2024)Exploring Large-Scale Language Models to Evaluate EEG-Based Multimodal Data for Mental HealthCompanion of the 2024 on ACM International Joint Conference on Pervasive and Ubiquitous Computing10.1145/3675094.3678494(412-417)Online publication date: 5-Oct-2024
  • Show More Cited By

Index Terms

  1. BabyNutri: A Cost-Effective Baby Food Macronutrients Analyzer Based on Spectral Reconstruction

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
      Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies  Volume 7, Issue 1
      March 2023
      1243 pages
      EISSN:2474-9567
      DOI:10.1145/3589760
      Issue’s Table of Contents
      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 28 March 2023
      Published in IMWUT Volume 7, Issue 1

      Permissions

      Request permissions for this article.

      Check for updates

      Author Tags

      1. baby food
      2. near-infrared spectrometer
      3. nutrient estimation
      4. spectral reconstruction

      Qualifiers

      • Research-article
      • Research
      • Refereed

      Funding Sources

      • RGC
      • the National Natural Science Foundation of China

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)232
      • Downloads (Last 6 weeks)37
      Reflects downloads up to 20 Jan 2025

      Other Metrics

      Citations

      Cited By

      View all
      • (2024)airTac: A Contactless Digital Tactile Receptor for Detecting Material and Roughness via Terahertz SensingProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36785868:3(1-37)Online publication date: 9-Sep-2024
      • (2024)ChromaFlash: Snapshot Hyperspectral Imaging Using Rolling Shutter CamerasProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36785828:3(1-31)Online publication date: 9-Sep-2024
      • (2024)Exploring Large-Scale Language Models to Evaluate EEG-Based Multimodal Data for Mental HealthCompanion of the 2024 on ACM International Joint Conference on Pervasive and Ubiquitous Computing10.1145/3675094.3678494(412-417)Online publication date: 5-Oct-2024
      • (2024)Ph.D. Forum: Toward Adaptive Visible Light PositioningProceedings of the 22nd ACM Conference on Embedded Networked Sensor Systems10.1145/3666025.3699667(918-919)Online publication date: 4-Nov-2024
      • (2024)Towards Enhanced Context Awareness with Vision-based Multimodal InterfacesAdjunct Proceedings of the 26th International Conference on Mobile Human-Computer Interaction10.1145/3640471.3686646(1-3)Online publication date: 21-Sep-2024
      • (2024)MultiSurf-GPT: Facilitating Context-Aware Reasoning with Large-Scale Language Model Agents for Multimodal Surface SensingAdjunct Proceedings of the 26th International Conference on Mobile Human-Computer Interaction10.1145/3640471.3680450(1-6)Online publication date: 21-Sep-2024
      • (2024)Ethical Practices for Collecting Ground-Truth Food Datasets: A Systematic Review2024 IEEE Conference on Artificial Intelligence (CAI)10.1109/CAI59869.2024.00105(530-536)Online publication date: 25-Jun-2024
      • (2023)LiT: Fine-grained Toothbrushing Monitoring with Commercial LED ToothbrushProceedings of the 29th Annual International Conference on Mobile Computing and Networking10.1145/3570361.3613287(1-16)Online publication date: 2-Oct-2023
      • (2023)Museum Visitor Experiences Based on Hyperspectral Image DataHuman-Computer Interaction – INTERACT 202310.1007/978-3-031-42283-6_35(638-647)Online publication date: 28-Aug-2023

      View Options

      Login options

      Full Access

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Media

      Figures

      Other

      Tables

      Share

      Share

      Share this Publication link

      Share on social media