ABSTRACT
Image content prediction with novel deep learning approaches is a hot research topic for many scientific disciplines. Image-based food types recognition and their ingredients is a particularly challenging task, since food dishes are typically deformable objects, usually including complex semantics, which makes the task of defining their structure very difficult. In this paper we introduce a novel web-based system that exploits commercial deep learning based platforms to predict image content for food recognition. In addition to that, the system combines the individual predictions of the platforms to produce more accurate results. Also, we provide a short assessment of the chosen platforms to determine the most efficient one, in the domain of food recognition. The paper is concluded by highlighting the key features of platforms and the advantages of the new presented system.
- Lukas Bossard, Matthieu Guillaumin, and Luc Van Gool. 2014. Food-101 – Mining Discriminative Components with Random Forests. In Computer Vision – ECCV 2014, David Fleet, Tomas Pajdla, Bernt Schiele, and Tinne Tuytelaars (Eds.). Springer International Publishing, Cham, 446–461.Google ScholarCross Ref
- Kiourt Chairi, Pavlidis George, and Stella Markantonatou. 2020. Deep learning approaches in food recognition,. In MACHINE LEARNING PARADIGMS - Advances in Theory and Applications of Deep Learning, Tsihrintzis George, A. and Jain Lakhmi (Eds.). Springer, Cham, 83–108. https://doi.org/10.1007/978-3-030-49724-8_4Google Scholar
- Alex Krizhevsky, Ilya Sutskever, and Geoffrey E. Hinton. 2017. ImageNet Classification with Deep Convolutional Neural Networks. 60, 6 (2017). https://doi.org/10.1145/3065386Google ScholarDigital Library
- Simon Mezgec and Barbara Korousic Seljak. 2017. NutriNet: A Deep Learning Food and Drink Image Recognition System for Dietary Assessment. Nutrients 9, 7 (2017). https://doi.org/10.3390/nu9070657Google Scholar
- Weiqing Min, Shuqiang Jiang, Linhu Liu, Yong Rui, and Ramesh Jain. 2019. A Survey on Food Computing. ACM Comput. Surv. 52, 5, Article 92 (Sept. 2019), 36 pages. https://doi.org/10.1145/3329168Google ScholarDigital Library
- S. J. Pan and Q. Yang. 2010. A Survey on Transfer Learning. IEEE Transactions on Knowledge and Data Engineering 22, 10(2010), 1345–1359.Google ScholarDigital Library
- Kawano Y. and Yanai K.2014. Automatic Expansion of a Food Image Dataset Leveraging Existing Categories with Domain Adaptation. In ECCV Workshop on Transferring and Adapting Source Knowledge in Computer Vision (TASK-CV). 3–17.Google Scholar
- LeCun Y., Bengio Y., and Hinton G.2015. Deep learning. Nature 521(2015), 436–444. https://doi.org/10.1038/nature14539Google ScholarCross Ref
- Matsuda Y., Hoashi H., and Yanai K.2012. Recognition of Multiple-Food Images by Detecting Candidate Regions. In IEEE International Conference on Multimedia and Expo (ICME). 25–30. https://doi.org/10.1109/ICME.2012.157Google ScholarDigital Library
- K. Yanai and Y. Kawano. 2015. Food image recognition using deep convolutional network with pre-training and fine-tuning. In 2015 IEEE International Conference on Multimedia Expo Workshops (ICMEW). 1–6.Google Scholar
- Lei Zhou, Chu Zhang, Fei Liu, Zhengjun Qiu, and Yong He. 2019. Application of Deep Learning in Food: A Review. Comprehensive Reviews in Food Science and Food Safety 18, 6(2019), 1793–1811. https://doi.org/10.1111/1541-4337.12492 arXiv:https://onlinelibrary.wiley.com/doi/pdf/10.1111/1541-4337.12492Google ScholarCross Ref
Recommendations
Food Detection and Recognition Using Convolutional Neural Network
MM '14: Proceedings of the 22nd ACM international conference on MultimediaIn this paper, we apply a convolutional neural network (CNN) to the tasks of detecting and recognizing food images. Because of the wide diversity of types of food, image recognition of food items is generally very difficult. However, deep learning has ...
Food/Non-food Image Classification and Food Categorization using Pre-Trained GoogLeNet Model
MADiMa '16: Proceedings of the 2nd International Workshop on Multimedia Assisted Dietary ManagementRecent past has seen a lot of developments in the field of image-based dietary assessment. Food image classification and recognition are crucial steps for dietary assessment. In the last couple of years, advancements in the deep learning and ...
Food Image Recognition Using Very Deep Convolutional Networks
MADiMa '16: Proceedings of the 2nd International Workshop on Multimedia Assisted Dietary ManagementWe evaluated the effectiveness in classifying food images of a deep-learning approach based on the specifications of Google's image recognition architecture Inception. The architecture is a deep convolutional neural network (DCNN) having a depth of 54 ...
Comments