Abstract
Food item segmentation in an image is a kind of fine-grained segmentation task, which is comparatively difficult than conventional image segmentation because intra-class variance is high and inter-class variance is low. So, an interactive food item segmentation algorithm using Random Forest is proposed in this work. The first step of the proposed algorithm is interactive food image segmentation, where food parts are extracted based on user inputs. It is observed that some of the segmented food parts may have some holes due to improper distribution of light. So, Boundary Detection & Filling and Gappy Principal Component Analysis methods are applied to restore the missing information in the second step. Local Binary Pattern and Non Redundant Local Binary Pattern are used for extracting features from the restored food parts, which are fed into support vector machine classifier for differentiating one food image from others. All the experiments have been performed on Food 101 database. A comparative study has also been done based on the three existing methods. The obtained results demonstrate that the proposed method outperforms the existing methods.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Chen, M., Dhingra, K., Wu, W., Yang, L., Sukthankar, R., Yang, J.: PFID: Pittsburgh fast-food image dataset. In: 16th IEEE International Conference on Image Processing, pp. 289–292 (2009)
Lowe, D.G.: Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vis. 60(2), 91–110 (2004)
Chen, Q., Agu, E.: Exploring statistical GLCM texture features for classifying food images. In: International Conference on Healthcare Informatics, pp. 453–453 (2015)
Bossard, L., Guillaumin, M., Van Gool, L.: Food-101 – mining discriminative components with random forests. In: Fleet, D., Pajdla, T., Schiele, B., Tuytelaars, T. (eds.) ECCV 2014. LNCS, vol. 8694, pp. 446–461. Springer, Cham (2014). https://doi.org/10.1007/978-3-319-10599-4_29
Nguyen, D.T., Zong, Z., Ogunbona, P.O., Probst, Y., Li, W.: Food image classification using local appearance and global structural information. Neurocomputing 140, 242–251 (2014)
Pishva, D., Kawai, A., Shiino, T.: Shape based segmentation and color distribution analysis with application to bread recognition. In: IAPR Conference on Machine Vision Applications (2000)
Joutou, T., Yanai, K.: A food image recognition system with multiple kernel learning. In: 16th IEEE International Conference on Image Processing, pp. 285–288 (2009)
Hoashi, H., Joutou, T., Yanai, K.: Image recognition of 85 food categories by feature fusion. In: IEEE International Symposium on Multimedia, pp. 296–301 (2010)
He, Y., Xu, C., Khanna, N., Boushey, C.J., Delp, E.J.: Analysis of food images: features and classification. In: IEEE International Conference on Image Processing, pp. 2744–2748 (2014)
He, Y., Xu, C., Khanna, N., Boushey, C.J., Delp, E.J.: Food image analysis: segmentation, identification and weight estimation. In: IEEE International Conference on Multimedia and Expo, pp. 1–6 (2013)
Bosch, M., Zhu, F., Khanna, N., Boushey, C.J., Delp, E.J.: Food texture descriptors based on fractal and local gradient information. In: 19th European Conference on Signal Processing, pp. 764–768 (2011)
Sridevi, M., Mala, C.: A survey on monochrome image segmentation methods. In: 2nd International Conference on Communication, Computing & Security, vol. 6, pp. 548–555 (2012)
Khan, W.: Image segmentation techniques: a survey. J. Image Graph. 1(4), 166–170 (2013)
Mageswari, S.U., Sridevi, M., Mala, C.: An experimental study and analysis of different image segmentation techniques. In: International Conference on Design and Manufacturing, vol. 64, pp. 36–45 (2013)
Bai, X., Sapiro, G.: Geodesic matting: a framework for fast interactive image and video segmentation and matting. Int. J. Comput. Vis. 82(2), 113–132 (2009)
Breiman, L.: Consistency for a simple model of random forests (2004)
Gonzalez, R.C., Woods, R.E.: Digital Image Processing. Pearson Education, London (2002)
Seal, A., Bhattacharjee, D., Nasipuri, M., Basu, D.K.: UGC-JU face database and its benchmarking using linear regression classifier. Multimed. Tools Appl. 74(9), 2913–2937 (2015)
Ojala, T., Pietikäinen, M., Harwood, D.: A comparative study of texture measures with classification based on featured distributions. Pattern Recogn. 29(1), 51–59 (1996)
Acknowledgment
Authors are thankful to a project entitled Privacy Enhancing Revocable Biometric Identities funded by DAE, BRNS, GOI and PDPM IIITDM Jabalpur for providing necessary infrastructure to conduct experiments relating to this work. Ayan Seal is grateful to Media Lab Asia, MeitY, GOI for providing him Visvesvaraya young faculty research fellowship.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer International Publishing AG, part of Springer Nature
About this paper
Cite this paper
Inunganbi, S., Seal, A., Khanna, P. (2018). Classification of Food Images through Interactive Image Segmentation. In: Nguyen, N., Hoang, D., Hong, TP., Pham, H., Trawiński, B. (eds) Intelligent Information and Database Systems. ACIIDS 2018. Lecture Notes in Computer Science(), vol 10752. Springer, Cham. https://doi.org/10.1007/978-3-319-75420-8_49
Download citation
DOI: https://doi.org/10.1007/978-3-319-75420-8_49
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-75419-2
Online ISBN: 978-3-319-75420-8
eBook Packages: Computer ScienceComputer Science (R0)