Abstract
Being able to accurately recognise food categories from input images has many possibly useful applications such as content-based recipe searching or automatic intake calories tracking. Convolutional neural networks has been successfully applied in a number of food recognition tasks. Despite its impressive predictive performance on closed datasets, there is currently no standard mechanism for distinguishing unknown object classes from the known ones leading to invalid classification attempts even on non-food images. In this paper, we study a technique for detecting whether input images are beyond the scope of CNN’s knowledge. The idea is to model the final activation vectors of data from the known classes using a data description method namely the support vector data description. We can then reject network’s prediction if the activation vector of the query image is too different from the known ones as generalised by the model. Experimental results on a subset of UECFOOD100 datasets demonstrated that the proposed method was able to accurately classify instances from the known classes while also being able to satisfactorily reject the prediction of novel food image compared to two commonly used baselines.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Bendale A, Boult TE (2015) Towards open set deep networks. CoRR abs/1511.06233
Chen J, Ngo CW (2016) Deep-based ingredient recognition for cooking recipe retrieval. In: Proceedings of the 2016 ACM on multimedia conference, pp 32–41
Deng J, Dong W, Socher R, Li LJ, Li K, Fei-Fei L (2009) Imagenet: a large-scale hierarchical image database. In: Proceedings of IEEE CVPR, pp 248–255
Fawcett T (2006) An introduction to roc analysis. Pattern Recogn Lett 27(8):861–874
He H, Kong F, Tan J (2016) DietCam: multiview food recognition using a multikernel SVM. IEEE J Biomed Health Inform 20:848–855
He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: Proceedings of IEEE CVPR, pp 770–778
He Y, Xu C, Khanna N, Boushey CJ, Delp EJ (2014) Analysis of food images: features and classification. In: Proceedings of IEEE image processing, pp 2744–2748
Huang G, Liu Z, Van Der Maaten L, Weinberger KQ (2017) Densely connected convolutional networks. In: Proceedings of IEEE CVPR, pp 4700–4708
Jain LP, Scheirer WJ, Boult TE (2014) Multi-class open set recognition using probability of inclusion. In: ECCV. Springer, Cham, pp 393–409
Kawano Y, Yanai K (2014) FoodCam: a real-time food recognition system on a smartphone. Multimed Tools Appl 74:5263–5287
Matsuda Y, Hoashi H, Yanai K (2012) Recognition of multiple-food images by detecting candidate regions. In: Proceedings of IEEE ICME
Meyers A, Johnston N, Rathod V, Korattikara A, Gorban A, Silberman N, Guadarrama S, Papandreou G, Huang J, Murphy KP (2015) Im2Calories: towards an automated mobile vision food diary. In: Proceedings of IEEE international conference on computer vision, pp 1233–1241
Mezgec S, Koroušić Seljak B (2017) Nutrinet: adeep learning food and drink image recognition system for dietary assessment. Nutrients 9(7):657
Moya MM, Koch MW, Hostetler LD (1993) One-class classifier networks for target recognition applications. NASA STI/Recon Technical Report 93
Pimentel MA, Clifton DA, Clifton L, Tarassenko L (2014) A review of novelty detection. Sig Process 99:215–249
Pouladzadeh P, Villalobos G, Almaghrabi R, Shirmohammadi S (2012) A novel SVM based food recognition method for calorie measurement applications. In: Proceedings of IEEE ICME (workshops), pp 495–498
Scheirer WJ, de Rezende Rocha A, Sapkota A, Boult TE (2013) Toward open set recognition. IEEE TPAMI 35(7):1757–1772
Simonyan K, Zisserman A (2014) Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556
Tax DM, Duin RP (2004) Support vector data description. Mach Learn 54(1):45–66
Yanai K, Kawano Y (2015) Food image recognition using deep convolutional network with pre-training and fine-tuning. In: Proceedings of IEEE international conference on multimedia & expo workshops, pp 1–6
Yosinski J, Clune J, Bengio Y, Lipson H (2014) How transferable are features in deep neural networks? In: NIPS, pp 3320–3328
Acknowledgement
The research is supported by the Faculty of Science, Chiang Mai University.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Bootkrajang, J., Chawachat, J., Trakulsanguan, E. (2020). Deep-Based Openset Classification Technique and Its Application in Novel Food Categories Recognition. In: Burduk, R., Kurzynski, M., Wozniak, M. (eds) Progress in Computer Recognition Systems. CORES 2019. Advances in Intelligent Systems and Computing, vol 977. Springer, Cham. https://doi.org/10.1007/978-3-030-19738-4_24
Download citation
DOI: https://doi.org/10.1007/978-3-030-19738-4_24
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-19737-7
Online ISBN: 978-3-030-19738-4
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)