Xiu Jin
ABSTRACT
For agricultural special species, the labeled procedure of large-scale samples is costly, thus, the bamboo species only has a limited number for supervised learning. The fine-tuning strategy is important for deep neural network by transferring learning methods, which utilize the weight of the deep model of the source domain, and can solve the problem associated with insufficient samples to make the model more stability and robustness. In the manuscript, the novelty of the strategy, for images of bamboo species with low-shot classification, mainly proposed an idea that is the transfer of the convolutional group features of deep convolutional models. The deep models with a novel fine-tuning method and three optimizers that are stochastic gradient descent, Adaptive Moment estimation, and Adadelta respectively, are evaluated by the accuracy and the expected calibration error value for the analysis of deep model generalization. An analysis of the results showed that, based on the proportion of training dataset is only 30%, the innovative strategy for bamboo species classification achieved better performance that has an accuracy of 0.82, and the expected calibration error of 0.16, which were better stability and generalization than those of other fine-tuning strategies. Consequently, the novel fine-tuning strategy proposed in this manuscript transfers the features of deep convolutional groups, improves the accuracy and generalizability of the model, and resolves the problems associated with having insufficient samples of bamboo species for low-shot classification.
- Yaping H, Cuiwei Z, Benxiang L, Shimin F and Junming J (2012). Moderate Theory for Germplasm Conservation System of Bamboo in China. World Bamboo and Rattan, 10(6), 31--41. https://doi.org/10.13640/j.cnki.wbr.2012.06.011.Google Scholar
- Kamilaris A and Prenafeta-Boldú F X (2018). Deep learning in agriculture: A survey. Computers and Electronics in Agriculture, 147(February), 70--90. https://doi.org/10.1016/j.compag.2018.02.016.Google ScholarCross Ref
- Barbedo J G A (2018). Impact of dataset size and variety on the effectiveness of deep learning and transfer learning for plant disease classification. Computers and Electronics in Agriculture, 153(August), 46--53. https://doi.org/10.1016/j.compag.2018.08.013.Google ScholarCross Ref
- Simonyan K and Zisserman A (2015). Very Deep Convolutional Networks for Large-Scale Image Recognition. ICLR: 1--14. http://arxiv.org/abs/1409.1556.Google Scholar
- He K, Zhang X, Ren S and Sun J (2016). Deep residual learning for image recognition. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2016-Decem: 770--778. https://doi.org/10.1109/CVPR.2016.90.Google ScholarCross Ref
- Huang G, Liu Z, Van Der Maaten L and Weinberger K Q (2017). Densely connected convolutional networks. Proceedings - 30th IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2017, 2017-Janua, 2261--2269. https://doi.org/10.1109/CVPR.2017.243.Google ScholarCross Ref
- Deng J, Dong W, Socher R, Li L, Li K and F F Li (2009). ImageNet: A Large-Scale Hierarchical Image Database, 248--255.Google Scholar
- Tan C, Sun F, Kong T, Zhang W, Yang C and Liu C (2018). A survey on deep transfer learning. Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 11141 LNCS, 270--279. https://doi.org/10.1007/978-3-030-01424-7_27.Google Scholar
- Huang J T, Li J, Yu D, Deng L and Gong Y (2013). Cross-language knowledge transfer using multilingual deep neural network with shared hidden layers. ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings, 1, 7304--7308. https://doi.org/10.1109/ICASSP.2013.6639081.Google Scholar
- Oquab M, Bottou L, Laptev I and Sivic J (2014). Learning and transferring mid-level image representations using convolutional neural networks. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 1717--1724. https://doi.org/10.1109/CVPR.2014.222.Google ScholarDigital Library
- Akcay S, Kundegorski M E, Willcocks C G and Breckon T P (2018). Using deep convolutional neural network architectures for object classification and detection within x-ray baggage security imagery. IEEE Transactions on Information Forensics and Security, 13(9), 2203--2215. https://doi.org/10.1109/TIFS.2018.2812196.Google ScholarCross Ref
- Wen L, Li X and Gao L (2019). A transfer convolutional neural network for fault diagnosis based on ResNet-50. Neural Computing and Applications, 0123456789. https://doi.org/10.1007/s00521-019-04097-w.Google ScholarDigital Library
- Yosinski J, Clune J, Bengio Y and Lipson H (2014). How transferable are features in deep neural networks? Advances in Neural Information Processing Systems, 4(January), 3320--3328.Google Scholar
- Dean J, Corrado G S, Monga R, Chen K, Devin M. Le Q V, Mao M Z, Ranzato M A, Senior A, Tucker P, Yang K and Ng A Y (2012). Large scale distributed deep networks. Advances in Neural Information Processing Systems, 2(October 2014), 1223--1231.Google Scholar
- Reddi S J, Kale S and Kumar S (2018). On the Convergence of Adam and Beyond. ICLR: 1--23. http://arxiv.org/abs/1904.09237.Google Scholar
- Wang X, Zhang P, Zhao Q, Pan J and Yan Y (2016). Improved end-to-end speech recognition using adaptive per-dimensional learning rate methods. IEICE Transactions on Information and Systems, E99D, (10), 2550--2553. https://doi.org/10.1587/transinf.2016SLL0001.Google Scholar
- Guo C, Pleiss G, Sun Y and Weinberger K Q (2017). On calibration of modern neural networks. 34th International Conference on Machine Learning, ICML 2017, 3, 2130--2143.Google Scholar
- Han T, Liu C, Yang W and Jiang D (2019). Learning transferable features in deep convolutional neural networks for diagnosing unseen machine conditions. ISA Transactions, vol. 93, 341 -353. https://doi.org/10.1016/j.isatra.2019.03.017.Google ScholarCross Ref
Index Terms
- Classifying a Limited Number of the Bamboo Species by the Transformation of Convolution Groups
Recommendations
Automatic Fish Species Classification Using Deep Convolutional Neural Networks
AbstractIn this paper, we presented an automated system for identification and classification of fish species. It helps the marine biologists to have greater understanding of the fish species and their habitats. The proposed model is based on deep ...
Edge-preserving image denoising using a deep convolutional neural network
Highlights- This paper makes use of a deep CNN for image denoising.
- The network is trained ...
AbstractThis paper introduces a novel denoising approach making use of a deep convolutional neural network to preserve image edges. The network is trained by using the edge map obtained from the well-known Canny algorithm and aims at ...
Richer feature for image classification with super and sub kernels based on deep convolutional neural network
The concepts of super convolutional kernel and sub convolutional kernel are proposed inspired by the process that human observes objects.A novel Parallel Crossing Deep Convolutional Neural Network (PCDCNN) model is designed to simulate the human ...
Comments