Abstract
Deep learning has achieved significant attention recently due to promising results in representing and classifying concepts most prominently in the form of convolutional neural networks (CNN). While CNN has been widely studied and evaluated in computer vision, there are other forms of deep learning algorithms which may be promising. One interesting deep learning approach which has received relatively little attention in visual concept classification is Cascade-Correlation Neural Networks (CCNN). In this paper, we create a visual concept retrieval system which is based on CCNN. Experimental results on the CalTech101 dataset indicate that CCNN outperforms ANN.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Weston, J., Ratle, F., Mobahi, H., Collobert, R.: Deep learning via semi-supervised embedding. In: Montavon, G., Orr, G.B., Müller, K.-R., et al. (eds.) NN: Tricks of the Trade, 2nd edn. LNCS, vol. 7700, pp. 639–655. Springer, Heidelberg (2012)
Rummelhart, D.E.: Learning representations by back-propagating errors. J. Nature 323(9), 533–536 (1986)
Yegnanarayana, B.: Artificial neural networks. M. PHI Learning Pvt. Ltd. (2009)
Mikolov, T., Kombrink, S., Deoras, A., et al.: RNNLM-Recurrent neural network language modeling toolkit. In: Proc. of the 2011 ASRU Workshop, pp. 196–201 (2011)
Hinton, G.E., Osindero, S., Teh, Y.W.: A fast learning algorithm for deep belief nets. J. Neural Computation 18(7), 1527–1554 (2006)
Ranzato, M., Susskind, J., Mnih, V., et al.: On deep generative models with applications to recognition. In: Proc. CVPR, pp. 2857–2864 (2011)
Le, Q.V.: Building high-level features using large scale unsupervised learning. In: Proc. Acoustics, Speech and Signal Processing (ICASSP), pp. 8595–8598 (2013)
Bengio, Y., Courville, A., Vincent, P.: Representation learning: A review and new perspectives. J. IEEE Trans. PAMI, 1798–1828 (2013)
Cireşan, D.C., Meier, U., Masci, J., et al.: High-performance neural networks for visual object classification. J. arXiv preprint arXiv:1102.0183 (2011)
Krizhevsky, A., Sutskever, I., Hinton, G.E.: ImageNet Classification with Deep Convolutional Neural Networks. J. NIPS, 1106–1114 (2012)
Fahlman, S.E., Lebiere, C.: The cascade-correlation learning architecture. J. Advances in Neural Information Processing Systems, 424–532 (1989)
Lazebnik, S., Schmid, C., Ponce, J.: Beyond bags of features: Spatial pyramid matching for recognizing natural scene categories. In: Proc. CVPR, vol. 2, pp. 2169–2178 (2006)
Indyk, P., Motwani, R.: Approximate nearest neighbors: towards removing the curse of dimensionality. In: Proc. of the Thirtieth Annual ACM Symposium on Theory of Computing, pp. 604–613. ACM (1998)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this paper
Cite this paper
Guo, Y., Bai, L., Lao, S., Wu, S., Lew, M.S. (2014). A Comparison between Artificial Neural Network and Cascade-Correlation Neural Network in Concept Classification. In: Ooi, W.T., Snoek, C.G.M., Tan, H.K., Ho, CK., Huet, B., Ngo, CW. (eds) Advances in Multimedia Information Processing – PCM 2014. PCM 2014. Lecture Notes in Computer Science, vol 8879. Springer, Cham. https://doi.org/10.1007/978-3-319-13168-9_26
Download citation
DOI: https://doi.org/10.1007/978-3-319-13168-9_26
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-13167-2
Online ISBN: 978-3-319-13168-9
eBook Packages: Computer ScienceComputer Science (R0)