Abstract
Neural networks researches are developed for the recent machine learnings. To improve the performance of the neural networks, the biological inspired neural networks are often studied. Models for motion processing in the biological systems have been used, which consist of the symmetric networks with quadrature functions of Gabor filters. This paper proposes a model of the bio-inspired asymmetric neural networks, which shows excellent ability of the movement detection. The prominent features are the nonlinear characteristics as the squaring and rectification functions, which are observed in the retinal and visual cortex networks. In this paper, the proposed asymmetric network with Gabor filters and the conventional energy model are analyzed from the orthogonality characteristics. It is shown that the biological asymmetric network is effective for generating the orthogonality function using the network correlation computations. Further, the asymmetric networks with nonlinear characteristics are able to generate independent subspaces, which will be useful for the creation of features spaces and efficient computations in the learning.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Reichard, W.: Autocorrelation, A Principle for the Evaluation of Sensory Information by the Central Nervous System. Rosenblith edn. Wiley, NY (1961)
Adelson, E.H., Bergen, J.R.: Spatiotemporal energy models for the perception of motion. J. Optical Soc. Am. A 2, 284–299 (1985)
Pan, H., Jiang, H.: Learning convolutional neural networks using hybrid orthogonal projection and estimation. In: ACML 2017, Proceedings of the Machine Learning Research, vol. 77, 1–16 (2017)
Bansal, N., Chen, X., Wang, Z.: Can we gain more from orthogonality regularization in training deep CNNs? In: 32nd International Conference on Neural Information Processing System, NIPS 2018, pp. 4266–4276 (2018)
Widrow, B., Greenblatt, A., Kim, Y., Park, D.: The No-Prop algorithm: a new learning algorithm for multilayer neural networks. Neural Netw. 37, 182–188 (2013)
Huang, L., Liu, X., Lang, B., Yu, A.W., Wang, Y., Li, B.: Orthogonal weight normalization: solution to optimization over multiple dependent stiefel manifolds in deep neural networks. In: 32nd AAAI Conference on AI, AAAI-18, pp. 3271–3278 (2018)
Shi, W., Gong, Y., Cheng, D., Tao, X., Zheng, N.: Entropy orthogonality based deep discriminative feature learning for object recognition. Pattern Recogn. 81, 71–80 (2018)
Simonceli, E.P., Heeger, D.J.: A model of neuronal responses in visual area MT. Vision. Res. 38, 743–761 (1996)
Marmarelis, P.Z., Marmarelis, V.Z.: Analysis of Physiological Systems – The White Noise Approach. Plenum Press, New York (1978)
Sakuranaga, M., Naka, K.-I.: Signal Transmission in the Catfish Retina.III. Transmission to Type-C Cell. J. Neurophysiol. 53(2), 411–428 (1985)
Naka, K.-I., Sakai, H.M., Ishii, N.: Generation of transformation of second order nonlinearity in catfish retina. Ann. Biomed. Eng. 16, 53–64 (1988)
Ishii, N., Deguchi, T., Kawaguchi, M., Sasaki, H.: Motion detection in asymmetric neural networks. In: Cheng, L., Liu, Q., Ronzhin, A. (eds.) ISNN 2016. LNCS, vol. 9719, pp. 409–417. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-40663-3_47
Ishii, N., Deguchi, T., Kawaguchi, M., Sasaki, H.: Distinctive features of asymmetric neural networks with gabor filters. In: de Cos Juez, F., et al. (eds.) HAIS 2018. LNCS, vol. 10870, pp. 185–196. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-92639-1_16
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Ishii, N., Deguchi, T., Kawaguchi, M., Sasaki, H., Matsuo, T. (2019). Orthogonal Properties of Asymmetric Neural Networks with Gabor Filters. In: Pérez GarcÃa, H., Sánchez González, L., Castejón Limas, M., Quintián Pardo, H., Corchado RodrÃguez, E. (eds) Hybrid Artificial Intelligent Systems. HAIS 2019. Lecture Notes in Computer Science(), vol 11734. Springer, Cham. https://doi.org/10.1007/978-3-030-29859-3_50
Download citation
DOI: https://doi.org/10.1007/978-3-030-29859-3_50
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-29858-6
Online ISBN: 978-3-030-29859-3
eBook Packages: Computer ScienceComputer Science (R0)