Abstract
In this review, we briefly introduce the ’sparse coding’ strategy employed in the sensory information processing system of mammals, and reveal the relationship between the strategy and some new advances in nonlinear approximation theory.
Keywords
- Receptive Field
- Independent Component Analysis
- Sparse Representation
- Natural Image
- Independent Component Analysis
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Olshausen, B.A., Field, D.J.: Sparse Coding of Sensory Inputs. Current Opinion in Neurobiology 14, 481–487 (2004)
Olshausen, B.A., Field, D.J.: Sparse Coding With An Overcomplete Basis Set: a Strategy Employed By V1? Vision Res. 37, 3311–3325 (1997)
Simoncelli, E.P., Olshausen, B.A.: Natural Image Statistics and Neural Representation. Annu. Rev. Neurosci 24, 1193–1216 (2001)
DeVore, R.A.: Nonlinear Approximation. Acta Numerica. Cambridge University Press, Cambridge (1998)
Olshausen, B.A., Field, D.J.: Emergence of Simple-cell Receptive Field Properties By Learning A Sparse Code for Natural Images. Nature 381, 607–609 (1996)
Van Hateren, J.H., Van Der Schaaf, A.: Independent Component Filters of Natural Images Compared with Simple Cells in Primary Visual Cortex. Proc. R. Soc. Lond. B Biol. Sci. 265, 359–366 (1998)
Bell, A.J., Sejnowski, T.J.: The Independent Components. of Natural Scenes Are Edge Filters. Vision Res. 37, 3327–3338 (1997)
Hyvarinen, A., Hoyer, P.O.: Emergence of Phase and Shift Invariant Features by Decomposition of Natural Images into Independent Feature Subspaces. Neural Comput 12, 1705–1720 (2000)
Candès, E.J.: Harmonic Analysis of Neural Networks. Appl. Comput. Harmon. Anal. 6, 197–218 (1999)
Donoho, D.L.: Orthonormal Ridgelet and Straight Singularities. SIAM J. Math. Anal. 31, 1062–1099 (2000)
Candès, E.J.: On the Representation of Mutilated Sobolev Functions. SIAM J. Math. Anal. l, 2495–2509 (1999)
Shan, T., Jiao, L.C., Feng, X.C.: Ridgelet Frame. In: Campilho, A.C., Kamel, M.S. (eds.) ICIAR 2004. LNCS, vol. 3211, pp. 479–486. Springer, Heidelberg (2004)
Tan, S., Zhang, X.R., Jiao, L.C.: Dual Ridgelet Frame Constructed Using Biorthonormal Wavelet Basis. In: IEEE International Conference on Acoustics, Speech, and Signal Processing (2005)
Candès, E.J., Donoho, D.L.: Curvelet-A Surprisingly Effective Nonadaptive Representation for Objects With Edges. In: Cohen, A., Rabut, C., Schumaker, L.L. (eds.) Curve and Surface Fitting: Saint-Malo, Nashville, Van-derbilt Univ. Press, TN (1999)
Do, M.N., Vetterli, M.: Contourlets. In: Stoeckler, J., Welland, G.V. (eds.) Beyond Wavelet, Academic Press, London (2002)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Tan, S., Ma, X., Zhang, X., Jiao, L. (2005). A Review: Relationship Between Response Properties of Visual Neurons and Advances in Nonlinear Approximation Theory. In: Wang, J., Liao, X., Yi, Z. (eds) Advances in Neural Networks – ISNN 2005. ISNN 2005. Lecture Notes in Computer Science, vol 3496. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11427391_7
Download citation
DOI: https://doi.org/10.1007/11427391_7
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-25912-1
Online ISBN: 978-3-540-32065-4
eBook Packages: Computer ScienceComputer Science (R0)