Abstract
We propose a system for solving pixel-based multi-spectral image classification problems with high throughput pipelined hardware. We introduce a new shared weight network architecture that contains both neural network and morphological network functionality. We then describe its implementation on Reconfigurable Computers. The implementation provides speed-up for our system in two ways. (1) In the optimization of our network, using Evolutionary Algorithms, for new features and data sets of interest. (2) In the application of an optimized network to large image databases, or directly at the sensor as required. We apply our system to 4 feature identification problems of practical interest, and compare its performance to two advanced software systems designed specifically for multi-spectral image classification. We achieve comparable performance in both training and testing. We estimate speed-up of two orders of magnitude compared to a Pentium III 500 MHz software implementation.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
M. Annapolis, http://www.annapmicro.com/. 2001.
J. Astola and P. Kuosmanen, Fundamentals of Nonlinear Digital Filtering, CRC Press: New York, 1997.
A. Blum and P. Langley, “Selection of relevant features and examples in machine learning,” Artificial Intelligence, Vol. 97, Nos. 1/2, pp. 245–271, 1997.
A.C. Bovik, T. Huang, and D. Munson, “A generalization of median filtering using linear combinations or order statistics,” IEEE Trans. Acoust., Speech, Signal Processing, Vol. 31, pp. 1342–1350, 1983.
Y.Y. Chung, M.T. Wong, N.W. Bergmann, and M. Bennamoun, “Implementing neural network in custom computers,” in IEEE International Conference on Systems, Man and Cybernetics: Conference Theme: Intelligent Systems for Humans in a Cyberworld. IEEE: San Diego, California, USA, 1998.
J.G. Eldredge and B.L. Hutchings, “Run-time reconfiguration: A method for enhancing the functional density of SRAM-based FPGAs,” Journal of VLSI Signal Processing, Vol. 12, No. 1, pp. 67–86, 1996.
M.A. Figueiredo and C. Gloster, “Implementation of a probabilistic neural network for multi-spectral image classification on an FPGA based custom computing machine,” in Vth Brazilian Symposium on Neural Networks. IEEE Computer Society: Belo Horizonte, Brazil, 1998.
D. Floreano and F. Mondada, “Automatic creation of an autonomous agent: Genetic evolution of a neural network driven robot,” in From Animals to Animats 3: Proc. 3rd Int. Conf. Simulation of Adaptive Behaviour, D.C. J.A. Meyer, P. Husbands, and S. Wilson (Eds.), MIT Press: Cambridge, 1994.
K. Fukushima, “Neocognitron:A self-organizing neural network model for a mechanism of pattern recognition unaffected by shift in position,” Biol. Cybern., Vol. 36, pp. 193–202, 1980.
K. Fukushima, “Neocognitron: A hierarchical neural network capable of visual pattern recognition,” Neural Networks, Vol. 1, pp. 119–130, 1988.
M. Gabbouj, E.J. Coyle, and N.C. Gallagher, “An overview of median and stack filtering,” Circuits, Systems, and Signal Processing, Vol. 11, No. 1, pp. 7–45, 1992.
F. Gurau, “Automatic definition of sub-neural networks,” Labortatoire de I'Informatique du Parallelism, Ecole Normale Superieure de Lyon: Lyon, France, 1994.
I. Harvey, P. Husbands, and D. Cliff, “Seeing the light: Artificial evolution, real vision,” in From Animals to Animats 3: Proc. 3rd Int. Conf. Simulation of Adaptive Behaviour, J.A.M.D. Cliff and S. Wilson (Eds.), MIT Press, 1994.
P. Heinonen and Y. Neuvo, “FIR-median hybrid filters,” IEEE Trans. Acoust., Speech, Signal Processing, Vol. 35, pp. 832–838, 1987.
A.K. Jain and F. Farrokhnia, “Unsupervised texture segmentation using Gabor filters,” Pattern Recognition, Vol. 24, No. 12, pp. 1167–1186, 1991.
M.D. King, W.P. Menzel, P.S. Grant, J.S. Myers, G.T. Arnold, S.E. Platnick, L.E. Gumley, S.C. Tsay, C.C. Moeller, M. Fitzgerald, K.S. Brown, and F.G. Osterwisch, “Airborne scanning spectrometer for remote sensing of cloud, aerosol, water vapor and surface properties,” Journal of Atmos. Oceanic Technol., Vol. 13, pp. 777–794, 1996.
P. Kraft, N.R. Harvey, and S. Marshall, “Parallel genetic algorithms in the optimization of morphological filters: A general design tool,” Journal of Electronic Imaging, Vol. 6, No. 4, pp. 504–516, 1997.
K.I. Laws, “Texture energy measures,” in Proceedings of Image Understanding Workshop, 1979.
Y. LeCun and B. Boser, “Convolutional networks for images, speech and time series,” in The Handbook of Brain Science and Neural Networks, M. Arbib (Ed.), MIT Press: Cambridge, MA, 1995, pp. 255–258.
L. Meeden, “An incremental approach to developing intelligent neural network controllers for robots,” IEEE Transactions on Systems, Man and Cybernetics: Part B, Vol. 26, No. 3, pp. 474–485, 1996.
J.F. Miller, D. Job, and V.K. Vassilev, “Principles in the evolutionary design of digital circuits—Part I,” Genetic Programming and Evolvable Machines, Vol. 1, No. 1, pp. 7–35, 2000.
M. Mitchell, J.P. Crutchfield, and R. Das, “Evolving cellular automata with genetic algorithms: A review of recent work,” in First International Conference on Evolutionary Computation and Its Applications (EvCA'96). Moscow, Russia, 1996.
D.E. Moriarty and R. Miikkulaiinen, “Forming neural networks through efficient and adaptive coevolution,” Evolutionary Computation, Vol. 5, No. 4, 1998.
C. Neubauer, “Evaluation of convolutional neural networks for visual recognition,” IEEE Transactions on Neural Networks, Vol. 9, No. 4, pp. 685–696, 1998.
J.D. Paola and R.A. Schowengerdt, “A review and analysis of backpropagation neural networks for classification of remotelysensed multi-spectral imagery,” International Journal of Remote Sensing, Vol. 16, No. 16, pp. 3033–3058, 1995.
S. Perkins, N.R. Harvey, S.P. Brumby, and K. Lacker, “Support vector machines for broad area feature extraction in remotely sensed images,” in Proc. SPIE 4381, 2001.
S. Perkins, J. Theiler, S.P. Brumby, N.R. Harvey, and R.B. Porter, “GENIE: A hybrid genetic algorithm for feature classification in multispectral images,” in Proc. SPIE, 2000.
M. Pietikainen, A. Rosenfeld, and L.S. Davis, “Experiments with texture classification using averages of local pattern matches,” IEEE Transactions on Systems, Man and Cybernetics, Vol. SMC-13, No. 3, 1983.
R. Porter, M. Gokhale, N. Harvey, S. Perkins, and C. Young, “Evolving network architectures with custom computers for multi-spectral feature identification,” in Third NASA/DoD Workshop on Evolvable Hardware, EH-2001, Long Beach, CA, 2001.
R.B. Porter, M. Gokhale, N.R. Harvey, S.J. Perkins, and C. Young, “Evolving a spatio-spectral network on reconfigurable computing for multispectral feature identification,” in Proc. SPIE, 2001.
M.A. Potter and K.A.D. Jong, “Evolving neural networks with collaborative species,” in Proceedings of the 1995 Summer Computer Simulation Conference, Ontario, Canada, 1995.
C.C. Pu and F.Y. Shih, “Soft mathematical morphology: Binary and gray scale,” in International Workshop on Mathematical Morphology and its Applications to Signal Processing, Barcelona, Spain, 1993.
G.X. Ritter and P. Sussner, “An introduction to morphological neural networks,” in 13th International Conference on Pattern Recognition, Vienna, Austria, 1996.
L.G. Roberts, “Machine perception of three-dimensional solids, in Optical and Electro-Optical Information Processing, J.T. Tippet (Ed.), MIT Press: Cambridge, MA, 1965.
F. Rosenblatt, Principles of Neurodynamics: Perceptrons and the Theory of Brain Mechanisms, Spartan: Washington D.C. 1962.
R.E. Schapire, Y. Freund, P. Bartlett, and W.S. Lee, “Boosting the margin: A new explanation for the effectiveness of voting methods,” in Proc. 14th International Conference on Machine Learning, Morgan Kaufmann, 1997.
I. Sobel, “Camera models and machine perception,” Stanford Artificial Intelligence Lab: Palo Alto, 1970.
P. Sussner, “Morphological perceptron learning,” in Joint Conference on the Science and Technology of Intelligent Systems, IEEE: Maryland, 1998.
J. Theiler, N.R. Harvey, S.P. Brumby, J.J. Szymanski, S. Alferink, S. Perkins, R. Porter, and J.J. Block, “Evolving retrieval algorithms with a genetic programming scheme,” in Proc. SPIE, 1999.
V.N. Vapnik, “Statistical learning theory,” Wiley Series on Adaptive and Learning Systems for Signal Processing, Communications, and Control, S. Haykin (Ed.), John Wiley & Sons, Inc, New York, 1998
J. Villasenor and W. Mangione-Smith, Configurable Computing, Scientific American, pp. 66–71, June 1997.
P.G. Weber, B.C. Brock, A.J. Garret, B.W. Smith, C.C. Borel, W.B. Clodius, S.C. Bender, R.R. Kay, and M.L. Decker, “Multispectral thermal imager mission overview,” in Proc. SPIE, 1999.
D. Whitley, S. Dominic, R. Das, and C. Anderson, “Genetic reinforcement learning for neurocontrol problems,” Machine Learning, Vol. 13, pp. 259–284, 1993.
S.S. Wilson, “Morphological networks,” in Visual Communications and Image Processing IV, SPIE, 1989.
Y. Won and P.D. Gader, “Morphological shared-weight neural network for pattern classification and automatic target detection,” in IEEE International Conferenec on Neural Networks, 1995.
Xilinx, Virtex Configuration Architecure: Advanced User's Guide, Xilinx Inc., 1999.
P. Yang and P. Maragos, “Min-max classifiers: Learnability, design and application,” Pattern Recognition, Vol. 28, No. 6, pp. 879–899, 1995.
X. Yao, “A review of evolutionary artificial neural networks,” International Journal of Intelligent Systems, Vol. 8, No. 4, pp. 539–577, 1993.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Porter, R., Harvey, N., Perkins, S. et al. Optimizing Digital Hardware Perceptrons for Multi-Spectral Image Classification. Journal of Mathematical Imaging and Vision 19, 133–150 (2003). https://doi.org/10.1023/A:1024777431042
Issue Date:
DOI: https://doi.org/10.1023/A:1024777431042