research-article

A preliminary investigation of a neocortex model implementation on the Cray XD1

Authors:

Kenneth L. Rice,

Christopher N. Vutsinas,

Tarek M. TahaAuthors Info & Claims

SC '07: Proceedings of the 2007 ACM/IEEE conference on Supercomputing

Article No.: 2, Pages 1 - 8

https://doi.org/10.1145/1362622.1362626

Published: 10 November 2007 Publication History

Abstract

In this paper we study the acceleration of a new class of cognitive processing applications based on the structure of the neocortex. Specifically we examine the speedup of a visual cortex model for image recognition. We propose techniques to accelerate the application on general purpose processors and on reconfigurable logic. We present implementations of our approach on a Cray XD1 and compare the performance potential of scaling the design utilizing reconfigurable logic based acceleration to a software only design. Our results indicate that acceleration using reconfigurable logic can provide a significant speedup over a software only implementation.

References

[1]

J. A. Anderson, "The BSB Network" In: Hassoun, M. H. (ed.): Associative Neural Networks. Oxford University Press, New York, 77--103, 1993.

Digital Library

[2]

J. A. Anderson. "Arithmetic on a parallel computer: Perception versus logic," Brain and Mind, 4:169--188, 2003.

[3]

J. A. Anderson, P. Allopenna, G. S. Guralnik, D. Scheinberg, J. A. Santini, S. Dimitriadis, B. B. Machta, and B. T. Merritt, "Programming a Parallel Computer: The Ersatz Brain Project", In W. Duch, J. Mandziuk, and J. M. Zurada (Eds.), Challenges to Computational Intelligence, Springer: Berlin, 2006.

[4]

T. Dean. "A Computational Model of the Cerebral Cortex." In Proceedings of the Twentieth National Conference on Artificial Intelligence (AAAI-05), pages 938--943, Cambridge, Massachusetts, 2005. AAAI, MIT Press.

Digital Library

[5]

D. J. Felleman and D. C. Van Essen, "Distributed hierarchical processing in the primate cerebral cortex," Cereb. Cortexl, 1--47 (1991).

[6]

D. George and J. Hawkins. "A Hierarchical Bayesian Model of Invariant Pattern Recognition in the Visual Cortex," in International Joint Conference on Neural Networks, 2005.

[7]

D. Hammerstrom, "Artificial Neural Networks, Where Do We Go Next?", http://web.cecs.pdx.edu/~strom/research/dh_research_sept05.pdf

[8]

J. Hawkins. "Learn Like A Human." in IEEE Spectrum, April 2007.

[9]

J. Hawkins and S. Blakeslee. "On Intelligence," Times Books, Henry Holt and Company, New York, NY 10011, Sept 2004.

Digital Library

[10]

J. Hawkins and D. George, "Hierarchical Temporal Memory - Concepts, Theory, and Terminology," Whitepaper, Numenta Inc, May 2006.

[11]

C. Johansson and A. Lansner. "Towards Cortex Sized Artificial Neural Systems", Neural Networks, 20(1):48--61, January 2007.

Digital Library

[12]

S. Lafontant and T. M. Taha, "Feasibility of Hardware Acceleration of a Neocortex Model," The International Conference on Engineering of Reconfigurable Systems and Algorithms, June 2007.

[13]

T. S. Lee and D. Mumford. "Hierarchical bayesian inference in the visual cortex" in Journal of the Optical Society of America A, 2(7): 1434--1448, 2003.

[14]

J. Pearl. "Probabilistic Reasoning in Intelligent Systems," Morgan Kaufman Publishers, San Francisco, California, 1988.

Digital Library

[15]

R. Zemel. "Cortical belief networks," in Hecht-Neilsen, R., ed., Theories of the Cerebral Cortex. New York, NY: Springer-Verlag, 2000.

Cited By

Wei HLi QDong Z(2014)Learning and Representing Object Shape Through an Array of Orientation ColumnsIEEE Transactions on Neural Networks and Learning Systems10.1109/TNNLS.2013.229317825:7(1346-1358)Online publication date: Jul-2014
https://doi.org/10.1109/TNNLS.2013.2293178
Wei HLi H(2013)Shape Description and Recognition Method Inspired by the Primary Visual CortexCognitive Computation10.1007/s12559-013-9222-36:2(164-174)Online publication date: 12-Jun-2013
https://doi.org/10.1007/s12559-013-9222-3
Rast ANavaridas JJin XGalluppi FPlana LMiguel-Alonso JPatterson CLuján MFurber S(2011)Managing Burstiness and Scalability in Event-Driven Models on the SpiNNaker Neuromimetic SystemInternational Journal of Parallel Programming10.1007/s10766-011-0180-740:6(553-582)Online publication date: 23-Jul-2011
https://doi.org/10.1007/s10766-011-0180-7
Show More Cited By

Index Terms

A preliminary investigation of a neocortex model implementation on the Cray XD1
1. Computer systems organization
  1. Architectures
    1. Distributed architectures

Recommendations

Scaling analysis of a neocortex inspired cognitive model on the Cray XD1

This paper presents the implementation and scaling of a neocortex inspired cognitive model on a Cray XD1. Both software and reconfigurable logic based FPGA implementations of the model are examined. This model belongs to a new class of biologically ...
Reconfiguration of FPGA for Domain Specific Applications Using Embedded System Approach
ICSPS '09: Proceedings of the 2009 International Conference on Signal Processing Systems

Today’s systems are more complex and need higher performance. To accomplish this, systems include more hardware compared to software. This increases the use of FPGAs in modern systems because of its reconfiguration capabilities. FPGA contains many ...
Preliminary investigation of advanced electrostatics in molecular dynamics on reconfigurable computers
SC '06: Proceedings of the 2006 ACM/IEEE conference on Supercomputing

Scientific computing is marked by applications with very high performance demands. As technology has improved, reconfigurable hardware has become a viable platform to provide application acceleration, even for floating-point-intensive scientific ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

SC '07: Proceedings of the 2007 ACM/IEEE conference on Supercomputing

November 2007

723 pages

ISBN:9781595937643

DOI:10.1145/1362622

General Chair:
Becky Verastegui
Oak Ridge National Laboratory

Copyright © 2007 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGARCH: ACM Special Interest Group on Computer Architecture
IEEE-CS: Computer Society

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 10 November 2007

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

SC '07

Sponsor:

SIGARCH
IEEE-CS

SC '07: International Conference for High Performance Computing, Networking, Storage and Analysis

November 10 - 16, 2007

Nevada, Reno

Acceptance Rates

SC '07 Paper Acceptance Rate 54 of 268 submissions, 20%;

Overall Acceptance Rate 1,516 of 6,373 submissions, 24%

Upcoming Conference

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

4
Total Citations
View Citations
232
Total Downloads

Downloads (Last 12 months)3
Downloads (Last 6 weeks)0

Reflects downloads up to 25 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Wei HLi QDong Z(2014)Learning and Representing Object Shape Through an Array of Orientation ColumnsIEEE Transactions on Neural Networks and Learning Systems10.1109/TNNLS.2013.229317825:7(1346-1358)Online publication date: Jul-2014
https://doi.org/10.1109/TNNLS.2013.2293178
Wei HLi H(2013)Shape Description and Recognition Method Inspired by the Primary Visual CortexCognitive Computation10.1007/s12559-013-9222-36:2(164-174)Online publication date: 12-Jun-2013
https://doi.org/10.1007/s12559-013-9222-3
Rast ANavaridas JJin XGalluppi FPlana LMiguel-Alonso JPatterson CLuján MFurber S(2011)Managing Burstiness and Scalability in Event-Driven Models on the SpiNNaker Neuromimetic SystemInternational Journal of Parallel Programming10.1007/s10766-011-0180-740:6(553-582)Online publication date: 23-Jul-2011
https://doi.org/10.1007/s10766-011-0180-7
Rice KTaha TVutsinas C(2009)Scaling analysis of a neocortex inspired cognitive model on the Cray XD1The Journal of Supercomputing10.1007/s11227-008-0195-z47:1(21-43)Online publication date: 1-Jan-2009
https://dl.acm.org/doi/10.1007/s11227-008-0195-z

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten