Beiye Liu
ABSTRACT
The increasing gap between the high data processing capability of modern computing systems and the limited memory bandwidth motivated the recent significant research on neuromorphic computing systems (NCS), which are inspired from the working mechanism of human brains. Discovery of memristor further accelerates engineering realization of NCS by leveraging the similarity between synaptic connections in neural networks and programming weight of the memristor. However, to achieve a stable large-scale NCS for practical applications, many essential EDA design challenges still need to be overcome especially the state-of-the-art memristor crossbar structure is adopted. In this paper, we summarize some of our recent published works about enhancing the design robustness and efficiency of memristor crossbar based NCS. The experiments show that the impacts of noises generated by process variations and the IR-drop over the crossbar can be effectively suppressed by our noise-eliminating training method and IR-drop compensation technique. Moreover, our network clustering techniques can alleviate the challenges of limited crossbar scale and routing congestion in NCS implementations.
- D. Ciresan, U. Meier, and J. Schmidhuber, "Multi-column deep neural networks for image classification," CVPR, pp. 3642--3649, 2012. Google Scholar
Digital Library
- "IEEE Standard for Information technology - Telecommunications and information exchange between systems Local and metropolitan area networks - Specific requirements Part 11: Wireless LAN Medium Access Control (MAC) and Physical Layer (PHY) Specifications," IEEE Std 802.11-2012, pp. 1--2793, 2012.Google Scholar
- U. Von Luxburg, "A tutorial on spectral clustering," Statistics and computing, vol. 17, pp. 395--416, 2007. Google ScholarDigital Library
- Golub, G. H. and Reinsch, C., "Singular value decomposition and least squares solutions," Numerische Mathematik, 1970. Google ScholarDigital Library
- B. Liu, et al., "Reduction and IR-drop compensations techniques for reliable neuromorphic computing systems," ICCAD, pp. 63--70, 2014. Google ScholarDigital Library
- B. Liu, et al., "Digital-assisted noise-eliminating training for memristor crossbar-based analog neuromorphic computing engine," DAC, pp. 1--6, 2013. Google ScholarDigital Library
- M. Sharad, D. Fan, and K. Roy, "Ultra low power associative computing with spin neurons and resistive crossbar memory," DAC, pp. 1--6, 2013. Google ScholarDigital Library
- M. Hu, et al, "Hardware realization of BSB recall function using memristor crossbar arrays," DAC, pp. 498--503, 2012. Google ScholarDigital Library
- P. F. López, et al, "A Computational Study of the Diffuse Neighbourhoods in Biological and Artificial Neural Networks," IJCCI, pp. 490--495, 2009.Google Scholar
- Miao Hu, et al, "BSB training scheme implementation on memristor-based circuit," CISDA, 2013.Google Scholar
- J. Liang and H. S. Wong, "Cross-point memory array without cell selectors - device characteristics and data storage pattern dependencies," IEEE Transactions on Electron Devices, vol. 57, pp. 2531--2538, 2010.Google ScholarCross Ref
- S. R. Lee, et al., "Multi-level switching of triple-layered TaOx RRAM with excellent reliability for storage class memory," VLSIT, pp. 71--72, 2012.Google Scholar
- J. J. Hopfield, "Neural networks and physical systems with emergent collective computational abilities", Proceedings of the National Academy of Sciences of the USA, 1982.Google ScholarCross Ref
- A. Asenov, S. Kaya, and A. R. Brown, "Intrinsic parameter fluctuations in decananometer MOSFETs introduced by gate line edge roughness," Electron Devices, IEEE Transactions on, vol. 50, pp. 1254--1260, 2003.Google ScholarCross Ref
- X. Dong, et al, "Circuit and microarchitecture evaluation of 3D stacking magnetic RAM (MRAM) as a universal memory replacement," DAC, pp. 554--559, 2008. Google ScholarDigital Library
- D. Niu, Y. Chen, C. Xu, and Y. Xie, "Impact of process variations on emerging memristor," DAC, pp. 877--882, 2010. Google ScholarDigital Library
- S. A. McKee, "Reflections on the memory wall," the 1st con-ference on Computing frontiers, p. 162, 2004. Google ScholarDigital Library
Index Terms
- EDA Challenges for Memristor-Crossbar based Neuromorphic Computing
Recommendations
An EDA framework for large scale hybrid neuromorphic computing systems
DAC '15: Proceedings of the 52nd Annual Design Automation ConferenceIn implementations of neuromorphic computing systems (NCS), memristor and its crossbar topology have been widely used to realize fully connected neural networks. However, many neural networks utilized in real applications often have a sparse ...
Effects of Noise on Leaky Integrate-and-Fire Neuron Models for Neuromorphic Computing Applications
Computational Science and Its Applications – ICCSA 2022AbstractArtificial neural networks (ANNs) have been extensively used for the description of problems arising from biological systems and for constructing neuromorphic computing models. The third generation of ANNs, namely, spiking neural networks (SNNs), ...
Memristive Crossbar Mapping for Neuromorphic Computing Systems on 3D IC
GLSVLSI '18: Proceedings of the 2018 on Great Lakes Symposium on VLSIIn recent years, neuromorphic computing systems based on memristive crossbar have provided a promising solution to enable acceleration of neural networks. Meanwhile, most of the neural networks used in realistic applications are often sparse. If such ...
Comments