skip to main content
10.1145/3531437.3539703acmconferencesArticle/Chapter ViewAbstractPublication PagesislpedConference Proceedingsconference-collections
poster

Canopy: A CNFET-based Process Variation Aware Systolic DNN Accelerator

Published: 01 August 2022 Publication History

Abstract

Although systolic accelerators have become the dominant method for executing Deep Neural Networks (DNNs), their performance efficiency (quantified as Energy-Delay Product or EDP) is limited by the capabilities of silicon Field-Effect Transistors (FETs). FETs constructed from Carbon Nanotubes (CNTs) have demonstrated > 10 × EDP benefits, however, the processing variations inherent in carbon nanotube FETs (CNFETs) fabrication compromise the EDP benefits, resulting > 40% performance degradation. In this work, we study the impact of CNT process variations and present Canopy, a process variation aware systolic DNN accelerator by leveraging the spatial correlation in CNT variations. Canopy co-optimizes the architecture and dataflow to allow computing engines in a systolic array run at their best performance with non-uniform latency, minimizing the performance degradation incurred by CNT variations. Furthermore, we devise Canopy with dynamic reconfigurability such that the microarchitectural capability and its associated flexibility achieves an extra degree of adaptability with regard to the DNN topology and processing hyper-parameters (e.g., batch size). Experimental results show that Canopy improves the performance by 5.85 × (4.66 ×) and reduces the energy by 34% (90%) when inferencing a single (a batch of) input compared to the baseline design under an iso-area comparison across seven DNN workloads.

References

[1]
Mohamed M Sabry Aly 2018. The N3XT Approach to Energy-Efficient Abundant-Data Computing. In Proceedings of the IEEE.
[2]
A. G. Amer, R. Ho, G. Hills, A. P. Chandrakasan, and M. M. Shulaker. 2019. SHARC: Self-Healing Analog with RRAM and CNFETs. In ISSCC.
[3]
S. Banerjee 2020. Analysis of the Impact of Process Variations and Manufacturing Defects on the Performance of Carbon-Nanotube FETs. IEEE TVLSIS (2020).
[4]
Qing Cao 2013. Arrays of Sngle-Walled Carbon Nanotubes with Full Surface Coverage for High-Performance Electronics. In Nature Nanotechnology.
[5]
Jie Deng 2006. A Circuit-Compatible SPICE Model for Enhancement Mode Carbon Nanotube Field Effect Transistors. In SISPAD.
[6]
Jie Deng and H-S Philip Wong. 2007. A compact SPICE model for carbon-nanotube field-effect transistors including nonidealities and its application—Part II: Full device model and circuit performance benchmarking. IEEE T-ED (2007).
[7]
Samuel J. Engers 2022. MOCCA: A Process Variation Tolerant Systolic DNN Accelerator Using CNFETs in Monolithic 3D. In GLSVLSI.
[8]
Aaron D Franklin 2012. Sub-10 nm carbon nanotube transistor. Nano letters (2012).
[9]
Gage Hills. 2015. Variation-Aware Nanosystem Design Kit (NDK). https://nanohub.org/resources/22582
[10]
Gage Hills 2015. Rapid Co-Optimization of Processing and Circuit Design to Overcome Carbon Nanotube Variations. IEEE TCAD (2015).
[11]
Gage Hills 2018. TRIG: Hardware Accelerator for Inference-based Applications and Experimental Demonstration using Carbon Nanotube FETs. In DAC.
[12]
Li Jiang 2018. CNFET-Based High Throughput SIMD Architecture. TCAD (2018).
[13]
Norman P. Jouppi 2017. In-Datacenter Performance Analysis of a Tensor Processing Unit. In ISCA.
[14]
Tianjian Li 2016. CNFET-based high throughput register file architecture. In ICCD.
[15]
O’Connor 2017. Fine-Grained DRAM: Energy-Efficient DRAM for Extreme Bandwidth Systems. In MICRO.
[16]
Nishant Patil 2007. Automated Design of Misaligned-Carbon-Nanotube-Immune Circuits. In DAC.
[17]
Ananda Samajdar 2018. SCALE-Sim: Systolic CNN Accelerator Simulator. arXiv e-prints (2018).
[18]
M. M. Shulaker 2014. Monolithic 3D Integration of Logic and Memory: Carbon Nanotube FETs, Resistive RAM, and Silicon FETs. In IEDM.
[19]
Fabian Teichert 2017. Electronic Transport in Metallic Carbon Nanotubes with Mixed Defects within the Strong Localization Regime. Computational Materials Science(2017).
[20]
H-SP Wong 2003. Carbon Nanotube Field Effect Transistors-Fabrication, Device Physics, and Circuit Implications. In ISSCC.
[21]
Damien Woods. 2012. Photonic neural networks. In Nature Physics.
[22]
Choongho Yu 2005. Thermal Conductance and Thermopower of an Individual Single-Wall Carbon Nanotube. Nano Letters (2005).
[23]
Guangyu Zhang 2006. Selective Etching of Metallic Carbon Nanotubes by Gas-Phase Reaction. Science (2006).
[24]
Jie Zhang 2009. Carbon Nanotube Circuits in the Presence of Carbon Nanotube Density Variations. In DAC.
[25]
Jie Zhang 2009. Probabilistic Analysis and Design of Metallic-Carbon-Nanotube-Tolerant Digital Logic Circuits. TCAD (2009).
[26]
Jie Zhang 2010. Carbon Nanotube Correlation: Promising Opportunity for CNFET Circuit Yield Enhancement. In DAC.

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
ISLPED '22: Proceedings of the ACM/IEEE International Symposium on Low Power Electronics and Design
August 2022
192 pages
ISBN:9781450393546
DOI:10.1145/3531437
Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 August 2022

Check for updates

Qualifiers

  • Poster
  • Research
  • Refereed limited

Conference

ISLPED '22
Sponsor:

Acceptance Rates

Overall Acceptance Rate 398 of 1,159 submissions, 34%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • 0
    Total Citations
  • 128
    Total Downloads
  • Downloads (Last 12 months)30
  • Downloads (Last 6 weeks)1
Reflects downloads up to 15 Feb 2025

Other Metrics

Citations

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media