skip to main content
10.1145/3545801.3545808acmotherconferencesArticle/Chapter ViewAbstractPublication PagesicbdcConference Proceedingsconference-collections
research-article

KARL: A Cost-effective Routing Algorithm in Fault Tolerant 3D Network-on-Chip via K-means Assisted Reinforcement Learning

Authors Info & Claims
Published:09 September 2022Publication History

ABSTRACT

In order to guarantee the communication quality of large-scale multicore processors, 3D Network-on-Chip has become the dominate component for interconnecting various IPs via using 3D stacking technology. A cost-effective routing algorithm KARL is proposed for fault tolerant 3D NoC using K-means to shrink the large Q-table of reinforcement learning with minimal performance loss. The simulation results from gem5 simulator demonstrate that the proposed adaptive routing approach can achieve the average latency 8.26% reduction and successful delivered rate 5.50% improvement over the state of the art on fault tolerant routing algorithms for 3D NoCs. The Q-table can be shrink 70% with less than 10% performance loss.

References

  1. Topol A W, La Tulipe D C, Shi L, Three-dimensional integrated circuits[J]. IBM Journal of Research and Development, 2006, 50(4.5): 491-506.Google ScholarGoogle ScholarCross RefCross Ref
  2. Liu C, Zhang L, Han Y, Vertical interconnects squeezing in symmetric 3D mesh network-on-chip[C]//16th Asia and South Pacific Design Automation Conference (ASP-DAC 2011). IEEE, 2011: 357-362.Google ScholarGoogle Scholar
  3. Feero B S, Pande P P. Networks-on-chip in a three-dimensional environment: A performance evaluation[J]. IEEE Transactions on computers, 2008, 58(1): 32-45.Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Syal N, Sehgal V K. Qualitative Analysis of 3D Routing Algorithms in 3× 3× 3 Mesh NoC Topology Under Varying Load in Bio-SoC[J]. International Journal of E-Health and Medical Communications (IJEHMC), 2020, 11(3): 86-102.Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Khayambashi M, Yaghini P M, Eghbal A, Analytical reliability analysis of 3D NoC under TSV failure[J]. ACM Journal on Emerging Technologies in Computing Systems (JETC), 2015, 11(4): 1-16.Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Eghbal A, Yaghini P M, Bagherzadeh N, Analytical fault tolerance assessment and metrics for TSV-based 3D network-on-chip[J]. IEEE Transactions on computers, 2015, 64(12): 3591-3604.Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Jheng K Y, Chao C H, Wang H Y, Traffic-thermal mutual-coupling co-simulation platform for three-dimensional network-on-chip[C]//Proceedings of 2010 International Symposium on VLSI Design, Automation and Test. IEEE, 2010: 135-138.Google ScholarGoogle Scholar
  8. Salamat R, Khayambashi M, Ebrahimi M, LEAD: An adaptive 3D-NoC routing algorithm with queuing-theory based analytical verification[J]. IEEE Transactions on Computers, 2018, 67(8): 1153-1166.Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Taheri E, Isakov M, Patooghy A, Advertiser elevator: A fault tolerant routing algorithm for partially connected 3D Network-on-Chips[C]//2017 IEEE 60th International Midwest Symposium on Circuits and Systems (MWSCAS). IEEE, 2017: 136-139.Google ScholarGoogle Scholar
  10. Foroutan S, Sheibanyrad A, Petrot F. Assignment of vertical-links to routers in vertically-partially-connected 3-D-NoCs[J]. IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems, 2014, 33(8): 1208-1218.Google ScholarGoogle ScholarCross RefCross Ref
  11. Meyer M C, Wang Y, Watanabe T. Fault-tolerant traffic-aware routing algorithm for 3-D photonic networks-on-chip[C] //2019 IEEE 13th International Symposium on Embedded Multicore/Many-core Systems-on-Chip (MCSoC). IEEE, 2019: 172-179.Google ScholarGoogle Scholar
  12. Ahmed A B, Abdallah A B. Graceful deadlock-free fault-tolerant routing algorithm for 3D Network-on-Chip architectures[J]. Journal of Parallel and Distributed Computing, 2014, 74(4): 2229-2240.Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Ebrahimi M, Daneshtalab M, Plosila J. Fault-tolerant routing algorithm for 3D NoC using hamiltonian path strategy[C]//2013 Design, Automation & Test in Europe Conference & Exhibition (DATE). IEEE, 2013: 1601-1604.Google ScholarGoogle Scholar
  14. Dubois F, Sheibanyrad A, Petrot F, Elevator-first: A deadlock-free distributed routing algorithm for vertically partially connected 3d-nocs[J]. IEEE Transactions on Computers, 2011, 62(3): 609-615.Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Pasricha S, Zou Y. A low overhead fault tolerant routing scheme for 3D networks-on-chip[C]//2011 12th International Symposium on Quality Electronic Design. IEEE, 2011: 1-8.Google ScholarGoogle Scholar
  16. Sinha D, Roy A, Kumar K V, D n-FTR: Fault-tolerant routing algorithm for Mesh based network-on-chip[C]//2018 4th International Conference on Recent Advances in Information Technology (RAIT). IEEE, 2018: 1-5.Google ScholarGoogle Scholar
  17. Jiang X, Zeng L, Watanabe T. A sophisticated routing algorithm in 3d noc with fixed tsvs for low energy and latency[J]. Information and Media Technologies, 2014, 9(4): 404-412.Google ScholarGoogle Scholar
  18. Ying H, Jaiswal A, Hofmann K. Deadlock-free routing algorithms for 3-dimension networks-on-chip with reduced vertical channel density topologies[C]//2012 International Conference on High Performance Computing & Simulation (HPCS). IEEE, 2012: 268-274.Google ScholarGoogle Scholar
  19. Taheri E, Patooghy A, Mohammadi K. Cool elevator: A thermal-aware routing algorithm for partially connected 3d nocs[C]//2016 6th International Conference on Computer and Knowledge Engineering (ICCKE). IEEE, 2016: 111-116.Google ScholarGoogle Scholar
  20. Dang K N, Okuyama Y, Abdallah A B. Soft-Error and Hard-fault Tolerant Architecture and Routing Algorithm for Reliable 3D-NoC Systems[J]. arXiv preprint arXiv:2003.09616, 2020.Google ScholarGoogle Scholar
  21. Kanagasabapathi S, Calicut C. A routing algorithm and a router architecture for 3D NoC[J]. Computer Science, 2019, 20(3).Google ScholarGoogle Scholar
  22. Sutton R S, Barto A G. Reinforcement learning: An introduction[M]. MIT press, 2018.Google ScholarGoogle Scholar
  23. Agarwal N, Krishna T, Peh L S, GARNET: A detailed on-chip network model inside a full-system simulator[C]//2009 IEEE international symposium on performance analysis of systems and software. IEEE, 2009: 33-42.Google ScholarGoogle Scholar

Index Terms

  1. KARL: A Cost-effective Routing Algorithm in Fault Tolerant 3D Network-on-Chip via K-means Assisted Reinforcement Learning

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in
    • Published in

      cover image ACM Other conferences
      ICBDC '22: Proceedings of the 7th International Conference on Big Data and Computing
      May 2022
      143 pages
      ISBN:9781450396097
      DOI:10.1145/3545801

      Copyright © 2022 ACM

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 9 September 2022

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • research-article
      • Research
      • Refereed limited
    • Article Metrics

      • Downloads (Last 12 months)23
      • Downloads (Last 6 weeks)3

      Other Metrics

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    HTML Format

    View this article in HTML Format .

    View HTML Format