research-article

A reuse-aware prefetching scheme for scratchpad memory

Authors:

Yi ZouAuthors Info & Claims

DAC '11: Proceedings of the 48th Design Automation Conference

Pages 960 - 965

https://doi.org/10.1145/2024724.2024937

Published: 05 June 2011 Publication History

Abstract

Scratchpad memory (SPM) has been utilized as prefetch buffer in embedded systems and parallel architectures to hide memory access latency. However, the impact of reuse pattern on SPM prefetching has not been fully investigated. In this paper we quantify the impact of reuse on SPM prefetching efficiency and propose a reuse-aware SPM prefetching (RASP) scheme. The average performance and energy improvements are 15.9% and 22.0% over cache prefetching, 12.9% and 31.2% over prefetch-only SPM management, 18.5% and 10% over DRDU [1] with SPM prefetching support.

References

[1]

I. Issenin, E. Brockmeyer, M. Miranda, and N. Dutt, "DRDU: A Data Reuse Analysis Technique for Efficient Scratch-Pad Memory Management," in ACM Trans. Des. Autom. Electron. Syst., 2007.

Digital Library

[2]

T. Chen, T. Zhang, Z. Sura, and M. Tallada, "Prefetching Irregular References for Software Cache on Cell," in Proc. CGO, 2008, pp. 155--164.

Digital Library

[3]

R. Banakar, S. Steinke, B. Lee, M. Balakrishnan, and P. Marwedel, "Scratchpad Memory: A Design Alternative for Cache On-chip Memory in Embedded Systems," in Proc. CODES, 2002, pp. 73--78.

Digital Library

[4]

J. Sjodin and C. Platen, "Storage Allocation for Embedded Processors," in Proc. CASES, 2001, pp. 15--23.

Digital Library

[5]

O. Avissar, R. Barua, and D. Stewart, "An Optimal Memory Allocation Scheme for Scratchpad-based Embedded Systems," in ACM TRANS. Embed. Comput. Syst., 2002, pp. 6--26.

Digital Library

[6]

M. Verma, S. Steinke, and P. Marwedel, "Data Partitioning for Maximal Scratchpad Usage," in Proc. ASPDAC, 2003, pp. 77--83.

Digital Library

[7]

M. Kandemir, J. Ramanujam, J. Irwin, N. Vijaykrishnan, I. Kadayif, and A. Parikh, "Dynamic Management of Scratchpad Memory Space," in Proc. DAC, 2001, pp. 690--695.

Digital Library

[8]

S. Udayakumaran and R. Barua, "Compiler-decided Dynamic Memory Allocation for Scratchpad Based Embedded Systems," in Proc. CASES, 2003, pp. 276--286.

Digital Library

[9]

L. Li, H. Feng, and J. Xue, "Compiler-directed Scratchpad Memory Management via Graph Coloring," in ACM Trans. Archit. Code Optim., 2009, pp. 1--17.

Digital Library

[10]

T. Yemliha, S. Srikantaiah, M. Kandemir, and O. Ozturk, "SPM Management Using Markov Chain Based Data Access Prediction," in Proc. ICCAD, 2008, pp. 565--569.

Digital Library

[11]

A. Beric, R. Sethuraman, H. Peters, G. Veldman, J. Meerbergen, and G. Haan, "Streaming Scratchpad Memory Organization for Video Applications," in Proc. Circuits, Signals and Systems, 2004, pp. 427--432.

[12]

T. Mowry, M. Lam, and A. Gupta, "Design and Evaluation of a Compiler Algorithm for Prefetching," in Proc. ASPLOS, 1992, pp. 62--73.

Digital Library

[13]

S. Vanderwiel and D. Lilja, "Data Prefetch Mechanisms," in ACM Computing Surveys, 2000, pp. 174--199.

Digital Library

[14]

R. M. Rabbah, H. Sandanagobalane, M. Ekapanyapong, and W. Wong, "Compiler Orchestrated Prefetching via Speculation and Predication," in Proc. ASPLOS, 2004, pp. 189--198.

Digital Library

[15]

T. C. Mowry, "Tolerating latency through software-controlled data prefetching," Ph.D. dissertation, Stanford University, 1994.

Digital Library

[16]

K. Kennedy and J. Allen, Optimizing Compilers for Modern Architectures: A Dependence-based Approach. Morgan Kaufmann Publishers Inc., 2002.

Digital Library

[17]

ITK Software Guide, http://www.itk.org/ItkSoftwareGuide.pdf.

[18]

M. Baskaran, U. Bondhugula, S. Krishnamoorthy, J. Ramanujam, A. Bountev, and P. Sadayappan, "Automatic Data Movement and Computation Mapping for Multi-level Parallel Architectures with Explicitly Managed Memories," in Proc. PPoPP, 2008, pp. 1--10.

Digital Library

[19]

M. Kandemir and A. Choudhary, "Compiler-Directed Scratchpad Memory Hierarchy Design and Management," in Proc. DAC, 2002, pp. 628--633.

Digital Library

[20]

P. Magnusson, M. Christensson, J. Eskilson, D. Forsgren, G. Hallberg, J. Hogberg, F. Larsson, A. Moestedt, and B. Werner, "Simics: A full system simulation platform," in IEEE Computer, 2002, pp. 50--58.

Digital Library

[21]

M. Martin, D. Sorin, B. Beckmann, M. Marty, M. Xu, A. Alameldeen, K. Moore, M. Hill, and D. Wood, "Multifacet's general execution-driven multiprocessor simulator(GEMS) toolset," in Computer Architecture News, 2005, pp. 92--99.

Digital Library

[22]

Omega Library, http://www.cs.umd.edu/projects/omega.

[23]

S. Li, J. Ahn, R. Strong, J. Brockman, D. Tullsen, and N. Jouppi, "McPAT: An Integrated Power, Area, and Timing Modeling Framework for Multi-core and Many-core Architectures," in Proc. MICRO, 2009, pp. 469--480.

Digital Library

[24]

Sun Microsystems, "UltraSPARC-II Enhancements: Support for Software Controlled Prefetch," White Paper, 1997.

[25]

B. Egger, S. Kim, C. Jang, J. Lee, S. L. Min, and H. Shin, "Scratchpad Memory Management Techniques for Code in Embedded Systems without an MMU," in IEEE Trans. on Computers, vol. 59, no. 8, 2010, pp. 1047--1062.

Digital Library

Cited By

Cobos MAhrens JKowalczyk KPolitis A(2022)An overview of machine learning and other data-based methods for spatial audio capture, processing, and reproductionEURASIP Journal on Audio, Speech, and Music Processing10.1186/s13636-022-00242-x2022:1Online publication date: 16-May-2022
https://dl.acm.org/doi/10.1186/s13636-022-00242-x
Liu SWeng JKupsh DSohrabizadeh AWang ZGuo LLiu JZhulin MMani RZhang LCong JNowatzki T(2022)OverGen: Improving FPGA Usability through Domain-specific Overlay Generation2022 55th IEEE/ACM International Symposium on Microarchitecture (MICRO)10.1109/MICRO56248.2022.00018(35-56)Online publication date: Oct-2022
https://doi.org/10.1109/MICRO56248.2022.00018
Jung JPark DDo YPark JLee JGupta RShen X(2020)Overlapping host-to-device copy and computation using hidden unified memoryProceedings of the 25th ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming10.1145/3332466.3374531(321-335)Online publication date: 19-Feb-2020
https://dl.acm.org/doi/10.1145/3332466.3374531
Show More Cited By

Index Terms

A reuse-aware prefetching scheme for scratchpad memory
1. Hardware
  1. Integrated circuits
    1. Semiconductor memory
      1. Dynamic memory

Recommendations

Compiler-directed scratchpad memory management via graph coloring

Scratchpad memory (SPM), a fast on-chip SRAM managed by software, is widely used in embedded systems. This article introduces a general-purpose compiler approach, called memory coloring, to assign static data aggregates, such as arrays and structs, in a ...
SA-SPM: an efficient compiler for security aware scratchpad memory (invited paper)
LCTES 2019: Proceedings of the 20th ACM SIGPLAN/SIGBED International Conference on Languages, Compilers, and Tools for Embedded Systems

Scratchpad memories (SPM) are often used to boost the performance of application-specific embedded systems. In embedded systems, main memories are vulnerable to external attacks such as bus snooping or memory extraction. Therefore it is desirable to ...
Dynamic data scratchpad memory management for a memory subsystem with an MMU
LCTES '07: Proceedings of the 2007 ACM SIGPLAN/SIGBED conference on Languages, compilers, and tools for embedded systems

In this paper, we propose a dynamic scratchpad memory (SPM)management technique for a horizontally-partitioned memory subsystem with an MMU. The memory subsystem consists of a relatively cheap direct-mapped data cache and SPM. Our technique loads ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

DAC '11: Proceedings of the 48th Design Automation Conference

June 2011

1055 pages

ISBN:9781450306362

DOI:10.1145/2024724

General Chair:
Leon Stok
IBM Corp., Hopewell Jct., NY
,
Program Chairs:
Nikil Dutt
Univ. of California, Irvine, CA
,
Soha Hassoun
Tufts Univ., Medford, MA

Copyright © 2011 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

EDAC: Electronic Design Automation Consortium
SIGDA: ACM Special Interest Group on Design Automation
IEEE Council on Electronic Design Automation (CEDA)

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 05 June 2011

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Division of Computing and Communication Foundations

Conference

DAC '11

Sponsor:

EDAC
SIGDA

DAC '11: The 48th Annual Design Automation Conference 2011

June 5 - 10, 2011

California, San Diego

Acceptance Rates

Overall Acceptance Rate 1,770 of 5,499 submissions, 32%

Upcoming Conference

DAC '25

Sponsor:
sigda

62nd ACM/IEEE Design Automation Conference

June 22 - 26, 2025

San Francisco , CA , USA

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

29
Total Citations
View Citations
286
Total Downloads

Downloads (Last 12 months)8
Downloads (Last 6 weeks)1

Reflects downloads up to 27 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Cobos MAhrens JKowalczyk KPolitis A(2022)An overview of machine learning and other data-based methods for spatial audio capture, processing, and reproductionEURASIP Journal on Audio, Speech, and Music Processing10.1186/s13636-022-00242-x2022:1Online publication date: 16-May-2022
https://dl.acm.org/doi/10.1186/s13636-022-00242-x
Liu SWeng JKupsh DSohrabizadeh AWang ZGuo LLiu JZhulin MMani RZhang LCong JNowatzki T(2022)OverGen: Improving FPGA Usability through Domain-specific Overlay Generation2022 55th IEEE/ACM International Symposium on Microarchitecture (MICRO)10.1109/MICRO56248.2022.00018(35-56)Online publication date: Oct-2022
https://doi.org/10.1109/MICRO56248.2022.00018
Jung JPark DDo YPark JLee JGupta RShen X(2020)Overlapping host-to-device copy and computation using hidden unified memoryProceedings of the 25th ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming10.1145/3332466.3374531(321-335)Online publication date: 19-Feb-2020
https://dl.acm.org/doi/10.1145/3332466.3374531
Kim HHong SPark JHan H(2019)Static code transformations for thread‐dense memory accesses in GPU computingConcurrency and Computation: Practice and Experience10.1002/cpe.551232:5Online publication date: 18-Oct-2019
https://doi.org/10.1002/cpe.5512
Shoushtari MDonyanavard BBathen LDutt N(2018)ShaVe-ICEACM Transactions on Embedded Computing Systems10.1145/315766717:2(1-25)Online publication date: 5-Feb-2018
https://dl.acm.org/doi/10.1145/3157667
Su JYang FZeng XZhou DChen J(2017)Efficient Memory Partitioning for Parallel Data Access in FPGA via Data ReuseIEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems10.1109/TCAD.2017.264883836:10(1674-1687)Online publication date: Oct-2017
https://doi.org/10.1109/TCAD.2017.2648838
Qamar AMuslim FGregoretti FLavagno LLazarescu M(2017)High-Level Synthesis for Semi-Global Matching: Is the Juice Worth the Squeeze?IEEE Access10.1109/ACCESS.2016.26353785(8419-8432)Online publication date: 2017
https://doi.org/10.1109/ACCESS.2016.2635378
Shen DLiu XLin F(2016)Characterizing emerging heterogeneous memoryACM SIGPLAN Notices10.1145/3241624.292670251:11(13-23)Online publication date: 14-Jun-2016
https://dl.acm.org/doi/10.1145/3241624.2926702
Chakraborty PPanda PSen S(2016)Partitioning and Data Mapping in Reconfigurable Cache and Scratchpad Memory--Based ArchitecturesACM Transactions on Design Automation of Electronic Systems10.1145/293468022:1(1-25)Online publication date: 2-Sep-2016
https://dl.acm.org/doi/10.1145/2934680
Shen DLiu XLin FFlood CZhang Z(2016)Characterizing emerging heterogeneous memoryProceedings of the 2016 ACM SIGPLAN International Symposium on Memory Management10.1145/2926697.2926702(13-23)Online publication date: 14-Jun-2016
https://dl.acm.org/doi/10.1145/2926697.2926702
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten