research-article

Let there be light!: the future of memory systems is photonics and 3D stacking

Authors:

Gilbert Hendry,

K. Scott Hemmert,

Arun Rodrigues,

David ResnickAuthors Info & Claims

MSPC '11: Proceedings of the 2011 ACM SIGPLAN Workshop on Memory Systems Performance and Correctness

Pages 43 - 48

https://doi.org/10.1145/1988915.1988926

Published: 05 June 2011 Publication History

Abstract

Energy consumption is the fundamental barrier to exascale supercomputing and it is dominated by the cost of moving data from one point to another, not computation. Similarly, performance is dominated by data movement, not computation. The solution to this problem requires three critical technologies: 3D integration, optical chip-to-chip communication, and a new communication model. A memory system based on these technologies has the potential to lower the cost of local memory accesses by orders of magnitude and provide substantially more bandwidth. To reach the goals of exascale computing with a manageable power budget, the industry will have to adopt these technologies. Doing so will enable exascale computing, and will have a major worldwide economic impact.

References

[1]

A. Alduino et al. Demonstration of a high speed 4-channel integrated silicon photonics WDM link with hybrid silicon lasers. In Proceedings of Hot Chips, Aug. 2010.

[2]

V. R. Almeida, R. R. Panepucci, and M. Lipson. Nanotaper for compact mode conversion. Optics Letters, 28(15):1302--1304, August 2003.

[3]

P. Cheben and et al. A high-resolution silicon-on-insulator arrayed waveguide grating microspectrometer with submicrometer aperture waveguides. Opt. Express, 15(5): 2299--2306, Mar 2007. URL http://www.opticsexpress.org/abstract.cfm?URI=oe-15-5-2299.

[4]

X. Dong and Y. Xie. System-level cost analysis and design exploration for three-dimensional integrated circuits (3d ics). In Proceedings of the 2009 Asia and South Pacific Design Automation Conference, ASP-DAC '09, pages 234--241, Piscataway, NJ, USA, 2009. IEEE Press. ISBN 978-1-4244-2748-2. URL http://portal.acm.org/citation.cfm?id=1509633.1509700.

Digital Library

[5]

Energy Information Administration. Commercial buildings energy consumption survey. Technical report, Department of Energy, 2007.

[6]

Energy Information Administration. Electric power monthly. Technical report, Department of Energy, March 2011. URL http://www.eia.doe.gov/cneaf/electricity/epm/.

[7]

Energy Information Administration. Annual energy review 2007. Technical Report DOE/EIA-0384(2007), Department of Energy, 2007.

[8]

Energy Information Administration. U. s. household electricity report. Technical report, Department of Energy, July 2005. URL http://www.eia.doe.gov/emeu/reps/enduse/er01_us.html.

[9]

ENERGY STAR Program. Report to congress on server and data center energy efficiency public law 109--431. Technical report, Environmental Protection Agency, August 2007. URL http://www.energystar.gov/ia/partners/prod_development/downloads/EPA_Datacenter_Report_Congress Final1.pdf.

[10]

ITRS Committee. International Technology Roadmap for Semiconductors 2008 Update, 2008. http://www.itrs.net/Links/2008ITRS/Home2008.htm.

[11]

D. Jensen and A. Rodrigues. Embedded systems and exascale computing. Computing in Science And Engineering, 2010. Accepted for Publication.

Digital Library

[12]

B. Koch, A. Fang, R. Jones, O. Cohen, M. Paniccia, D. Blumenthal, and J. Bowers. Silicon evanescent optical frequency comb generator. In Group IV Photonics, 2008 5th IEEE International Conference on, pages 64--66, Sept 2008.

[13]

P. M. e. Kogge. ExaScale Computing Study: Technology Challenges in Achieving Exascale Systems. Technical report, University of Notre Dame CSE Department Technical Report, TR-2008-13, September 28, 2008.

[14]

L. Liao, D. Samara-Rubio, M. Morse, A. Liu, D. Hodge, D. Rubin, U. Keil, and T. Franck. High speed silicon mach-zehnder modulator. Opt. Express, 13(8):3129--3135, Apr 2005. URL http://www.opticsexpress.org/abstract.cfm?URI=oe-13-8-3129.

[15]

I. K. LLC. Ic cost model 0909b. Software, November 2009.

[16]

S. A. McKee. Reflections on the memory wall. In CF '04: Proceedings of the 1st conference on Computing frontiers, page 162, New York, NY, USA, 2004. ACM. ISBN 1-58113-741-9.

Digital Library

[17]

R. C. Murphy, A. Rodrigues, P. Kogge, and K. Underwood. The implications of working set analysis on supercomputing memory hierarchy design. In The 2005 International Conference on Supercomputing, June 20--22, 2005.

Digital Library

[18]

N. Ophir et al. First demonstration of error-free operation of a full silicon on-chip photonic link. In OFC, Mar. 2011.

[19]

K. Pedretti, C. Vaughan, K. S. Hemmert, and B. Barrett. Application sensitivity to link and injection bandwidth on a cray xt4 system. In Proceedings of the 2008 Cray User Group Annual Technical Conference, May 2008.

[20]

A. Rodrigues. Dusty Decks, Memory Walls, and the Speed of Light. PhD thesis, University of Notre Dame, 2006.

Digital Library

[21]

Samsung. Samsung develops industry's first ddr4 dram, using 30nm class technology. News Release, January 2011. URL http://www.samsung.com/us/business/semi-conductor/newsView.do?news_id=1202.

[22]

H. D. Thacker and others. Flip-chip integrated silicon photonic bridge chips for sub-picojoule per bit optical links. In Electronic Components and Technology Conference (ECTC), 2010 Proceedings 60th, pages 240--246, June 2010.

[23]

F. Xia, L. Sekaric, and Y. Vlasov. Ultracompact optical buffers on a silicon chip. Nature Photonics, 1:65--71, Jan. 2007.

Cited By

Nguyen TMacLean CSiracusa MDoerfler DWright NWilliams S(2021)FPGA‐based HPC accelerators: An evaluation on performance and energy efficiencyConcurrency and Computation: Practice and Experience10.1002/cpe.657034:20Online publication date: 22-Aug-2021
https://doi.org/10.1002/cpe.6570
Nguyen TWilliams SSiracusa MMacLean CDoerfler DWright N(2020)The Performance and Energy Efficiency Potential of FPGAs in Scientific Computing2020 IEEE/ACM Performance Modeling, Benchmarking and Simulation of High Performance Computer Systems (PMBS)10.1109/PMBS51919.2020.00007(8-19)Online publication date: Nov-2020
https://doi.org/10.1109/PMBS51919.2020.00007
Tang YWang YLi HLi X(2017)ApproxPIM: Exploiting realistic 3D-stacked DRAM for energy-efficient processing in-memory2017 22nd Asia and South Pacific Design Automation Conference (ASP-DAC)10.1109/ASPDAC.2017.7858355(396-401)Online publication date: Jan-2017
https://doi.org/10.1109/ASPDAC.2017.7858355
Show More Cited By

Index Terms

Let there be light!: the future of memory systems is photonics and 3D stacking
1. Hardware
  1. Integrated circuits
    1. Semiconductor memory

Recommendations

Optically connected memory for disaggregated data centers
Highlights
- Optical memory disaggregation for data centers achieves low energy-per-bit consumption.
- Main memory disaggregation using state-of-the-art optical devices.
- First evaluation of both energy-per-bit and system-level performance for ...
Abstract
Recent advances in integrated photonics enable the implementation of reconfigurable, high-bandwidth, and low energy-per-bit interconnects in next-generation data centers. We propose and evaluate an Optically Connected Memory (OCM) architecture ...
Design-Induced Latency Variation in Modern DRAM Chips: Characterization, Analysis, and Latency Reduction Mechanisms
Performance evaluation review

Variation has been shown to exist across the cells within a modern DRAM chip. Prior work has studied and exploited several forms of variation, such as manufacturing-process- or temperature-induced variation. We empirically demonstrate a new form of ...
Design-Induced Latency Variation in Modern DRAM Chips: Characterization, Analysis, and Latency Reduction Mechanisms
SIGMETRICS '17 Abstracts: Proceedings of the 2017 ACM SIGMETRICS / International Conference on Measurement and Modeling of Computer Systems

Variation has been shown to exist across the cells within a modern DRAM chip. Prior work has studied and exploited several forms of variation, such as manufacturing-process- or temperature-induced variation. We empirically demonstrate a new form of ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

MSPC '11: Proceedings of the 2011 ACM SIGPLAN Workshop on Memory Systems Performance and Correctness

June 2011

74 pages

ISBN:9781450307949

DOI:10.1145/1988915

General Chair:
Jeffrey Vetter
Oak Ridge National Lab and Georgia Institute of Technology
,
Program Chairs:
Madanlal Musuvathi
Microsoft Research
,
Xipeng Shen
College of William & Mary

Copyright © 2011 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGPLAN: ACM Special Interest Group on Programming Languages

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 05 June 2011

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Advanced Scientific Computing Research

Conference

PLDI '11

Sponsor:

SIGPLAN

PLDI '11: ACM SIGPLAN Conference on Programming Language Design and Implementation

June 5, 2011

California, San Jose

Acceptance Rates

Overall Acceptance Rate 6 of 20 submissions, 30%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

7
Total Citations
View Citations
247
Total Downloads

Downloads (Last 12 months)4
Downloads (Last 6 weeks)0

Reflects downloads up to 27 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Nguyen TMacLean CSiracusa MDoerfler DWright NWilliams S(2021)FPGA‐based HPC accelerators: An evaluation on performance and energy efficiencyConcurrency and Computation: Practice and Experience10.1002/cpe.657034:20Online publication date: 22-Aug-2021
https://doi.org/10.1002/cpe.6570
Nguyen TWilliams SSiracusa MMacLean CDoerfler DWright N(2020)The Performance and Energy Efficiency Potential of FPGAs in Scientific Computing2020 IEEE/ACM Performance Modeling, Benchmarking and Simulation of High Performance Computer Systems (PMBS)10.1109/PMBS51919.2020.00007(8-19)Online publication date: Nov-2020
https://doi.org/10.1109/PMBS51919.2020.00007
Tang YWang YLi HLi X(2017)ApproxPIM: Exploiting realistic 3D-stacked DRAM for energy-efficient processing in-memory2017 22nd Asia and South Pacific Design Automation Conference (ASP-DAC)10.1109/ASPDAC.2017.7858355(396-401)Online publication date: Jan-2017
https://doi.org/10.1109/ASPDAC.2017.7858355
Rumley SBahadori MPolster RHammond SCalhoun DWen KRodrigues ABergman K(2017)Optical interconnects for extreme scale computing systemsParallel Computing10.1016/j.parco.2017.02.00164:C(65-80)Online publication date: 1-May-2017
https://dl.acm.org/doi/10.1016/j.parco.2017.02.001
Calhoun DLi QNikolova DChen CWen KRumley SBergman K(2016)Hardware–Software Integrated Silicon Photonics for Computing SystemsSilicon Photonics III10.1007/978-3-642-10503-6_5(157-189)Online publication date: 9-Jan-2016
https://doi.org/10.1007/978-3-642-10503-6_5
Dosanjh SBarrett RDoerfler DHammond SHemmert KHeroux MLin PPedretti KRodrigues ATrucano TLuitjens J(2014)Exascale design space exploration and co-designFuture Generation Computer Systems10.5555/2747903.274819730:C(46-58)Online publication date: 1-Jan-2014
https://dl.acm.org/doi/10.5555/2747903.2748197
Guo ZFox GZhou MRuan Y(2012)Improving Resource Utilization in MapReduceProceedings of the 2012 IEEE International Conference on Cluster Computing10.1109/CLUSTER.2012.69(402-410)Online publication date: 24-Sep-2012
https://dl.acm.org/doi/10.1109/CLUSTER.2012.69

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten