skip to main content
10.1145/1837274.1837491acmconferencesArticle/Chapter ViewAbstractPublication PagesdacConference Proceedingsconference-collections
research-article

Stochastic computation

Published: 13 June 2010 Publication History

Abstract

Stochastic computation, as presented in this paper, exploits the statistical nature of application-level performance metrics, and matches it to the statistical attributes of the underlying device and circuit fabrics. Nanoscale circuit fabrics are viewed as noisy communication channels/networks. Communications-inspired design techniques based on estimation and detection theory are proposed. Stochastic computation advocates an explicit characterization and exploitation of error statistics at the architectural and system levels. This paper traces the roots of stochastic computing from the Von Neumann era into its current form. Design and CAD challenges are described.

References

[1]
S. Borkar, T. Karnik, S. Narendra, J. Tschanz, A. Keshavarazi, and V. De, "Parameter variations and impact on circuits and microarchitecture," in Proc. of DAC., June 2003, pp. 338--342.
[2]
Intl. technology roadmap for semiconductors 2008 update. ITRS. {Online}. Available: http://www.itrs.net/Links/2008ITRS/Home2008.htm
[3]
J. Rabaey, D. Burke, K. Lutz, and J. Wawrzynek, "Workloads of the future," IEEE Design and Test of Computers, vol. 25, no. 4, pp. 358--365, July/August 2008.
[4]
H. Poor, An Introduction to Signal Detection and Estimation. New York, NY: Springer-Verlag, 1994.
[5]
R. Hegde and N. R. Shanbhag, "Soft digital signal processing," IEEE Trans. VLSI Syst., vol. 9, no. 6, pp. 813--823, Dec. 2001.
[6]
G. V. Varatkar and N. R. Shanbhag, "Error-resilient motion estimation architecture," IEEE Trans. VLSI Syst., vol. 16, no. 10, pp. 1399--1412, Oct. 2008.
[7]
R. Abdallah and N. Shanbhag, "Error-resilient low-power viterbi decoder architectures," IEEE Trans. Signal Process., vol. 57, no. 12, pp. 4906--4917, Dec. 2009.
[8]
G. V. Varatkar, S. Narayanan, N. R. Shanbhag, and D. Jones, "Sensor network-on-chip," in 2007 Intl. Symp. on System-on-Chip, Nov. 2007, pp. 1--4.
[9]
J. Von Neumann, "Probabilistic logics and the synthesis of reliable organisms from unreliable components," Automata Studies, pp. 43--98, 1956.
[10]
N. Pippenger, "Reliable computation by formulas in the presence of noise," IEEE Trans. Info. Th., vol. 34, no. 2, pp. 194--197, March 1988.
[11]
T. Feder, "Reliable computation by networks in the presence of noise," IEEE Transaction Information Theory, vol. 35, no. 3, pp. 569--572, May 1989.
[12]
W. Evans and L. Schulman, "Signal propagation, with application to a lower bound on the depth of noisy formulas," in Proc. of Annual Symp. on Foundations of Computer Science, 1993, pp. 594--603.
[13]
B. Hajek and T. Weller, "On the maximum tolerable noise for reliable computation by formulas," IEEE Transaction Information Theory, vol. 37, no. 2, pp. 388--391, March 1991.
[14]
J. Cortese and R. Goodman, "A statistical analysis of neural computation," in IEEE Int. Symp on Information Theory, July 1994, p. 215.
[15]
K. Nepal, R. Bahar, J. Mundy, W. Patterson, and A. Zaslavsky, "Designing logic circuits for probabilistic computation in the presence of noise," in Design Automation Conf., June 2005, pp. 486--490.
[16]
W. Qian and M. Riedel, "The synthesis of robust polynomial arithmetic with stochastic logic," in Proc. of Design Automation Conf., Jun 2008, pp. 648--653.
[17]
N. Vaidya and D. Pradhan, "Fault-tolerant design strategies for high reliability and safety," IEEE Trans. Comput., vol. 42, no. 10, pp. 1195--1206, Oct. 1993.
[18]
Y. Tamir, M. Tremblay, and D. Rennels, "The implementation and application of micro rollback in fault-tolerant VLSI systems," in Proc. of IEEE FTC, 1988, pp. 234--239.
[19]
S. J. Piestrak, "Design of fast self-testing checkers for a class of berger codes," IEEE Trans. Comput., vol. 36, no. 5, pp. 629--634, 1987.
[20]
D. Ernst et al., "Razor: A low-power pipeline based on circuit-level timing speculation," in Proc. 36th IEEE/ACM Intl. Symp. on Microarchitecture, Dec. 2003, pp. 7--18.
[21]
S. Winograd and J. D. Cowan, Reliable Computation in the Presence of Noise. Cambridge, MA: MIT Press, 1963.
[22]
B. Shim, S. Sridhara, and N. R. Shanbhag, "Reliable low-power digital signal processing via reduced precision redundancy," IEEE Trans. VLSI Syst., vol. 12, no. 5, pp. 497--510, May 2004.
[23]
L. Wang and N. R. Shanbhag, "Low-power filtering via adaptive error-cancellation," IEEE Trans. VLSI Syst., vol. 51, no. 2, pp. 575--583, Feb. 2003.
[24]
R. Hegde and N. R. Shanbhag, "A voltage overscaled low-power digital filter IC," IEEE J. Solid-State Circuits, vol. 39, no. 2, pp. 388--391, Feb. 2004.
[25]
P. Huber, Robust Statistics. New York, NY: Wiley, 1981.
[26]
W.-H. Chen, C. Smith, and S. Fralick, "A fast computational algorithm for the discrete cosine transform," IEEE Trans. Commun., vol. 25, no. 9, pp. 1004--1009, Sep. 1977.
[27]
J. Rabaey, A. Chandrakasan, and B. Nikolic, Digital Integrated Circuits, 2nd ed. Upper Saddle River, NJ: Prentice Hall, 2002.
[28]
E. P. Kim, R. A. Abdallah, and N. R. Shanbhag, "Soft NMR: Exploiting statistics for energy-efficiency," in 2009 Intl. Symp. on System-on-Chip (SOC), Oct. 2009, pp. 52--55.
[29]
A. Kahng, S. Kang, R. Kumar, and J. Sartori, "Designing processors from the ground up to allow voltage/reliability tradeoffs," in Proc. 16th HPCA, Jan. 2010.
[30]
L. Leem, H. Cho, J. Bau, Q. Jacobson, and S. Mitra, "Error-resilient system architecture for probabilistic applications," in IEEE/ACM DATE, Mar. 2010.
[31]
A. Kahng, S. Kang, R. Kumar, and J. Sartori, "Recovery-driven design: A methodology for power minimization for error tolerant processor modules," in 47th DAC, Anaheim, June 2010, Jun. 2010.

Cited By

View all
  • (2023)Survey of Novel Architectures for Energy Efficient High-Performance Mobile Computing PlatformsEnergies10.3390/en1616604316:16(6043)Online publication date: 18-Aug-2023
  • (2023)Computing mathematical functions with chemical reactions via stochastic logicPLOS ONE10.1371/journal.pone.028157418:5(e0281574)Online publication date: 8-May-2023
  • (2021)Memristive combinational logic circuits and stochastic computing implementation schemeCircuit World10.1108/CW-09-2018-007248:3(354-365)Online publication date: 8-Jun-2021
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
DAC '10: Proceedings of the 47th Design Automation Conference
June 2010
1036 pages
ISBN:9781450300025
DOI:10.1145/1837274
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 13 June 2010

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. algorithmic noise-tolerance
  2. energy-efficiency
  3. error-resiliency
  4. reliability
  5. soft processing
  6. stochastic computation

Qualifiers

  • Research-article

Conference

DAC '10
Sponsor:

Acceptance Rates

Overall Acceptance Rate 1,770 of 5,499 submissions, 32%

Upcoming Conference

DAC '25
62nd ACM/IEEE Design Automation Conference
June 22 - 26, 2025
San Francisco , CA , USA

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)39
  • Downloads (Last 6 weeks)6
Reflects downloads up to 21 Jan 2025

Other Metrics

Citations

Cited By

View all
  • (2023)Survey of Novel Architectures for Energy Efficient High-Performance Mobile Computing PlatformsEnergies10.3390/en1616604316:16(6043)Online publication date: 18-Aug-2023
  • (2023)Computing mathematical functions with chemical reactions via stochastic logicPLOS ONE10.1371/journal.pone.028157418:5(e0281574)Online publication date: 8-May-2023
  • (2021)Memristive combinational logic circuits and stochastic computing implementation schemeCircuit World10.1108/CW-09-2018-007248:3(354-365)Online publication date: 8-Jun-2021
  • (2021)Theory and experimental verification of configurable computing with stochastic memristorsScientific Reports10.1038/s41598-021-83382-y11:1Online publication date: 18-Feb-2021
  • (2020)Deep In-Memory Architectures in SRAM: An Analog Approach to Approximate ComputingProceedings of the IEEE10.1109/JPROC.2020.3034117108:12(2251-2275)Online publication date: Dec-2020
  • (2019)Fully Synthesizable Low-Area Digital-to-Analog Converter With Graceful Degradation and Dynamic Power-Resolution ScalingIEEE Transactions on Circuits and Systems I: Regular Papers10.1109/TCSI.2019.290346466:8(2865-2875)Online publication date: Aug-2019
  • (2019)Error-Resilient Spintronics via the Shannon- Inspired Model of ComputationIEEE Journal on Exploratory Solid-State Computational Devices and Circuits10.1109/JXCDC.2019.29099125:1(10-18)Online publication date: Jun-2019
  • (2019)A Time-Domain Computing Accelerated Image Recognition Processor With Efficient Time Encoding and Non-Linear Logic OperationIEEE Journal of Solid-State Circuits10.1109/JSSC.2018.288339454:11(3226-3237)Online publication date: Nov-2019
  • (2019)Shannon-Inspired Statistical Computing for the Nanoscale EraProceedings of the IEEE10.1109/JPROC.2018.2869867107:1(90-107)Online publication date: Jan-2019
  • (2019)The Good, the Bad, Algorithmic Noise Tolerance (Ant), the UglyICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)10.1109/ICASSP.2019.8683247(5366-5370)Online publication date: May-2019
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media