skip to main content
10.1145/2463209.2488945acmconferencesArticle/Chapter ViewAbstractPublication PagesdacConference Proceedingsconference-collections
research-article

On robust task-accurate performance estimation

Published: 29 May 2013 Publication History

Abstract

Task-accurate performance estimation methods are widely applied in early design phases to explore different architecture options. These methods rely on accurate annotations generated by software profiling or real measurements to guarantee accurate results. However, in practice, such accurate annotations are not available in early design phases due to lack of source code and hardware platform. Instead, estimated mean or worst-case annotations are usually used, which makes the final result inaccurate because of the errors induced by the estimations, especially for designs with tight time constraints. In this paper, we propose a novel methodology that combines Distributionally Robust Monte Carlo Simulation with task-accurate performance estimation method to guarantee robust system performance estimation in early design phases, i.e., determining the lower bound of the confidence level of fulfilling a specific time constraint. Instead of using accurate annotations, our method only uses estimated annotations in the form of intervals and it does not make any assumptions of the distribution types of these intervals.

References

[1]
B. Barmish and C. Lagoa. The Uniform Distribution: A Rigorous Justification for Its Use in Robustness Analysis. Mathematics of Control, Signals, and Systems (MCSS), 10(3):203--222, 1997.
[2]
P. Bjuréus and A. Jantsch. Performance Analysis with Confidence Intervals for Embedded Software Processes. In Proceedings of the 14th international symposium on Systems synthesis, pages 45--50, 2001.
[3]
P. Eles, K. Kuchcinski, Z. Peng, A. Doboli, and P. Pop. Process Scheduling for Performance Estimation and Synthesis of Hardware/Software Systems. In Euromicro Conference, 1998. Proceedings. 24th, volume 1, pages 168--175. IEEE, 1998.
[4]
P. Giusto, G. Martin, and E. Harcourt. Reliable Estimation of Execution Time of Embedded Software. In DATE, pages 580--589, 2001.
[5]
T. Kempf, M. Doerper, R. Leupers, G. Ascheid, H. Meyr, T. Kogel, and B. Vanthournout. A Modular Simulation Framework for Spatial and Temporal Task Mapping onto Multi-Processor SoC Platforms. In DATE, pages 876--881, 2005.
[6]
C. Lagoa. Contributions to The Theory of Probabilistic Robustness. PhD thesis, University of Wisconsin--Madison, 1998.
[7]
C. Lagoa. Probabilistic Enhancement of Classical Robustness Margins: A Class of Nonsymmetric Distributions. Automatic Control, IEEE Transactions on, 48(11):1990--1994, 2003.
[8]
C. Lagoa and B. Barmish. Distributionally Robust Monte Carlo Simulation: A Tutorial Survey. In Proceedings of the IFAC World Congress, pages 1--12, 2002.
[9]
E. Lee, S. Neuendorffer, and M. Wirthlin. Actor-Oriented Design of Embedded Hardware and Software Systems. Journal of Circuits Systems and Computers, 12(3):231--260, 2003.
[10]
E. A. Lee and S. Neuendorffer. Actor-Oriented Models for Codesign: Balancing Re-Use and Performance. Formal Methods and Models for System Design, pages 33--56, 2004.
[11]
R. Rockafellar. Convex Analysis, volume 28. Princeton University Press, 1996.
[12]
T. Santner, B. Williams, and W. Notz. The Design and Analysis of Computer Experiments. Springer, 2003.
[13]
J. Schnerr, O. Bringmann, A. Viehl, and W. Rosenstiel. High-Performance Timing Simulation of Embedded Software. In DAC, pages 290--295, 2008.
[14]
M. Stein. Large Sample Properties of Simulations Using Latin Hypercube Sampling. Technometrics, 29(2):143--151, 1987.
[15]
M. Streubühr, J. Gladigau, C. Haubelt, and J. Teich. Efficient Approximately-Timed Performance Modeling for Architectural Exploration of MPSoCs. In Advances in Design Methods from Modeling Languages for Embedded Systems and SoC's, volume 63, pages 59--72. 2010.
[16]
W. Wolf. An Architectural Co-Synthesis Algorithm for Distributed, Embedded Computing Systems. TVLSI, 5(2):218--229, 1997.
[17]
L. Xie and A. Davoodi. Robust Estimation of Timing Yield with Partial Statistical Information on Process Variations. TCAD, 27(12):2264--2276, 2008.
[18]
Y. Xu, R. Rosales, B. Wang, M. Streubühr, R. Hasholzner, C. Haubelt, and J. Teich. A Very Fast and Quasi-Accurate Power-State-Based System-Level Power Modeling Methodology. In ARCS'12, pages 37--49. Springer-Verlag.

Cited By

View all
  • (2018)Actor-Oriented Design Patterns for Performance Modeling of Wireless Communications in Cyber-physical SystemsProceedings of the 14th ACM International Symposium on QoS and Security for Wireless and Mobile Networks10.1145/3267129.3267136(29-38)Online publication date: 25-Oct-2018
  • (2016)Performance Estimation of Task Graphs Based on Path ProfilingInternational Journal of Parallel Programming10.1007/s10766-015-0372-744:4(735-771)Online publication date: 1-Aug-2016
  • (2014)FALCONProceedings of the 51st Annual Design Automation Conference10.1145/2593069.2593138(1-6)Online publication date: 1-Jun-2014

Index Terms

  1. On robust task-accurate performance estimation

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    DAC '13: Proceedings of the 50th Annual Design Automation Conference
    May 2013
    1285 pages
    ISBN:9781450320719
    DOI:10.1145/2463209
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    In-Cooperation

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 29 May 2013

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. distributionally robust Monte Carlo simulation
    2. robust performance estimation
    3. task-accurate

    Qualifiers

    • Research-article

    Conference

    DAC '13
    Sponsor:

    Acceptance Rates

    Overall Acceptance Rate 1,770 of 5,499 submissions, 32%

    Upcoming Conference

    DAC '25
    62nd ACM/IEEE Design Automation Conference
    June 22 - 26, 2025
    San Francisco , CA , USA

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)1
    • Downloads (Last 6 weeks)0
    Reflects downloads up to 08 Mar 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2018)Actor-Oriented Design Patterns for Performance Modeling of Wireless Communications in Cyber-physical SystemsProceedings of the 14th ACM International Symposium on QoS and Security for Wireless and Mobile Networks10.1145/3267129.3267136(29-38)Online publication date: 25-Oct-2018
    • (2016)Performance Estimation of Task Graphs Based on Path ProfilingInternational Journal of Parallel Programming10.1007/s10766-015-0372-744:4(735-771)Online publication date: 1-Aug-2016
    • (2014)FALCONProceedings of the 51st Annual Design Automation Conference10.1145/2593069.2593138(1-6)Online publication date: 1-Jun-2014

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media