ABSTRACT
Blockchain is a highly popular paradigm for non-centralized applications, especially in finance and trade. Performance is a major challenge for blockchains, since consensus approaches are known not to scale. In this presentation we address blockchain performance, from the perspective of model-based prediction as well as benchmark-based assessment. We present research results about smart contracts in the Ethereum blockchain and discuss the requirements for generic benchmarks for blockchain performance. Benchmarking is a common approach to compare industry-class systems. As blockchain technologies mature, the role of reliable benchmarks will become increasingly important. However, definitions of benchmarks for blockchains are still in their infancy. We argue that there is a clear need for benchmarks, and that benchmarks should be based on the sound scientific principles of metrology [1]. A variety of important performance issues should be addressed, including the performance of the proof (be it work, stake, or other), transaction processing and block creation. Moreover, in all these situations, establishing energy consumption benchmarks is critical in determining if incentives are in place for miners to operate the blockchain system. A particularly interesting element in some blockchains is the mechanism of smart contracts. For instance, in Ethereum, the fees associated with executing contracts depend on the benchmarked performance of the operation code. In [2] it was demonstrated that uncertainty with respect to the correctness of the anticipated execution time impacts the decisions miners will take. We will discuss improved benchmarking approaches for operational code.
- A. Bondavalli, A. Ceccarelli, L. Falai and M. Vadursi, Foundations of Metrology in the Observation of Critical Systems, Chapter 10 in Resilience Assessment and Evaluation of Computing Systems, Springer Verlag, 2012.Google Scholar
- M. Alharby and A. van Moorsel, The Impact of Profit Uncertainty on Miner Decisions in Blockchain Systems, UK Performance Engineering Workshop, 2018Google Scholar
Index Terms
- Benchmarks and Models for Blockchain
Recommendations
Towards a Blockchain Deployment at UAE University: Performance Evaluation and Blockchain Taxonomy
ICBCT 2019: Proceedings of the 2019 International Conference on Blockchain TechnologyBlockchain technology initially developed for transactions on cryptocurrencies is now gaining popularity in major domains such as education, healthcare, media, government, smart computing, and business enterprise. Blockchain manages the transactions ...
An End-to-End Performance Comparison of Seven Permissioned Blockchain Systems
Middleware '23: Proceedings of the 24th International Middleware ConferenceThe emergence of numerous blockchain solutions, offering innovative approaches to optimise performance, scalability, privacy, and governance, complicates performance analysis. Reasons for the difficulty of benchmarking blockchains include, for example, ...
The DaCapo benchmarks: java benchmarking development and analysis
OOPSLA '06: Proceedings of the 21st annual ACM SIGPLAN conference on Object-oriented programming systems, languages, and applicationsSince benchmarks drive computer science research and industry product development, which ones we use and how we evaluate them are key questions for the community. Despite complex runtime tradeoffs due to dynamic compilation and garbage collection ...
Comments