Abstract
In order to increase throughput, more and more blockchains begin to provide the ability to execute smart contract transactions in parallel. However, there is currently no research work on evaluating parallel execution schemes in different blockchains, which makes it difficult for developers to find a blockchain technology suitable for their application scenarios. In this paper, we firstly summarize existing parallel execution schemes of smart contract transactions. Then, based on their characteristics, we propose a comprehensive evaluation framework for parallel execution schemes of smart contract transactions and implement a benchmark tool, which can compare different parallel execution schemes and discover their limitations. Finally, we utilize the evaluation framework and the tool to evaluate several excellent blockchains in China and obtain some useful findings.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Nakamoto, S.: Bitcoin: A peer-to-peer electronic cash system. Decentral. Bus. Rev. 21260 (2008)
Ethereum. https://www.ethereum.org/zh/. Accessed 15 Sept 2021
Yao, Q., Zhang, DW.: Survey on identity management in blockchain. J. Softw. (2021)
Pîrlea, G., Kumar, A., Sergey, I.: Practical smart contract sharding with ownership and commutativity analysis. In: Proceedings of the 42nd ACM SIGPLAN International Conference on Programming Language Design and Implementation, pp. 1327–1341 (2021)
Meneghetti, A., Parise, T., Sala, M., Taufer, D.: A survey on efficient parallelization of blockchain-based smart contracts. Ann. Emerg. Technol. Comput. (AETiC) (2019). Print ISSN 2516-0281
Shihab, Shahriar, Hazari, Qusay, H., Mahmoud.: A parallel proof of work to improve transaction speed and scalability in blockchain systems. In: 2019 IEEE 9th Annual Computing and Communication Workshop and Conference (CCWC), IEEE (2019)
Shevkar, R.: Performance-based analysis of blockchain scalability metric. Tehnički glasnik 15(1), 133–142 (2021)
Qin, C., Guo, B., Shen, Y., Li, T., Zhang, Y., Zhang, Z.: A secure and effective construction scheme for blockchain networks. Secur. Commun. Networks (2020)
FISCO BCOS. https://fisco-bcos-documentation.readthedocs.io. Accessed 15 Sept 2021/
ChainMaker. https://docs.chainmaker.org.cn/index.html. Accessed 15 Sept 2021
Lian, Y., Tsai, W. T., Li, G., Yao, Y., Deng, E.: Smart-contract execution with concurrent block building. In: 2017 IEEE Symposium on Service-Oriented System Engineering (SOSE), IEEE, pp. 160–167 (2017)
Wang, G., Shi, Z. J., Nixon, M., Han, S.: Sok: Sharding on blockchain. In: Proceedings of the 1st ACM Conference on Advances in Financial Technologies, pp. 41–6 (2019)
Yu, G., Wang, X., Yu, K., Ni, W., Liu, R.P.: Survey: sharding in blockchains. In: IEEE Access, vol. 1–1 pp. 99, (2020)
Hyperledger Caliper. https://github.com/hyperledger/caliper. Accessed 15 Sept 2021
Wang, R., Ye, K., Meng, T., Xu, C.Z.: Performance evaluation on blockchain systems: a case study on Ethereum, Fabric, Sawtooth and Fisco-Bcos. In: International Conference on Services Computing, pp. 120–134, Springer, Cham. https://doi.org/10.1007/978-3-030-59592-0_8
Hyperledger Fabric. https://github.com/hyperledger/fabric. Accessed 15 Sept 2021
Xbench. https://github.com/xuperchain/xbench. Accessed 15 Sept 2021
XuperChain. https://xuper.baidu.com/n/xuperdoc/index.htm. Accessed 9 Sept 2021
FISCO BCOS’s stress test program. https://github.com/FISCO-BCOS/java-sdk-demo. Accessed 15 Sept 2021
Truffle. https://www.trufflesuite.com/docs/truffle/testing/testing-your-contracts. Accessed 15 Sept 2021
Dinh, T., Wang, J., Chen, G., Liu, R., Ooi, B. C., Tan, K. L.: Blockbench: a framework for analyzing private blockchains. In: Proceedings of the 2017 ACM International Conference on Management of Data, pp. 1085–1100 (2017)
Anjana, P.S., A Tt Iya, H., Kumari, S., Peri, S., Somani, A.: Efficient concurrent execution of smart contracts in blockchains using object-based transactional memory. In: International Conference on Networked Systems, pp. 77–93. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-67087-0_6
Anjana, P.S., Kumari, S., Peri, S., Rathor, S., Somani, A.: Optsmart: a space efficient optimistic concurrent execution of smart contracts. arXiv preprint arXiv:2102.04875 (2021)
Amiri, M.J., Agrawal, D., Abbadi, A.E.: ParBlockchain: Leveraging transaction parallelism in permissioned blockchain systems. In: 2019 IEEE 39th International Conference on Distributed Computing Systems (ICDCS), IEEE, pp. 1337–1347 (2019)
Yu, W., Luo, K., Ding, Y., You, G., Hu, K.: A parallel smart contract model. In: Proceedings of the 2018 International Conference on Machine Learning and Machine Intelligence, pp. 72–77 (2018)
Dickerson, T., Gazzillo, P., Herlihy, M., Koskinen, E.: Adding concurrency to smart contracts. Distrib. Comput. 33(3–4), 209–225 (2019). https://doi.org/10.1007/s00446-019-00357-z
Kuzlu, M., Pipattanasomporn, M., Gurses, L., Rahman, S.: Performance analysis of a hyperledger fabric blockchain framework: throughput, latency and scalability. In: 2019 IEEE International Conference on Blockchain (Blockchain), pp. 536–540, IEEE (2019)
Ruan, P., Loghin, D., Ta, Q.T., Zhang, M., Chen, G., Ooi, B.C.: A transactional perspective on execute-order-validate blockchains. In: Proceedings of the 2020 ACM SIGMOD International Conference on Management of Data, pp. 543–557 (2020)
Sharma, A., Schuhknecht, F.M., Agrawal, D., Dittrich, J.: Blurring the lines between blockchains and database systems: the case of hyperledger fabric. In: Proceedings of the 2019 International Conference on Management of Data, pp. 105–122 (2019)
Dong, Z., Zheng, E., Choon, Y., Zomaya, A.Y.: Dagbench: A performance evaluation framework for DAG distributed ledgers. In: 2019 IEEE 12th International Conference on Cloud Computing (CLOUD), IEEE, pp. 264–271 (2019)
Alsunaidi, S.J., Alhaidari, F.A.: A survey of consensus algorithms for blockchain technology. In: 2019 International Conference on Computer and Information Sciences (ICCIS), IEEE, pp. 1–6 (2019)
Bamakan, S.M.H., Motavali, A., Bondarti, A.B.: A survey of blockchain consensus algorithms performance evaluation criteria. Exp. Syst. Appl. 154, 113385
Dabbagh, M., Choo, K.K.R., Beheshti, A., Tahir, M., Safa, N.S.: A survey of empirical performance evaluation of permissioned blockchain platforms: Challenges and opportunities. Comput. Security 100, 102078
Zhou, Q., Huang, H., Zheng, Z., Bian, J.: Solutions to scalability of blockchain: a survey. IEEE Access 8, 16440–16455 (2020)
Acknowledgements
Thanks to the developers of XuperChain, FISCO BCOS and ChainMaker for their selfless guidance and help, as well as their open source communities. This work is supported by National Key Research and Development Program of China (Grant No. 2018YFB1402803) and National Natural Science Foundation of China (Grant No. 61872344, 61972386).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 Springer Nature Switzerland AG
About this paper
Cite this paper
Shi, J. et al. (2022). Evaluating the Parallel Execution Schemes of Smart Contract Transactions in Different Blockchains: An Empirical Study. In: Lai, Y., Wang, T., Jiang, M., Xu, G., Liang, W., Castiglione, A. (eds) Algorithms and Architectures for Parallel Processing. ICA3PP 2021. Lecture Notes in Computer Science(), vol 13157. Springer, Cham. https://doi.org/10.1007/978-3-030-95391-1_3
Download citation
DOI: https://doi.org/10.1007/978-3-030-95391-1_3
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-95390-4
Online ISBN: 978-3-030-95391-1
eBook Packages: Computer ScienceComputer Science (R0)