ABSTRACT
Trusted Execution Environments (TEEs) have enabled building secure systems that operate on untrusted machines. However, TEEs' architecture questions previous performance findings. The existing relational algorithms have been designed for traditional CPUs. Prior work has shown that these algorithms underperform in TEEs and, in most cases, can not be easily reused. Moreover, they frequently used benchmarks pertinent to CPUs and ignored TEE-specific metrics essential to understand the performance differences. Therefore, there is a need for a fair benchmarking approach for TEE algorithms.
In this demonstration, we showcase TeeBench, a unified benchmarking framework for relational operators across TEEs. TeeBench focuses on TEE-specific hardware metrics. It enables a comprehensive performance analysis that helps researchers to evaluate their advances. It comes with an interactive web browser tool that allows the users to upload their implementation of a relational algorithm and seamlessly benchmark it across different TEEs. In addition, it introduces a novel TEE-Analyzer that hints the users about performance bottlenecks and suggests possible code improvements. Users receive instant feedback if changes to their algorithm improve the performance through an interactive, human-friendly web interface. We expect TeeBench to encourage the usage of TEEs and to advance the study of privacy-preserving systems.
Supplemental Material
- 2016. Regulation (EU) 2016/679 of the european parliament and of the council of 27 April 2016. Official Journal of the European Union (2016).Google Scholar
- Panagiotis Antonopoulos, Arvind Arasu, Kunal D Singh, Ken Eguro, Nitish Gupta, Rajat Jain, Raghav Kaushik, Hanuma Kodavalla, Donald Kossmann, Nikolas Ogg, et al. 2020. Azure SQL Database Always Encrypted. In SIGMOD.Google Scholar
- Cagri Balkesen, Jens Teubner, Gustavo Alonso, and M Tamer Özsu. 2013. Main-memory hash joins on multi-core CPUs: Tuning to the underlying hardware. In ICDE.Google Scholar
- Deloitte. 2020. Cloud banking: More than just a CIO conversation. What will financial services of the future look like with cloud? https://www2.deloitte.com/za/en/pages/ financial-services/articles/bank-2030-financial-services-cloud.htmlGoogle Scholar
- European Banking Federation. 2020. The use of Cloud Computing by Financial Institutions. Technical Report. Brussels, BE.Google Scholar
- Github. 2021. Intel Performance Counter Monitor. https://github.com/intel/PCMGoogle Scholar
- Kajetan Maliszewski. 2020. Secure Data Processing at Scale. Proceedings of the VLDB PhD Workshop (2020).Google Scholar
- Kajetan Maliszewski, Jorge-Arnulfo Quiané-Ruiz, Jonas Traub, and Volker Markl. 2021. What is the price for joining securely? benchmarking equi-joins in trusted execution environments. PVLDB (2021).Google Scholar
- Wenting Zheng, Ankur Dave, Jethro G Beekman, Raluca Ada Popa, Joseph E Gonzalez, and Ion Stoica. 2017. Opaque: an oblivious and encrypted distributed analytics platform. In NSDI.Google Scholar
Index Terms
- TeeBench: Seamless Benchmarking in Trusted Execution Environments
Recommendations
Trusted execution environments on mobile devices
CCS '13: Proceedings of the 2013 ACM SIGSAC conference on Computer & communications securityA trusted execution environment (TEE) is a secure processing environment that is isolated from the normal processing environment where the device operating system and applications run. The first mobile phones with hardware-based TEEs appeared almost a ...
TEESec: Pre-Silicon Vulnerability Discovery for Trusted Execution Environments
ISCA '23: Proceedings of the 50th Annual International Symposium on Computer ArchitectureTrusted execution environments (TEE) are CPU hardware extensions that provide security guarantees for applications running on untrusted operating systems. The security of TEEs is threatened by a variety of microarchitectural vulnerabilities, which ...
Benchmarking data warehouses
Database benchmarks can either help users in comparing the performances of different systems, or help engineers in testing the effect of various design choices. In the field of data warehouses, the Transaction Processing Performance Council's standard ...
Comments