ABSTRACT
Experimental evaluation and comparison of techniques, algorithms or complete systems is a crucial requirement to assess the practical impact of research results. The quality of published experimental results is usually limited due to several reasons such as: limited time, unavailability of standard benchmarks or shortage of computing resources. Moreover, achieving an independent, consistent, complete and insightful assessment for different alternatives in the same domain is a time and resource consuming task. We demonstrate Liquid Benchmark as a cloud-based service that provides collaborative platforms to simplify the task of peer researchers in performing high quality experimental evaluations and guarantee a transparent scientific crediting process. The service allows building repositories of competing research implementations, sharing testing computing platforms, collaboratively building the specifications of standard benchmarks and allowing end-users to easily create and run testing experiments and share their results.
- S. Sakr. XML compression techniques: A survey and comparison. J. Comput. Syst. Sci., 75(5):303--322, 2009. Google ScholarDigital Library
- S. Sakr and F. Casati. Liquid Benchmarks: Towards An Online Platform for Collaborative Assessment of Computer Science Research Results. In TPCTC, 2010. Google ScholarDigital Library
- X. Yan, P. Yu, and J. Han. Graph Indexing: A Frequent Structure-based Approach. In SIGMOD, 2004. Google ScholarDigital Library
- S. Zhang, M. Hu, and J. Yang. TreePi: A Novel Graph Indexing Method. In ICDE, 2007.Google ScholarCross Ref
Index Terms
- Liquid benchmarks: benchmarking-as-a-service
Recommendations
Cloud Multi-Tenancy: Issues and Developments
UCC '17 Companion: Companion Proceedings of the10th International Conference on Utility and Cloud ComputingCloud Computing (CC) is a computational paradigm that provides pay-per use services to customers from a pool of networked computing resources that are provided on demand. Customers therefore does not need to worry about infrastructure or storage. Cloud ...
Software engineering for multi-tenancy computing challenges and implications
InnoSWDev 2014: Proceedings of the International Workshop on Innovative Software Development Methodologies and PracticesMulti-tenancy is a cloud computing phenomenon. Multiple instances of an application occupy and share resources from a large pool, allowing different users to have their own version of the same application running and coexisting on the same hardware but ...
Pricing as a Service: Personalized Pricing Strategy in Cloud Computing
CIT '12: Proceedings of the 2012 IEEE 12th International Conference on Computer and Information TechnologyCloud computing is emerging as a model in support of "everything-as-a-service". Virtualized physical resources, virtualized infrastructure, as well as virtualized middleware platforms and business applications are being provided and consumed as services ...
Comments