A Tool of Benchmarking Realtime Analysis for Massive Behavior Data

Abstract

With the increasing development of platforms for massive users, the amount of data generated from these platforms is rapidly increasing. A large number of big data analysis frameworks have been designed to analyze data generated from these platforms. This however requires a specific benchmark to evaluate the system performance. Today, realtime analysis (or streaming analysis) becomes a hot research topic of big data research. However, there is no special benchmark designed for such streaming analysis systems. This paper introduces a tool for evaluating the performance of such streaming analysis systems. Based on the scenario of e-commerce platforms, the benchmark tool is designed using a data generator with certain user models based on the user’s habits in e-commerce platforms. A test suite is developed to be responsible for simulated mixed workloads for streaming analysis.