Abstract
Complex Event processing (CEP) has emerged over the last ten years. CEP systems are outstanding in processing large amount of data and responding in a timely fashion. While CEP applications are fast growing, performance management in this area has not gain much attention. It is critical to meet the promised level of service for both system designers and users. In this paper, we present a benchmark for complex event processing systems: CEPBen. The CEPBen benchmark is designed to evaluate CEP functional behaviours, i.e., filtering, transformation and event pattern detection and provides a novel methodology of evaluating the performance of CEP systems. A performance study by running the CEPBen on Esper CEP engine is described and discussed. The results obtained from performance tests demonstrate the influences of CEP functional behaviours on the system performance.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Esper performance (2007), http://docs.codehaus.org/
Oracle complex event processing performance (November 2008), http://www.oracle.com/
Oracle complex event processing exalogic performance study - an oracle white paper (2011), http://www.oracle.com/
Arasu, A., Cherniack, M., Galvez, E., Maier, D., Maskey, A., Ryvkina, E., Stonebraker, M., Tibbetts, R.: Linear road: A stream data management benchmark. In: VLDB Conference (September 2004)
Bizarro, P.: Bicep - benchmarking complex event processing systems. In: Chandy, M., Etzion, O., von Ammon, R. (eds.) Event Processing, Dagstuhl, Germany. Dagstuhl Seminar Proceedings, number 07191, Internationales Begegnungs- und Forschungszentrum für Informatik (IBFI), Schloss Dagstuhl, Germany (2007)
Carey, M.J., DeWitt, D.J., Naughton, J.F.: The 007 benchmark. SIGMOD Rec. 22(2), 12–21 (1993)
Carey, M.J., DeWitt, D.J., Kant, C., Naughton, J.F.: A status report on the oo7 oodbms benchmarking effort. In: OOPSLA 1994: Proceedings of the Ninth Annual Conference on Object-Oriented Programming Systems, Language, and Applications, pp. 414–426. ACM, New York (1994)
Chandy, M.K., Etzion, O., Ammon, von Ammon, R.: 10201 executive summary and manifesto–event processing. Event Processing (10201) (2011)
EsperTech Inc. Esper Reference, version 4.9.0 edition (2012)
Etzion, O., Niblett, P.: Event Processing in Action. Manning Publication Co., Stamford (2011)
Geppert, A., Gatziu, S., Dittrich, K.R.: A designer’s benchmark for active database management systems: 007 meets the beast. In: Sellis, T.K. (ed.) RIDS 1995. LNCS, vol. 985, pp. 309–326. Springer, Heidelberg (1995)
Grabs, T., Lu, M.: Measuring performance of complex event processing systems, pp. 83–96 (2012)
Isoyama, K., Kobayashi, Y., Sato, T., Kida, K., Yoshida, M., Tagato, H.: A scalable complex event processing system and evaluations of its performance, pp. 123–126 (2012)
Kounev, S., Bacon, J., Sachs, K., Buchmann, A.: A methodology for performance modeling of distributed event-based systems. In: 11th IEEE Symposium on Object Oriented Real-Time Distributed Computing (ISORC) (2008)
Lakshmanan, G.T., Rabinovich, Y.G., Etzion, O.: A stratified approach for supporting high throughput event processing applications. In: DEBS 2009: Proceedings of the Third ACM International Conference on Distributed Event-Based Systems, pp. 1–12. ACM, New York (2009)
Luckham, D.C.: Event Processing for Business: Organizing the Real Time Enterprise. John Wiley & Sons (2011)
Mendes, M.R.N., Bizarro, P., Marques, P.: A performance study of event processing systems. In: Nambiar, R., Poess, M. (eds.) TPCTC 2009. LNCS, vol. 5895, pp. 221–236. Springer, Heidelberg (2009)
Schmidt, A.R., Waas, F., Kersten, M.L., Florescu, D., Manolescu, I., Carey, M.J., Busse, R.: The xml benchmark project. Technical report, Amsterdam, The Netherlands (2001)
Tibbetts, R.: Performance & scalability characterization., http://www.streambase.com
Wu, E., Diao, Y., Rizvi, S.: High-performance complex event processing over streams, pp. 407–418 (2006)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this paper
Cite this paper
Li, C., Berry, R. (2014). CEPBen: A Benchmark for Complex Event Processing Systems. In: Nambiar, R., Poess, M. (eds) Performance Characterization and Benchmarking. TPCTC 2013. Lecture Notes in Computer Science, vol 8391. Springer, Cham. https://doi.org/10.1007/978-3-319-04936-6_9
Download citation
DOI: https://doi.org/10.1007/978-3-319-04936-6_9
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-04935-9
Online ISBN: 978-3-319-04936-6
eBook Packages: Computer ScienceComputer Science (R0)