abstract

Open Source In-Memory Data Grid Systems: Benchmarking Hazelcast and Infinispan

Authors:

Adel TaweelAuthors Info & Claims

ICPE '17: Proceedings of the 8th ACM/SPEC on International Conference on Performance Engineering

Pages 163 - 164

https://doi.org/10.1145/3030207.3053671

Published: 17 April 2017 Publication History

Abstract

Distributed cache systems are used to store and retrieve frequently used data for faster access by exploiting the memory of more than one machine, but they appear as one logical big cache. In this paper, we studied the performance of two popular open source distributed cache systems (Hazelcast and Infinispan) indifferently. The conducted performance analysis shows that Infinispan outperforms Hazelcast in the simple data retrieval scenarios as well as most of SQL-like queries scenarios, whereas Hazelcast outperforms Infinispan in SQL-like queries for small data sizes.

References

[1]

From cache to in-memory data grid. introduction to hazelcast. http://www.slideshare.net/tmatyashovsky/from-cache-to-in-memory-data-grid-introduction-to-hazelcast. Accessed on: 28/05/2016.

[2]

Gridgain vs. hazelcast benchmarks. http://go.gridgain.com/Benchmark_GridGain_vs_Hazelcast.html. Accessed on: 28/05/2016.

[3]

Gridgain/apache ignite vs hazelcast benchmark. https://hazelcast.com/resources/benchmark-gridgain/. Accessed on: 28/05/2016.

[4]

Hazelcast documentation. http://docs.hazelcast.org/docs/3.6/manual/html-single/index.html#distributed-query. Accessed on: 28/05/2016.

[5]

Ignite vs. hazelcast benchmarks. http://www.gridgain.com/resources/benchmarks/ignite-vs-hazelcast-benchmarks/. Accessed on: 28/05/2016.

[6]

Infinispan. http://www.aosabook.org/en/posa/infinispan.html#fn10. Accessed on: 25/06/2016.

[7]

Infinispan documentation. http://infinispan.org/docs/8.2.x/index.html. Accessed on: 01/05/2016.

[8]

Infinispan vs hazelcast performance blog. http://blog.infinispan.org/2013/05/infinispan-vs-hazelcast-performance.html. Accessed on: 28/05/2016.

[9]

Jboss marshalling project. http://jbossmarshalling.jboss.org/. Accessed on: 25/06/2016.

[10]

Jmh - java microbenchmark harness. http://tutorials.jenkov.com/java-performance/jmh.html. Accessed on: 28/05/2016.

[11]

Map vs hazelcast vs infinispan comparison. https://bitbucket.org/ssmoot/scala-map-benchmarks/src. Accessed on: 28/05/2016.

[12]

Radargun documentation. https://github.com/radargun/radargun/wiki. Accessed on: 28/05/2016.

[13]

Radargun documentation. https://github.com/radargun/radargun/wiki. Accessed on: 28/05/2016.

[14]

Red hat infinispan vs hazelcast benchmark. https://hazelcast.com/resources/benchmark-infinispan/. Accessed on: 28/05/2016.

[15]

Redis 3.0.7 vs hazelcast 3.6 benchmark. https://hazelcast.com/resources/benchmark-redis-vs-hazelcast/. Accessed on: 28/05/2016.

[16]

Yahoo! cloud serving benchmark. https://github.com/brianfrankcooper/YCSB/wiki. Accessed on: 28/05/2016.

[17]

Yardstick - benchmarking framework. https://github.com/yardstick-benchmarks/yardstick. Accessed on: 28/05/2016.

[18]

Yardstick gridgain benchmarks. https://github.com/gridgain/yardstick-gridgain. Accessed on: 28/05/2016.

[19]

Yardstick hazelcast benchmarks. https://github.com/gridgain/yardstick-hazelcast. Accessed on: 28/05/2016.

[20]

Yardstick infinispan benchmarks. https://github.com/yardstick-benchmarks/yardstick-infinispan. Accessed on: 28/05/2016.

[21]

X. Chen, C. P. Ho, R. Osman, P. G. Harrison, and W. J. Knottenbelt. Understanding, modelling, and improving the performance of web applications in multicore virtualised environments. In Proceedings of the 5th ACM/SPEC international conference on Performance engineering, pages 197--207. ACM, 2014.

Digital Library

[22]

B. F. Cooper, A. Silberstein, E. Tam, R. Ramakrishnan, and R. Sears. Benchmarking cloud serving systems with ycsb. In Proceedings of the 1st ACM symposium on Cloud computing, pages 143--154. ACM, 2010.

Digital Library

[23]

A. Das, F. Mueller, X. Gu, and A. Iyengar. Performance analysis of a multi-tenant in-memory data grid.

[24]

G. Denaro, A. Polini, and W. Emmerich. Early performance testing of distributed software applications. In Proceedings of ACM SIGSOFT Software Engineering Notes, volume 29, pages 94--103. ACM, 2004.

Digital Library

[25]

A. Dey, A. Fekete, R. Nambiar, and U. Röhm. Ycsb

[26]

t: Benchmarking web-scale transactional databases. In Proceedings of Data Engineering Workshops (ICDEW), 2014 IEEE 30th International Conference on, pages 223--230. IEEE, 2014.

[27]

C. Engelbert. White paper: Caching strategies. Technical report, Hazelcast Company.

[28]

B. Evans. White paper: An architect's view of hazelcast. Technical report, Hazelcast Company.

[29]

H. Khazaei, J. Misic, and V. B. Misic. Performance analysis of cloud computing centers using m/g/m/m

[30]

r queuing systems. IEEE Transactions on parallel and distributed systems, 23(5):936--943, 2012.

[31]

M. Klems and H. Anh Lê. Position paper: cloud system deployment and performance evaluation tools for distributed databases. In Proceedings of the 2013 international workshop on Hot topics in cloud services, pages 63--70. ACM, 2013.

Digital Library

[32]

Q. Wang, L. Cherkasova, J. Li, and H. Volos. Interconnect emulator for aiding performance analysis of distributed memory applications. In Proceedings of the 7th ACM/SPEC on International Conference on Performance Engineering, pages 75--83. ACM, 2016.

Digital Library

[33]

S. v. Wouw, J. Vi\ na, A. Iosup, and D. Epema. An empirical performance evaluation of distributed sql query engines. In Proceedings of the 6th ACM/SPEC International Conference on Performance Engineering, pages 123--131. ACM, 2015.

Digital Library

Cited By

Guroob A(2023)EA2-IMDG: Efficient Approach of Using an In-Memory Data Grid to Improve the Performance of Replication and Scheduling in Grid Environment SystemsComputation10.3390/computation1103006511:3(65)Online publication date: 20-Mar-2023
https://doi.org/10.3390/computation11030065
Gorsky SEdelev AFeoktistov A(2022)Data Processing in Problem-Solving of Energy System Vulnerability Based on In-memory Data GridMathematics and its Applications in New Computer Systems10.1007/978-3-030-97020-8_25(271-279)Online publication date: 26-Apr-2022
https://doi.org/10.1007/978-3-030-97020-8_25
Lefort APipereau YAmponsem KSutra PThomas G(2021)J-NVMProceedings of the ACM SIGOPS 28th Symposium on Operating Systems Principles10.1145/3477132.3483579(408-423)Online publication date: 26-Oct-2021
https://dl.acm.org/doi/10.1145/3477132.3483579
Show More Cited By

Index Terms

Open Source In-Memory Data Grid Systems: Benchmarking Hazelcast and Infinispan

Recommendations

Constructing a data accessing layer for in-memory data grid
Internetware '12: Proceedings of the Fourth Asia-Pacific Symposium on Internetware

In-memory data grid (IMDG) is a novel data processing middleware for Internetware. It provides higher scalability and performance compared with traditional rational database. However, because the data stored in IMDG must follow the key/value data model, ...
Data Analysis with Open Source Tools
Performance Comparison of Real-time Spatial Data Processing: A Pivot on In-Memory Data Grid (IMDG) Technology
BigDAS '15: Proceedings of the 2015 International Conference on Big Data Applications and Services

The dramatic development of IT technology has increased absolute amount of data to store, analyze, and process for computers and it has also rapidly increased the amount of realtime processing for data stream which contains various information with the ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

ICPE '17: Proceedings of the 8th ACM/SPEC on International Conference on Performance Engineering

April 2017

450 pages

ISBN:9781450344043

DOI:10.1145/3030207

General Chairs:
Walter Binder
Università della Svizzera Italiana, Switzerland
,
Vittorio Cortellessa
Università dell'Aquila, Italy
,
Program Chairs:
Anne Koziolek
Karlsruhe Institute of Technology, Germany
,
Evgenia Smirni
College of William & Mary, USA
,
Meikel Poess
Oracle Corporation, USA

Copyright © 2017 Owner/Author.

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

SIGMETRICS: ACM Special Interest Group on Measurement and Evaluation
SIGSOFT: ACM Special Interest Group on Software Engineering
SPEC: SPEC Research Group

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 17 April 2017

Check for updates

Author Tags

Qualifiers

Abstract

Conference

ICPE '17

Sponsor:

ICPE '17: ACM/SPEC International Conference on Performance Engineering

April 22 - 26, 2017

L'Aquila, Italy

Acceptance Rates

ICPE '17 Paper Acceptance Rate 27 of 83 submissions, 33%;

Overall Acceptance Rate 252 of 851 submissions, 30%

Upcoming Conference

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

5
Total Citations
View Citations
219
Total Downloads

Downloads (Last 12 months)10
Downloads (Last 6 weeks)4

Reflects downloads up to 08 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Guroob A(2023)EA2-IMDG: Efficient Approach of Using an In-Memory Data Grid to Improve the Performance of Replication and Scheduling in Grid Environment SystemsComputation10.3390/computation1103006511:3(65)Online publication date: 20-Mar-2023
https://doi.org/10.3390/computation11030065
Gorsky SEdelev AFeoktistov A(2022)Data Processing in Problem-Solving of Energy System Vulnerability Based on In-memory Data GridMathematics and its Applications in New Computer Systems10.1007/978-3-030-97020-8_25(271-279)Online publication date: 26-Apr-2022
https://doi.org/10.1007/978-3-030-97020-8_25
Lefort APipereau YAmponsem KSutra PThomas G(2021)J-NVMProceedings of the ACM SIGOPS 28th Symposium on Operating Systems Principles10.1145/3477132.3483579(408-423)Online publication date: 26-Oct-2021
https://dl.acm.org/doi/10.1145/3477132.3483579
Jarrah MAl‐khatieb BMahasneh NAl‐khateeb BJararweh Y(2020)GDBApex: A graph‐based system to enable efficient transformation of enterprise infrastructuresSoftware: Practice and Experience10.1002/spe.287151:3(517-531)Online publication date: Jul-2020
https://doi.org/10.1002/spe.2871
Fireman DBrunet JLopes RQuaresma DPereira T(2018)Improving Tail Latency of Stateful Cloud Services via GC Control and Load Shedding2018 IEEE International Conference on Cloud Computing Technology and Science (CloudCom)10.1109/CloudCom2018.2018.00034(121-128)Online publication date: Dec-2018
https://doi.org/10.1109/CloudCom2018.2018.00034

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten