Abstract
ImageJ has become a popular software platform for image processing and its community has developed and made available numerous plugins for scientific audiences. Nevertheless, no platform-wide solution for parallel processing of big data has been created so far. As ImageJ is a part of the SciJava collaboration project, we propose the concept of seamlessly integrating parallelization-providing capability into one of the SciJava libraries. Specifically, this approach strives to make high-performance infrastructure accessible to ImageJ plugin developers whilst remaining extensible and technology-agnostic. Two parallelization approaches were created and experimentally evaluated on an HPC infrastructure. The results indicate good scalability and are promising for prospective integration of the created functionality into the SciJava Common library.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
- 2.
- 3.
- 4.
Super-resolution microscopy frame, available at https://idr.openmicroscopy.org, ID 3138072.
- 5.
References
ActiveMQ - Apache ActiveMQ - index. http://activemq.apache.org/. Accessed 31 May 2018
Apache Spark - unified analytics engine for big data. https://spark.apache.org/. Accessed 31 May 2018
RabbitMQ - messaging that just works. https://www.rabbitmq.com/. Accessed 31 May 2018
Welcome to Apache Hadoop. https://hadoop.apache.org/. Accessed 31 May 2018
Berthold, M.R., et al.: KNIME - the Konstanz information miner: version 2.0 and beyond. ACM SIGKDD Explor. Newslett. 11(1), 26–31 (2009)
Bonér, J.: Introducing Akka - simpler scalability, fault-tolerance, concurrency & remoting through actors. Technical report (2009)
Bull, J., Westhead, M.D., Kambites, M., Obdrzálek, J.: Towards OpenMP for Java. In: European Workshop on OpenMP (EWOMP 2000), vol. 39, p. 40 (2000)
Cima, V., Böhm, S., Martinovič, J., Dvorský, J., Ashby, T.J., Chupakhin, V.: HyperLoom possibilities for executing scientific workflows on the cloud. In: Barolli, L., Terzo, O. (eds.) CISIS 2017. AISC, vol. 611, pp. 397–406. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-61566-0_36
Expósito, R.R., Ramos, S., Taboada, G.L., Touriño, J., Doallo, R.: FastMPJ: a scalable and efficient Java message-passing library. Cluster Comput. 17(3), 1031–1050 (2014)
Fillbrunn, A., Dietz, C., Pfeuffer, J., Rahn, R., Landrum, G.A., Berthold, M.R.: KNIME for reproducible cross-domain analysis of life science data. J. Biotechnol. 261, 149–156 (2017)
Grunzke, R., Jug, F., Schuller, B., Jäkel, R., Myers, G., Nagel, W.E.: Seamless HPC Integration of data-intensive knime workflows via UNICORE. In: Desprez, F., et al. (eds.) Euro-Par 2016. LNCS, vol. 10104, pp. 480–491. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-58943-5_39
Jones, T.R., et al.: Cellprofiler analyst: data exploration and analysis software for complex image-based screens. BMC Bioinform. 9(1), 482 (2008). https://doi.org/10.1186/1471-2105-9-482
Kaminsky, A.: Big CPU, Big Data: Solving the World’s Toughest Computational Problems with Parallel Computing, 1st edn. CreateSpace Independent Publishing Platform, North Charleston (2016)
Köster, J., Rahmann, S.: Snakemake - a scalable bioinformatics workflow engine. Bioinformatics 28(19), 2520–2522 (2012)
Lee, H.K., Carpenter, B., Fox, G., Lim, S.B.: HP Java: programming support for high-performance grid-enabled applications. Parallel Algorithms Appl. 19(2–3), 175–193 (2004)
Romberg, M.: The unicore architecture: seamless access to distributed resources. In: The Eighth International Symposium on High Performance Distributed Computing, Proceedings, pp. 287–293. IEEE (1999)
Romberg, M.: The unicore grid infrastructure. Sci. Program. 10(2), 149–157 (2002)
Rueden, C., Schindelin, J., Hiner, M., Eliceiri, K.: SciJava Common [software]. http://scijava.org
Rueden, C.T., Eliceiri, K.W.: The ImageJ ecosystem: an open and extensible platform for biomedical image analysis. Microscopy Microanal. 23(S1), 226–227 (2017)
Rueden, C.T., et al.: Image J2: ImageJ for the next generation of scientific image data. BMC Bioinform. 18(1), 529 (2017)
Schindelin, J., et al.: Fiji: an open-source platform for biological-image analysis. Nature Methods 9(7), 676 (2012)
Schindelin, J., Rueden, C.T., Hiner, M.C., Eliceiri, K.W.: The ImageJ ecosystem: an open platform for biomedical image analysis. Mol. Reprod. Dev. 82(7–8), 518–529 (2015)
Schmied, C., Stamataki, E., Tomancak, P.: Open-source solutions for SPIMage processing. Methods Cell Biol. 123C, 505–529 (2014)
Schmied, C., Steinbach, P., Pietzsch, T., Preibisch, S., Tomancak, P.: An automated workflow for parallel processing of large multiview SPIM recordings. Bioinformatics 32(7), 1112–1114 (2016)
Schneider, C.A., Rasband, W.S., Eliceiri, K.W.: NIH Image to ImageJ: 25 years of image analysis. Nat. Meth. 9(7), 671–675 (2012)
Taboada, G.L., Ramos, S., Expósito, R.R., Touriño, J., Doallo, R.: Java in the high performance computing arena: research, practice and experience. Sci. Comput. Program. 78(5), 425–444 (2013)
Veldema, R., Bhoedjang, R., Bal, H.E.: Distributed shared memory management for Java. In: Proceedings of Sixth Annual Conference of the Advanced School for Computing and Imaging (ASCI 2000). Citeseer (1999)
Wollmann, T., Erfle, H., Eils, R., Rohr, K., Gunkel, M.: Workflows for microscopy image analysis and cellular phenotyping. J. Biotechnol. 261, 70–75 (2017)
Acknowledgement
This work was supported by the European Regional Development Fund in the IT4Innovations national supercomputing center – path to exascale project, project number CZ.02.1.01/0.0/0.0/16_013/0001791 within the Operational Programme Research, Development and Education.
We would like to thank Curtis Rueden from Laboratory for Optical and Computational Instrumentation, University of Wisconsin-Madison for his assistance and comments that greatly improved this work.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer Nature Switzerland AG
About this paper
Cite this paper
Krumnikl, M. et al. (2018). SciJava Interface for Parallel Execution in the ImageJ Ecosystem. In: Saeed, K., Homenda, W. (eds) Computer Information Systems and Industrial Management. CISIM 2018. Lecture Notes in Computer Science(), vol 11127. Springer, Cham. https://doi.org/10.1007/978-3-319-99954-8_25
Download citation
DOI: https://doi.org/10.1007/978-3-319-99954-8_25
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-99953-1
Online ISBN: 978-3-319-99954-8
eBook Packages: Computer ScienceComputer Science (R0)