Skip to main content

SciJava Interface for Parallel Execution in the ImageJ Ecosystem

  • Conference paper
  • First Online:
Computer Information Systems and Industrial Management (CISIM 2018)

Abstract

ImageJ has become a popular software platform for image processing and its community has developed and made available numerous plugins for scientific audiences. Nevertheless, no platform-wide solution for parallel processing of big data has been created so far. As ImageJ is a part of the SciJava collaboration project, we propose the concept of seamlessly integrating parallelization-providing capability into one of the SciJava libraries. Specifically, this approach strives to make high-performance infrastructure accessible to ImageJ plugin developers whilst remaining extensible and technology-agnostic. Two parallelization approaches were created and experimentally evaluated on an HPC infrastructure. The results indicate good scalability and are promising for prospective integration of the created functionality into the SciJava Common library.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    https://github.com/imagej/imagej-server/wiki/Rationale.

  2. 2.

    https://github.com/imagej/imagej-server.

  3. 3.

    https://docs.it4i.cz/salomon/hardware-overview/.

  4. 4.

    Super-resolution microscopy frame, available at https://idr.openmicroscopy.org, ID 3138072.

  5. 5.

    https://github.com/PetrBainar/scijava-parallel.

References

  1. ActiveMQ - Apache ActiveMQ - index. http://activemq.apache.org/. Accessed 31 May 2018

  2. Apache Spark - unified analytics engine for big data. https://spark.apache.org/. Accessed 31 May 2018

  3. RabbitMQ - messaging that just works. https://www.rabbitmq.com/. Accessed 31 May 2018

  4. Welcome to Apache Hadoop. https://hadoop.apache.org/. Accessed 31 May 2018

  5. Berthold, M.R., et al.: KNIME - the Konstanz information miner: version 2.0 and beyond. ACM SIGKDD Explor. Newslett. 11(1), 26–31 (2009)

    Google Scholar 

  6. Bonér, J.: Introducing Akka - simpler scalability, fault-tolerance, concurrency & remoting through actors. Technical report (2009)

    Google Scholar 

  7. Bull, J., Westhead, M.D., Kambites, M., Obdrzálek, J.: Towards OpenMP for Java. In: European Workshop on OpenMP (EWOMP 2000), vol. 39, p. 40 (2000)

    Google Scholar 

  8. Cima, V., Böhm, S., Martinovič, J., Dvorský, J., Ashby, T.J., Chupakhin, V.: HyperLoom possibilities for executing scientific workflows on the cloud. In: Barolli, L., Terzo, O. (eds.) CISIS 2017. AISC, vol. 611, pp. 397–406. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-61566-0_36

    Chapter  Google Scholar 

  9. Expósito, R.R., Ramos, S., Taboada, G.L., Touriño, J., Doallo, R.: FastMPJ: a scalable and efficient Java message-passing library. Cluster Comput. 17(3), 1031–1050 (2014)

    Article  Google Scholar 

  10. Fillbrunn, A., Dietz, C., Pfeuffer, J., Rahn, R., Landrum, G.A., Berthold, M.R.: KNIME for reproducible cross-domain analysis of life science data. J. Biotechnol. 261, 149–156 (2017)

    Article  Google Scholar 

  11. Grunzke, R., Jug, F., Schuller, B., Jäkel, R., Myers, G., Nagel, W.E.: Seamless HPC Integration of data-intensive knime workflows via UNICORE. In: Desprez, F., et al. (eds.) Euro-Par 2016. LNCS, vol. 10104, pp. 480–491. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-58943-5_39

    Chapter  Google Scholar 

  12. Jones, T.R., et al.: Cellprofiler analyst: data exploration and analysis software for complex image-based screens. BMC Bioinform. 9(1), 482 (2008). https://doi.org/10.1186/1471-2105-9-482

    Article  Google Scholar 

  13. Kaminsky, A.: Big CPU, Big Data: Solving the World’s Toughest Computational Problems with Parallel Computing, 1st edn. CreateSpace Independent Publishing Platform, North Charleston (2016)

    Google Scholar 

  14. Köster, J., Rahmann, S.: Snakemake - a scalable bioinformatics workflow engine. Bioinformatics 28(19), 2520–2522 (2012)

    Article  Google Scholar 

  15. Lee, H.K., Carpenter, B., Fox, G., Lim, S.B.: HP Java: programming support for high-performance grid-enabled applications. Parallel Algorithms Appl. 19(2–3), 175–193 (2004)

    Article  MathSciNet  Google Scholar 

  16. Romberg, M.: The unicore architecture: seamless access to distributed resources. In: The Eighth International Symposium on High Performance Distributed Computing, Proceedings, pp. 287–293. IEEE (1999)

    Google Scholar 

  17. Romberg, M.: The unicore grid infrastructure. Sci. Program. 10(2), 149–157 (2002)

    Google Scholar 

  18. Rueden, C., Schindelin, J., Hiner, M., Eliceiri, K.: SciJava Common [software]. http://scijava.org

  19. Rueden, C.T., Eliceiri, K.W.: The ImageJ ecosystem: an open and extensible platform for biomedical image analysis. Microscopy Microanal. 23(S1), 226–227 (2017)

    Article  Google Scholar 

  20. Rueden, C.T., et al.: Image J2: ImageJ for the next generation of scientific image data. BMC Bioinform. 18(1), 529 (2017)

    Article  Google Scholar 

  21. Schindelin, J., et al.: Fiji: an open-source platform for biological-image analysis. Nature Methods 9(7), 676 (2012)

    Article  Google Scholar 

  22. Schindelin, J., Rueden, C.T., Hiner, M.C., Eliceiri, K.W.: The ImageJ ecosystem: an open platform for biomedical image analysis. Mol. Reprod. Dev. 82(7–8), 518–529 (2015)

    Article  Google Scholar 

  23. Schmied, C., Stamataki, E., Tomancak, P.: Open-source solutions for SPIMage processing. Methods Cell Biol. 123C, 505–529 (2014)

    Google Scholar 

  24. Schmied, C., Steinbach, P., Pietzsch, T., Preibisch, S., Tomancak, P.: An automated workflow for parallel processing of large multiview SPIM recordings. Bioinformatics 32(7), 1112–1114 (2016)

    Article  Google Scholar 

  25. Schneider, C.A., Rasband, W.S., Eliceiri, K.W.: NIH Image to ImageJ: 25 years of image analysis. Nat. Meth. 9(7), 671–675 (2012)

    Article  Google Scholar 

  26. Taboada, G.L., Ramos, S., Expósito, R.R., Touriño, J., Doallo, R.: Java in the high performance computing arena: research, practice and experience. Sci. Comput. Program. 78(5), 425–444 (2013)

    Article  Google Scholar 

  27. Veldema, R., Bhoedjang, R., Bal, H.E.: Distributed shared memory management for Java. In: Proceedings of Sixth Annual Conference of the Advanced School for Computing and Imaging (ASCI 2000). Citeseer (1999)

    Google Scholar 

  28. Wollmann, T., Erfle, H., Eils, R., Rohr, K., Gunkel, M.: Workflows for microscopy image analysis and cellular phenotyping. J. Biotechnol. 261, 70–75 (2017)

    Article  Google Scholar 

Download references

Acknowledgement

This work was supported by the European Regional Development Fund in the IT4Innovations national supercomputing center – path to exascale project, project number CZ.02.1.01/0.0/0.0/16_013/0001791 within the Operational Programme Research, Development and Education.

We would like to thank Curtis Rueden from Laboratory for Optical and Computational Instrumentation, University of Wisconsin-Madison for his assistance and comments that greatly improved this work.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Michal Krumnikl .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Krumnikl, M. et al. (2018). SciJava Interface for Parallel Execution in the ImageJ Ecosystem. In: Saeed, K., Homenda, W. (eds) Computer Information Systems and Industrial Management. CISIM 2018. Lecture Notes in Computer Science(), vol 11127. Springer, Cham. https://doi.org/10.1007/978-3-319-99954-8_25

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-99954-8_25

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-99953-1

  • Online ISBN: 978-3-319-99954-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics