Skip to main content

Forecasting Algae Growth in Photo-Bioreactors Using Attention LSTMs

  • Conference paper
  • First Online:
Software Engineering and Formal Methods. SEFM 2022 Collocated Workshops (SEFM 2022)

Abstract

Sustainability is the current global challenge. This is reflected in the demand for healthy food and CO\(_2\) neutrality. These challenges can be met with the industrial cultivation of algae: Algae can be used as food supplements, nutraceuticals, pharmaceuticals, fuel, CO\(_2\) sinks, and obtain high relative yield density per area. Current limitations in their large-scale use exists, as scaling up from laboratory environments to pilot applications typically requires more than 5 years, because of highly complex interactions in the growth behavior: They are influenced by current and past environmental conditions. These interactions make current pilot applications inefficient due to insufficient control and monitoring techniques. This limitation can be countered: By using modern communication and evaluation technologies, a “smart” bioreactor can be developed, which evaluates algae growth in real-time, performs process adaptations and thus significantly accelerates algae growth and scale-up. Therefore, an algae bioreactor was established at the University of Technology Sydney. The subject of this paper is the study of algae growth using Long Short-Term Memory Neural Networks (LSTMs). In order to learn the behavior of algae in the shortest possible series of experiments, repetitive change intervals were run by systematically varying the environmental parameters. LSTMs were trained to model algae growth. Attention mechanism is used on variable and temporal direction for importance. The LSTM is compared to a Transformer and an ARIMA. Based on the trained models, the behavior of algae growth is interpreted.

The infrastructure used for this work was funded by the Australian Government, Department of Industry, Innovation and Science as part of the Industry 4.0 Testlabs for Australia pilot program. This research has been funded by the Federal Ministry of Education and Research of Germany and the state of North-Rhine Westphalia as part of the Lamarr-Institute for Machine Learning and Artificial Intelligence, LAMARR22B.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 89.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 119.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Akiba, T., Sano, S., Yanase, T., Ohta, T., Koyama, M.: Optuna: a next-generation hyperparameter optimization framework. In: Proceedings of the 25rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (2019)

    Google Scholar 

  2. Benedetti, M., Vecchi, V., Barera, S., Dall’Osto, L.: Biomass from microalgae: the potential of domestication towards sustainable biofactories. Microb. Cell Fact. 17(1), 1–18 (2018)

    Article  Google Scholar 

  3. Box, G.E., Jenkins, G.M., Reinsel, G.C., Ljung, G.M.: Time series analysis: forecasting and control. Wiley, Hoboken (2015)

    Google Scholar 

  4. Béchet, Q., Shilton, A., Guieysse, B.: Modeling the effects of light and temperature on algae growth: state of the art and critical assessment for productivity prediction during outdoor cultivation. Biotechnol. Adv. 31(8), 1648–1663 (2013)

    Article  Google Scholar 

  5. Chalker, B.E.: Modeling light saturation curves for photosynthesis: an exponential function. J. Theor. Biol. 84(2), 205–215 (1980)

    Article  Google Scholar 

  6. Doan, Y.T.T., Ho, M.T., Nguyen, H.K., Han, H.D.: Optimization of spirulina sp. cultivation using reinforcement learning with state prediction based on LSTM neural network. J. Appl. Phycol. 33(5), 2733–2744 (2021)

    Article  Google Scholar 

  7. Elman, J.L.: Finding structure in time. Cogn. Sci. 14(2), 179–211 (1990)

    Article  Google Scholar 

  8. Gao, X., Kong, B., Vigil, R.D.: Simulation of algal photobioreactors: recent developments and challenges. Biotechnol. Lett. 40(9), 1311–1327 (2018)

    Article  Google Scholar 

  9. Graham, L.E., Graham, J.M., Wilcox, L.W.: Algae, 2nd edn. Pearson Benjamin Cummings, San Francisco (2009)

    Google Scholar 

  10. Guo, T., Lin, T., Antulov-Fantulin, N.: Exploring interpretable LSTM neural networks over multi-variable data. In: Chaudhuri, K., Salakhutdinov, R. (eds.) Proceedings of the 36th International Conference on Machine Learning, ICML 2019, 9–15 June 2019, Long Beach, California, USA. Proceedings of Machine Learning Research, vol. 97, pp. 2494–2504. PMLR (2019)

    Google Scholar 

  11. Hochreiter, S., Schmidhuber, J.: Long short-term memory. Neural Comput. 9(8), 1735–1780 (1997)

    Article  Google Scholar 

  12. Jeong, K.S., Recknagel, F., Joo, G.J.: Prediction and elucidation of population dynamics of the blue-green algae microcystis aeruginosa and the diatom stephanodiscus hantzschii in the nakdong river-reservoir system (south korea) by a recurrent artificial neural network. In: Recknagel, F. (ed.) Ecological Informatics, pp. 255–273. Springer, Heidelberg (2006). https://doi.org/10.1007/3-540-28426-5_12

    Chapter  Google Scholar 

  13. Jeong, K.S., Kim, D.K., Joo, G.J.: River phytoplankton prediction model by artificial neural network: model performance and selection of input variables to predict time-series phytoplankton proliferations in a regulated river system. Eco. Inform. 1(3), 235–245 (2006)

    Article  Google Scholar 

  14. Lee, S., Lee, D.: Improved prediction of harmful algal blooms in four major south Korea’s rivers using deep learning models. Int. J. Environ. Res. Public Health 15(7), 1322 (2018)

    Article  Google Scholar 

  15. Levy, O., Dubinsky, Z., Schneider, K., Achituv, Y., Zakai, D., Gorbunov, M.Y.: Diurnal hysteresis in coral photosynthesis. Mar. Ecol. Prog. Ser. 268, 105–117 (2004)

    Article  Google Scholar 

  16. Lim, B., Arik, S.Ö., Loeff, N., Pfister, T.: Temporal fusion transformers for interpretable multi-horizon time series forecasting. CoRR abs/1912.09363 (2019)

    Google Scholar 

  17. Lucker, B.F., Hall, C.C., Zegarac, R., Kramer, D.M.: The environmental photobioreactor (ePBR): an algal culturing platform for simulating dynamic natural environments. Algal Res. 6(Part B), 242–249 (2014)

    Article  Google Scholar 

  18. Rawat, I., Kumar, R.R., Mutanda, T., Bux, F.: Biodiesel from microalgae: a critical evaluation from laboratory to large scale production. Appl. Energy 103, 444–467 (2013)

    Article  Google Scholar 

  19. del Rio-Chanona, E.A., Wagner, J.L., Ali, H., Fiorelli, F., Zhang, D., Hellgardt, K.: Deep learning-based surrogate modeling and optimization for microalgal biofuel production and photobioreactor design. AIChE J. 65(3), 915–923 (2019)

    Article  Google Scholar 

  20. Rossignolo, J.A., Felicio Peres Duran, A.J., Bueno, C., Martinelli Filho, J.E., Savastano Junior, H., Tonin, F.G.: Algae application in civil construction: a review with focus on the potential uses of the pelagic Sargassum spp. biomass. J. Environ. Manag. 303(December 2021), 114258 (2022)

    Google Scholar 

  21. Shahriari, B., Swersky, K., Wang, Z., Adams, R.P., de Freitas, N.: Taking the human out of the loop: a review of Bayesian optimization. Proc. IEEE 104(1), 148–175 (2016)

    Article  Google Scholar 

  22. Taunt, H.N., Stoffels, L., Purton, S.: Green biologics: the algal chloroplast as a platform for making biopharmaceuticals. Bioengineered 9(1), 48–54 (2018)

    Article  Google Scholar 

  23. Vaswani, A., et al.: Attention is all you need. Adv. Neural Inf. Process. Syst. 30, 6000–6010 (2017)

    Google Scholar 

  24. Wu, N., Green, B., Ben, X., O’Banion, S.: Deep transformer models for time series forecasting: the influenza prevalence case. CoRR abs/2001.08317 (2020)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding authors

Correspondence to Daniel Boiar or Nils Killich .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Boiar, D., Killich, N., Schulte, L., Hernandez Moreno, V., Deuse, J., Liebig, T. (2023). Forecasting Algae Growth in Photo-Bioreactors Using Attention LSTMs. In: Masci, P., Bernardeschi, C., Graziani, P., Koddenbrock, M., Palmieri, M. (eds) Software Engineering and Formal Methods. SEFM 2022 Collocated Workshops. SEFM 2022. Lecture Notes in Computer Science, vol 13765. Springer, Cham. https://doi.org/10.1007/978-3-031-26236-4_3

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-26236-4_3

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-26235-7

  • Online ISBN: 978-3-031-26236-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics