Skip to main content

On Developing Sustainable Deep Learning Applications Using Pre-calculating Energy Usage

  • Conference paper
  • First Online:
Smart Cities, Green Technologies, and Intelligent Transport Systems (SMARTGREENS 2022, VEHITS 2022)

Abstract

Sustainable computing is essential to our modern digital society. It deals with how computing resources and devices can be developed and used to perform operations as efficiently and eco-friendly as possible. With the explosive use of Deep Learning (DL) application systems whose development is known to be computationally intensive, this paper investigates sustainable development of DL applications to exemplify other software development. While much research on sustainable hardware development has made good progresses to reduce electronic waste and power consumption, sustainable software development is relatively behind. Most aim to find energy-efficient solutions as a result from improving computational efficiency (e.g., via optimization). This is useful but not direct. Before one can develop sustainable software, it is necessary to be able to assess and measure energy usage of the software computation. This paper presents an analytical modeling approach to quantifying energy consumption and illustrates how it can help achieve sustainable software development. In particular, we develop an energy model, for DL application systems, that has been evaluated theoretically and empirically on real systems. Unlike most existing work, our approach provides the ability to pre-determine the required energy consumption of DL applications prior to system implementation. The paper illustrates how the approach can help sustainable development of DL application system for monitoring crop health in smart agriculture in two scenarios: 1) when scaling the DL applications based on energy consumed by various design choices, and 2) when deciding whether to use sensors or drones to expand monitoring coverage.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 54.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 69.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Benhamaid, S., Bouabdallah, A., Lakhlef, H.: Recent advances in energy management for Green-IoT: an up-to-date and comprehensive survey. J. Netw. Comput. Appl. 198, 103257 (2022)

    Article  Google Scholar 

  2. Gomes, C., Dietterich, T., Barrett, C., et al.: Computational sustainability: computing for a better world and a sustainable future. Commun. ACM. 62, 56–65 (2019)

    Article  Google Scholar 

  3. Dhaini, M., Jaber, M., Fakhereldine, A., Hamdan, S., Haraty, R.A.: Green computing approaches-a survey. Informatica 45 (2021)

    Google Scholar 

  4. Lu, M., Fu, G., Osman, N.B., Konbr, U.: Green energy harvesting strategies on edge-based urban computing in sustainable Internet of Things. Sustain. Cities Soc. 75, 103349 (2021)

    Article  Google Scholar 

  5. Zhu, S., Ota, K., Dong, M.: Green AI for IIoT: energy efficient intelligent edge computing for industrial Internet of Things. IEEE Trans. Green Commun. Netw. 6(1), 79–88 (2021)

    Article  Google Scholar 

  6. Ma, D., Lan, G., Hassan, M., Hu, W., Das, S.K.: Sensing, computing, and communications for energy harvesting IoTs: a survey. IEEE Commun. Surv. Tutor. 22, 1222–1250 (2020)

    Article  Google Scholar 

  7. Hossain, M.S., Rahman, M.A., Muhammad, G.: Towards energy-aware cloud-oriented cyber-physical therapy system. Future Gen. Comput. Syst. 105, 800–813 (2020)

    Article  Google Scholar 

  8. Haseeb, K., Ud Din, I., Almogren, A., Islam, N.: An Energy efficient and secure IoT-based WSN framework: an application to smart agriculture. Sensors 20, 2081 (2020)

    Article  Google Scholar 

  9. Razooqi, Y.S., Al-Asfoor, M.: Intelligent routing to enhance energy consumption in wireless sensor network: a survey. In: Shakya, S., Bestak, R., Palanisamy, R., Kamel, K.A. (eds.) Mobile Computing and Sustainable Informatics. LNDECT, vol. 68, pp. 283–300. Springer, Singapore (2022). https://doi.org/10.1007/978-981-16-1866-6_21

    Chapter  Google Scholar 

  10. Fu, H., Sharif-Khodaei, Z., Aliabadi, M.H.F.: An energy-efficient cyber-physical system for wireless on-board aircraft structural health monitoring. Mech. Syst. Sig. Process. 128, 352–368 (2019)

    Article  Google Scholar 

  11. Bouguera, T., Diouris, J., Chaillout, J., Andrieux, G.: Energy consumption modeling for communicating sensors using LoRa technology. In: 2018 IEEE Conference on Antenna Measurements & Applications (CAMA), pp. 1–4 (2018)

    Google Scholar 

  12. Atitallah, S.B., Driss, M., Boulila, W., Ghézala, H.B.: Leveraging Deep Learning and IoT big data analytics to support the smart cities development: review and future directions. Comput. Sci. Rev. 38, 100303 (2020)

    Article  Google Scholar 

  13. Liu, Y., Sun, P., Wergeles, N., Shang, Y.: A survey and performance evaluation of deep learning methods for small object detection. Expert Syst. Appl. 172, 114602 (2021)

    Article  Google Scholar 

  14. Too, E.C., Yujian, L., Njuki, S., Yingchun, L.: A comparative study of fine-tuning deep learning models for plant disease identification. Comput. Electron. Agric. 161, 272–279 (2019)

    Article  Google Scholar 

  15. Strubell, E., Ganesh, A., McCallum, A.: Energy and policy considerations for deep learning in NLP. In: Proceedings of the Conference on 57th Annual Meeting of the ACL, pp. 3645–3650 (2020)

    Google Scholar 

  16. Faviola Rodrigues, C., Riley, G., Luján, M.: SyNERGY: an energy measurement and prediction framework for Convolutional Neural Networks on Jetson TX1. In: Proceedings of the International Conference on Parallel and Distributed Processing Techniques and Applications, pp. 375–382 (2018)

    Google Scholar 

  17. Cai, E., Juan, D.-C., Stamoulis, D., Marculescu, D.: NeuralPower: predict and deploy energy-efficient convolutional neural networks. In: Asian Conference on Machine Learning, pp. 622–637 (2017)

    Google Scholar 

  18. García-Martín, E., Rodrigues, C.F., Riley, G., Grahn, H.: Estimation of energy consumption in machine learning. J. Parallel Distrib. Comput. 134, 75–88 (2019)

    Article  Google Scholar 

  19. Yang, T.J., Chen, Y.H., Emer, J., Sze, V.: A method to estimate the energy consumption of deep neural networks. In: Conference Record of 51st ACSSC 2017, pp. 1916–1920 (2018)

    Google Scholar 

  20. Rouhani, B.D., Mirhoseini, A., Koushanfar, F.: DeLight: adding energy dimension to deep neural networks. In: Proceedings of the International Symposium on Low Power Electronics and Design, pp. 112–117 (2016).

    Google Scholar 

  21. Mo, X., Xu, J.: Energy-efficient federated edge learning with joint communication and computation design. J. Commun. Inf. Netw. 6(2), 110–124 (2020)

    Article  Google Scholar 

  22. Yang, Z., Chen, M., Saad, W., Hong, C.S., Shikh-Bahaei, M.: Energy efficient federated learning over wireless communication networks. IEEE Trans. Wireless Commun. 20, 1935–1949 (2021)

    Article  Google Scholar 

  23. Puangpontip, S., Hewett, R.: Energy-aware deep learning for green cyber-physical systems. In: Proceedings of the 11th International Conference on Smart Cities and Green ICT Systems - SMARTGREENS, pp. 32–43. SciTePress (2022)

    Google Scholar 

  24. Sze, V., Chen, Y.H., Yang, T.J., Emer, J.S.: Efficient processing of deep neural networks: a tutorial and survey. Proc. IEEE 105, 2295–2329 (2017)

    Article  Google Scholar 

  25. Rajasekaran, T., Anandamurugan, S.: Challenges and applications of wireless sensor networks in smart farming—a survey. In: Dinesh Peter, J., Alavi, A.H., Javadi, B. (eds.) Advances in Big Data and Cloud Computing: Proceedings of ICBDCC 2018, pp. 353–361. Springer, Singapore (2019). https://doi.org/10.1007/978-981-13-1882-5_30

    Chapter  Google Scholar 

  26. Yao, J., Ansari, N.: QoS-aware power control in internet of drones for data collection service. IEEE Trans. Veh. Technol. 68, 6649–6656 (2019)

    Article  Google Scholar 

  27. Krizhevsky, A., Sutskever, I., Hinton, G.E.: ImageNet classification with deep convolutional neural networks. Commun. ACM 60, 84–90 (2017)

    Article  Google Scholar 

  28. Gikunda, P.K., Jouandeau, N.: State-of-the-art convolutional neural networks for smart farms: a review. In: Arai, K., Bhatia, R., Kapoor, S. (eds.) CompCom 2019. AISC, vol. 997, pp. 763–775. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-22871-2_53

    Chapter  Google Scholar 

  29. Coral: Google Coral Dev Board. https://coral.ai/docs/dev-board/datasheet/

  30. Puangpontip, S., Hewett, R.: On using deep learning for business analytics: at what cost? In: International Conference on Knowledge-Based and Intelligent Information & Engineering Systems (2022)

    Google Scholar 

  31. Li, J.: Research on optoelectronic accelerator based on AI computing. In: 2022 IEEE International Conference on Artificial Intelligence and Computer Applications, pp. 1001–1006 (2022)

    Google Scholar 

  32. Li, Y., Nie, J., Chao, X.: Do we really need deep CNN for plant diseases identification? Comput. Electron. Agric. 178, 105803 (2020)

    Article  Google Scholar 

  33. Liu, Y., Yang, C., Jiang, L., Xie, S., Zhang, Y.: Intelligent edge computing for IoT-based energy management in smart cities. IEEE Netw. 33, 111–117 (2019)

    Article  Google Scholar 

  34. Mitchell, W., Westberg, S., Reiling, A., Taha, T., Balster, E., Hill, K.: Generalized power modeling for deep learning. In: IEEE NAECON 2018, pp. 391–394 (2018)

    Google Scholar 

  35. Horcas, J.M., Pinto, M., Fuentes, L.: Context-aware energy-efficient applications for cyber-physical systems. Ad Hoc Netw. 82, 15–30 (2019)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Supadchaya Puangpontip .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Puangpontip, S., Hewett, R. (2023). On Developing Sustainable Deep Learning Applications Using Pre-calculating Energy Usage. In: Klein, C., Jarke, M., Ploeg, J., Helfert, M., Berns, K., Gusikhin, O. (eds) Smart Cities, Green Technologies, and Intelligent Transport Systems. SMARTGREENS VEHITS 2022 2022. Communications in Computer and Information Science, vol 1843. Springer, Cham. https://doi.org/10.1007/978-3-031-37470-8_2

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-37470-8_2

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-37469-2

  • Online ISBN: 978-3-031-37470-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics