skip to main content
10.1145/3584931.3606959acmconferencesArticle/Chapter ViewAbstractPublication PagescscwConference Proceedingsconference-collections
research-article

Visualizing the Carbon Intensity of Machine Learning Inference for Image Analysis on TensorFlow Hub

Published: 14 October 2023 Publication History

Abstract

The increasing performance of machine learning (ML) models necessitates greater computing resources, contributing to rising carbon intensity in ML computing and raising concerns about computational equity. Previous studies focused on developing tools that enable model developers to view the carbon intensity of the ML models in the training process. Still, little is known about how to support ML developers in online communities to explore the carbon intensity of ML models during inference. We developed MIEV, a model inference emission visualizer, that supports ML developers on TensorFlow Hub to explore the carbon intensity of image domain models during the model Inference phase. We also provide insights into designing technologies that promote collaborative work among ML developers to drive sustainable AI development processes. To the best of our knowledge, this is the first attempt to interactively visualize the carbon intensity of ML models in online communities during the Inference phase.

References

[1]
Moayad Alshangiti, Hitesh Sapkota, Pradeep K. Murukannaiah, Xumin Liu, and Qi Yu. 2019. Why is Developing Machine Learning Applications Challenging? A Study on Stack Overflow Posts. In 2019 ACM/IEEE International Symposium on Empirical Software Engineering and Measurement (ESEM). IEEE, Porto de Galinhas, Brazil, 1–11. https://doi.org/10.1109/ESEM.2019.8870187
[2]
Lasse F. Wolff Anthony, Benjamin Kanding, and Raghavendra Selvan. 2020. Carbontracker: Tracking and Predicting the Carbon Footprint of Training Deep Learning Models. arxiv:2007.03051 [cs.CY]
[3]
Abdul Ali Bangash, Hareem Sahar, Shaiful Chowdhury, Alexander William Wong, Abram Hindle, and Karim Ali. 2019. What do Developers Know About Machine Learning: A Study of ML Discussions on StackOverflow. In 2019 IEEE/ACM 16th International Conference on Mining Software Repositories (MSR). IEEE, Montreal, QC, Canada, 260–264. https://doi.org/10.1109/MSR.2019.00052
[4]
Emily M. Bender, Timnit Gebru, Angelina McMillan-Major, and Shmargaret Shmitchell. 2021. On the Dangers of Stochastic Parrots: Can Language Models Be Too Big?. In Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency (Virtual Event, Canada) (FAccT ’21). Association for Computing Machinery, New York, NY, USA, 610–623. https://doi.org/10.1145/3442188.3445922
[5]
S. A. Budennyy, V. D. Lazarev, N. N. Zakharenko, A. N. Korovin, O. A. Plosskaya, D. V. Dimitrov, V. S. Akhripkin, I. V. Pavlov, I. V. Oseledets, I. S. Barsola, I. V. Egorov, A. A. Kosterina, and L. E. Zhukov. 2022. eco2AI: Carbon Emissions Tracking of Machine Learning Models as the First Step Towards Sustainable AI. Doklady Mathematics 106, 1 (01 Dec 2022), S118–S128. https://doi.org/10.1134/S1064562422060230
[6]
Carrie J. Cai and Philip J. Guo. 2019. Software Developers Learning Machine Learning: Motivations, Hurdles, and Desires. In 2019 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC). IEEE, Memphis, TN, USA, 25–34. https://doi.org/10.1109/VLHCC.2019.8818751
[7]
Dong Chen, Rachel K. E. Bellamy, Peter K. Malkin, and Thomas Erickson. 2016. Diagnostic visualization for non-expert machine learning practitioners: A design study. In 2016 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC). IEEE, Cambridge, UK, 87–95. https://doi.org/10.1109/VLHCC.2016.7739669
[8]
Zhenpeng Chen, Yanbin Cao, Yuanqiang Liu, Haoyu Wang, Tao Xie, and Xuanzhe Liu. 2020. A Comprehensive Study on Challenges in Deploying Deep Learning Based Software. In Proceedings of the 28th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering (Virtual Event, USA) (ESEC/FSE 2020). Association for Computing Machinery, New York, NY, USA, 750–762. https://doi.org/10.1145/3368089.3409759
[9]
Furui Cheng, Yao Ming, and Huamin Qu. 2020. Dece: Decision explorer with counterfactual explanations for machine learning models. IEEE Transactions on Visualization and Computer Graphics 27, 2 (2020), 1438–1447.
[10]
codecarbon. 2023. codecarbon. https://github.com/mlco2/codecarbon. Accessed: July 7, 2023.
[11]
Laura Dabbish, Colleen Stuart, Jason Tsay, and Jim Herbsleb. 2012. Social Coding in GitHub: Transparency and Collaboration in an Open Software Repository. In Proceedings of the ACM 2012 Conference on Computer Supported Cooperative Work (Seattle, Washington, USA) (CSCW ’12). Association for Computing Machinery, New York, NY, USA, 1277–1286. https://doi.org/10.1145/2145204.2145396
[12]
Ayse Dalgali and Kevin Crowston. 2019. Sharing Open Deep Learning Models. In Hawaii International Conference on System Sciences. HICSS(Hawaii International Conference on System Sciences), Grand Wailea, Hawaii, 2109–2118.
[13]
Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019. BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers). Association for Computational Linguistics, Minneapolis, Minnesota, 4171–4186. https://doi.org/10.18653/v1/N19-1423
[14]
Jesse Dodge, Taylor Prewitt, Remi Tachet des Combes, Erika Odmark, Roy Schwartz, Emma Strubell, Alexandra Sasha Luccioni, Noah A. Smith, Nicole DeCario, and Will Buchanan. 2022. Measuring the Carbon Intensity of AI in Cloud Instances. In Proceedings of the 2022 ACM Conference on Fairness, Accountability, and Transparency (Seoul, Republic of Korea) (FAccT ’22). Association for Computing Machinery, New York, NY, USA, 1877–1894. https://doi.org/10.1145/3531146.3533234
[15]
Hugging Face. 2023. Hugging Face. https://huggingface.co. Accessed: July 7, 2023.
[16]
Flask. 2023. Flask. https://flask.palletsprojects.com. Accessed: July 7, 2023.
[17]
Flutter. 2023. Flutter. https://flutter.dev. Accessed: July 7, 2023.
[18]
Humberto Garcia Caballero, Alberto Corvo, Fokke van Meulen, Pedro Fonseca, Sebastiaan Overeem, Jack J. van Wijk, and Michel A. Westenberg. 2021. PerSleep: A Visual Analytics Approach for Performance Assessment of Sleep Staging Models. In VCBM 2021 - Eurographics Workshop on Visual Computing for Biology and Medicine(Eurographics Workshop on Visual Computing for Biomedicine), Steffen Oeltze-Jafra, Noeska N. Smit, Bjorn Sommer, Kay Nieselt, and Thomas Schultz (Eds.). Eurographics Association, Paris, France, 123–133. https://doi.org/10.2312/vcbm.20211352 2021 Eurographics Workshop on Visual Computing for Biology and Medicine, VCBM 2021, VCBM 2021 ; Conference date: 22-09-2021 Through 24-09-2021.
[19]
A. Hamidi, G. Antoniol, F. Khomh, M. Penta, and M. Hamidi. 2021. Towards Understanding Developers’ Machine-Learning Challenges: A Multi-Language Study on Stack Overflow. In 2021 IEEE 21st International Working Conference on Source Code Analysis and Manipulation (SCAM). IEEE Computer Society, Los Alamitos, CA, USA, 58–69. https://doi.org/10.1109/SCAM52516.2021.00016
[20]
Peter Henderson, Jieru Hu, Joshua Romoff, Emma Brunskill, Dan Jurafsky, and Joelle Pineau. 2020. Towards the systematic reporting of the energy and carbon footprints of machine learning. The Journal of Machine Learning Research 21, 1 (2020), 10039–10081.
[21]
Chris W Hope. 2008. Optimal carbon emissions and the social cost of carbon over time under uncertainty. Integrated Assessment Journal 8, 1 (2008), 107–122.
[22]
Forrest Iandola, Matt Moskewicz, Sergey Karayev, Ross Girshick, Trevor Darrell, and Kurt Keutzer. 2014. DenseNet: Implementing Efficient ConvNet Descriptor Pyramids. arxiv:1404.1869 [cs.CV]
[23]
Md Johirul Islam, Giang Nguyen, Rangeet Pan, and Hridesh Rajan. 2019. A Comprehensive Study on Deep Learning Bug Characteristics. In Proceedings of the 2019 27th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering (Tallinn, Estonia) (ESEC/FSE 2019). Association for Computing Machinery, New York, NY, USA, 510–520. https://doi.org/10.1145/3338906.3338955
[24]
Md Johirul Islam, Hoan Anh Nguyen, Rangeet Pan, and Hridesh Rajan. 2019. What Do Developers Ask About ML Libraries? A Large-scale Study Using Stack Overflow. arxiv:1906.11940 [cs.SE]
[25]
S. Jin, H. Lee, C. Park, H. Chu, Y. Tae, J. Choo, and S. Ko. 2023. A Visual Analytics System for Improving Attention-based Traffic Forecasting Models. IEEE Transactions on Visualization and Computer Graphics 29, 01 (jan 2023), 1102–1112. https://doi.org/10.1109/TVCG.2022.3209462
[26]
Zhihua Jin, Yong Wang, Qianwen Wang, Yao Ming, Tengfei Ma, and Huamin Qu. 2022. GNNLens: A Visual Analytics Approach for Prediction Error Diagnosis of Graph Neural Networks. IEEE Transactions on Visualization and Computer Graphics 29, 6 (feb 2022), 3024–3038. https://doi.org/10.1109/TVCG.2022.3148107
[27]
Alexandre Lacoste, Alexandra Luccioni, Victor Schmidt, and Thomas Dandres. 2019. Quantifying the Carbon Emissions of Machine Learning. arxiv:1910.09700 [cs.CY]
[28]
Loïc Lannelongue, Jason Grealey, and Michael Inouye. 2021. Green Algorithms: Quantifying the Carbon Footprint of Computation. Advanced Science 8, 12 (May 2021), 2100707. https://doi.org/10.1002/advs.202100707
[29]
Hyunmin Lee, Minki Chun, and Hyunggu Jung. 2023. PORDE: Explaining Data Poisoning Attacks Through Visual Analytics with Food Delivery App Reviews. In Companion Proceedings of the 28th International Conference on Intelligent User Interfaces (Sydney, NSW, Australia) (IUI ’23 Companion). Association for Computing Machinery, New York, NY, USA, 46–50. https://doi.org/10.1145/3581754.3584128
[30]
Anne-Laure Ligozat, Julien Lefevre, Aurélie Bugeau, and Jacques Combaz. 2022. Unraveling the Hidden Environmental Impacts of AI Solutions for Environment Life Cycle Assessment of AI Solutions. Sustainability 14, 9 (Apr 2022), 5172. https://doi.org/10.3390/su14095172
[31]
Zerong Liu and Aidong Lu. 2019. Explainable Visualization for Interactive Exploration of CNN on Wikipedia Vandal Detection. In 2019 IEEE International Conference on Big Data (Big Data). IEEE, Los Angeles, CA, USA, 2354–2363. https://doi.org/10.1109/BigData47090.2019.9006128
[32]
Kadan Lottick, Silvia Susai, Sorelle A. Friedler, and Jonathan P. Wilson. 2019. Energy Usage Reports: Environmental awareness as part of algorithmic accountability. arxiv:1911.08354 [cs.LG]
[33]
Jennifer Marlow, Laura Dabbish, and Jim Herbsleb. 2013. Impression Formation in Online Peer Production: Activity Traces and Personal Profiles in Github. In Proceedings of the 2013 Conference on Computer Supported Cooperative Work (San Antonio, Texas, USA) (CSCW ’13). Association for Computing Machinery, New York, NY, USA, 117–128. https://doi.org/10.1145/2441776.2441792
[34]
Yao Ming, Huamin Qu, and Enrico Bertini. 2019. RuleMatrix: Visualizing and Understanding Classifiers with Rules. IEEE Transactions on Visualization and Computer Graphics 25, 1 (2019), 342–352. https://doi.org/10.1109/TVCG.2018.2864812
[35]
David Patterson, Joseph Gonzalez, Urs Hölzle, Quoc Le, Chen Liang, Lluis-Miquel Munguia, Daniel Rothchild, David R. So, Maud Texier, and Jeff Dean. 2022. The Carbon Footprint of Machine Learning Training Will Plateau, Then Shrink. Computer 55, 7 (2022), 18–28. https://doi.org/10.1109/MC.2022.3148714
[36]
David Patterson, Joseph Gonzalez, Quoc Le, Chen Liang, Lluis-Miquel Munguia, Daniel Rothchild, David So, Maud Texier, and Jeff Dean. 2021. Carbon Emissions and Large Neural Network Training. arxiv:2104.10350 [cs.LG]
[37]
PyTorch. 2023. PyTorch Hub. https://pytorch.org/hub. Accessed: July 7, 2023.
[38]
Omar Shaikh, Jon Saad-Falcon, Austin P Wright, Nilaksh Das, Scott Freitas, Omar Asensio, and Duen Horng Chau. 2021. EnergyVis: Interactively Tracking and Exploring Energy Consumption for ML Models. In Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems (Yokohama, Japan) (CHI EA ’21). Association for Computing Machinery, New York, NY, USA, Article 458, 7 pages. https://doi.org/10.1145/3411763.3451780
[39]
Donghee Shin. 2021. The effects of explainability and causability on perception, trust, and acceptance: Implications for explainable AI. International Journal of Human-Computer Studies 146 (2021), 102551. https://doi.org/10.1016/j.ijhcs.2020.102551
[40]
B. Shneiderman. 1996. The Eyes Have It: A Task by Data Type Taxonomy for Information Visualizations. In Visual Languages, IEEE Symposium on. IEEE Computer Society, Los Alamitos, CA, USA, 336. https://doi.org/10.1109/VL.1996.545307
[41]
Yunjia Sun, Edward Lank, and Michael Terry. 2017. Label-and-Learn: Visualizing the Likelihood of Machine Learning Classifier’s Success During Data Labeling. In Proceedings of the 22nd International Conference on Intelligent User Interfaces (Limassol, Cyprus) (IUI ’17). Association for Computing Machinery, New York, NY, USA, 523–534. https://doi.org/10.1145/3025171.3025208
[42]
TensorFlow. 2023. TensorFlow Hub. https://tfhub.dev. Accessed: July 7, 2023.
[43]
Andreas Theissler, Stephan Frey, and Jens Ehlert. 2019. OCADaMi: One-Class Anomaly Detection and Data Mining Toolbox. In Machine Learning and Knowledge Discovery in Databases: European Conference, ECML PKDD 2019, Wurzburg, Germany, September 16–20, 2019, Proceedings, Part III (Wurzburg, Germany). Springer-Verlag, Berlin, Heidelberg, 764–768. https://doi.org/10.1007/978-3-030-46133-1_47
[44]
Roberto Verdecchia, June Sallou, and Luís Cruz. 2023. A systematic review of Green AI. WIREs Data Mining and Knowledge Discovery 13, 4 (2023), e1507. https://doi.org/10.1002/widm.1507 arXiv:https://wires.onlinelibrary.wiley.com/doi/pdf/10.1002/widm.1507
[45]
Junhong Wang, Yun Li, Zhaoyu Zhou, Chengshun Wang, Yijie Hou, Li Zhang, Xiangyang Xue, Michael Kamp, Xiaolong Zhang, and Siming Chen. 2022. When, Where and How does it fail? A Spatial-temporal Visual Analytics Approach for Interpretable Object Detection in Autonomous Driving. IEEE Transactions on Visualization and Computer Graphics (2022), 1–16. https://doi.org/10.1109/TVCG.2022.3201101
[46]
Carole-Jean Wu, Ramya Raghavendra, Udit Gupta, Bilge Acun, Newsha Ardalani, Kiwan Maeng, Gloria Chang, Fiona Aga, Jinshi Huang, Charles Bai, 2022. Sustainable ai: Environmental implications, challenges and opportunities. Proceedings of Machine Learning and Systems 4 (2022), 795–813.
[47]
Tiankai Xie, Yuxin Ma, Jian Kang, Hanghang Tong, and Ross Maciejewski. 2022. FairRankVis: A Visual Analytics Framework for Exploring Algorithmic Fairness in Graph Mining Models. IEEE Transactions on Visualization and Computer Graphics 28, 1 (2022), 368–377. https://doi.org/10.1109/TVCG.2021.3114850
[48]
Taewon Yoo, Minki Chun, Yunjung Bae, Soohyun Kwon, and Hyunggu Jung. 2022. Exploring the Community of Model Publishers on TensorFlow Hub. In Companion Publication of the 2022 Conference on Computer Supported Cooperative Work and Social Computing (Virtual Event, Taiwan) (CSCW’22 Companion). Association for Computing Machinery, New York, NY, USA, 63–67. https://doi.org/10.1145/3500868.3559477
[49]
Tianyi Zhang, Cuiyun Gao, Lei Ma, Michael Lyu, and Miryung Kim. 2019. An Empirical Study of Common Challenges in Developing Deep Learning Applications. In 2019 IEEE 30th International Symposium on Software Reliability Engineering (ISSRE). IEEE, Berlin, Germany, 104–115. https://doi.org/10.1109/ISSRE.2019.00020
[50]
Henghui Zhao, Yanhui Li, Fanwei Liu, Xiaoyuan Xie, and Lin Chen. 2021. State and tendency: an empirical study of deep learning question&answer topics on Stack Overflow. Science China Information Sciences 64 (11 2021), 212105. https://doi.org/10.1007/s11432-019-3018-6
[51]
Mingrui Zhuang, Zhonghua Chen, Hongkai Wang, Hong Tang, Jiang He, Bobo Qin, Yuxin Yang, Xiaoxian Jin, Mengzhu Yu, Baitao Jin, Taijing Li, and Lauri Kettunen. 2022. AnatomySketch: An Extensible Open-Source Software Platform for Medical Image Analysis Algorithm Development. Journal of Digital Imaging 35, 6 (June 2022), 1623–1633. https://doi.org/10.1007/s10278-022-00660-5

Index Terms

  1. Visualizing the Carbon Intensity of Machine Learning Inference for Image Analysis on TensorFlow Hub

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    CSCW '23 Companion: Companion Publication of the 2023 Conference on Computer Supported Cooperative Work and Social Computing
    October 2023
    596 pages
    ISBN:9798400701290
    DOI:10.1145/3584931
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 14 October 2023

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. TensorFlow Hub
    2. carbon intensity
    3. inference
    4. online communities

    Qualifiers

    • Research-article
    • Research
    • Refereed limited

    Funding Sources

    Conference

    CSCW '23
    Sponsor:

    Acceptance Rates

    Overall Acceptance Rate 2,235 of 8,521 submissions, 26%

    Upcoming Conference

    CSCW '25

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • 0
      Total Citations
    • 335
      Total Downloads
    • Downloads (Last 12 months)225
    • Downloads (Last 6 weeks)22
    Reflects downloads up to 20 Jan 2025

    Other Metrics

    Citations

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    HTML Format

    View this article in HTML Format.

    HTML Format

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media