skip to main content
10.1145/3239235.3239240acmconferencesArticle/Chapter ViewAbstractPublication PagesesemConference Proceedingsconference-collections
research-article

An exploratory study of software sustainability dimensions and characteristics: end user perspectives in the kingdom of Saudi Arabia (KSA)

Published:11 October 2018Publication History

ABSTRACT

Background: Sustainability has become an important topic globally and the focus on ICT sustainability is increasing. However, issues exist, including vagueness and complexity of the concept itself, in addition to immaturity of the Software Engineering (SE) field. Aims: The study surveys respondents on software sustainability dimensions and characteristics from their perspectives, and seeks to derive rankings for their priority. Method: An exploratory study was conducted to quantitatively investigate Saudi Arabian (KSA) software user's perceptions with regard to the concept itself, the dimensions and characteristics of the software sustainability. Survey data was gathered from 906 respondents. Results: The results highlight key dimensions for sustainability and their priorities to users. The results also indicate that the characteristics perceived to be the most significant, were security, usability, reliability, maintainability, extensibility and portability, whereas respondents were relatively less concerned with computer ethics (e.g. privacy and trust), functionality, efficiency and reusability. A key finding was that females considered the environmental dimension to be more important than males. Conclusions: The dimensions and characteristics identified here can be used as a means of providing valuable feedback for the planning and implementation of future development of sustainable software.

References

  1. Oxford Dictionary, "Oxford Dictionary," 2018. {Online}. Available: https://en.oxforddictionaries.com/definition/sustainability. {Accessed: 05-Jun-2018}.Google ScholarGoogle Scholar
  2. M. L. Weitzman, "Sustainability and Technical Progress," Scand. J. Econ., vol. 99, no. 1, pp. 1--13, Mar. 1997.Google ScholarGoogle ScholarCross RefCross Ref
  3. C. Venters, C. Jay, L. M. S. Lau, M. K. Griffiths, V. Holmes, R. R. Ward, J. Austin, C. E. Dibsdale, and J. Xu, "Software sustainability: The modern tower of babel," in Third International Workshop on Requirements Engineering for Sustainable Systems, 2014, pp. 7--12.Google ScholarGoogle Scholar
  4. L. Sheldrick, "Designing Ubiquitous Sustainability into Product Design Processes," Loughborough University, 2015.Google ScholarGoogle Scholar
  5. C. C. Venters, L. Lau, M. K. Griffiths, V. Holmes, R. R. Ward, C. Jay, C. E. Dibsdale, and J. Xu, "The Blind Men and the Elephant Towards an Empirical Evaluation Framework for Software Sustainability," J. Open Res. Softw., vol. 2, no. 1, pp. 1--6, 2014.Google ScholarGoogle ScholarCross RefCross Ref
  6. G. Rodriguez-Navas, L. Duboc, S. Betz, R. Chitchyan, B. Penzenstadler, and C. C. Venters, "Safety vs. Sustainability Design: Analogies, Differences and Potential Synergies," in Fourth International Workshop on Requirements Engineering for Sustainable Systems (RE4SuSy), 2015, pp. 25--34.Google ScholarGoogle Scholar
  7. S. Rogers, K. Gardner, and C. Carlson, "Social Capital and Walkability as Social Aspects of Sustainability," Sustainability, vol. 5, no. 8, pp. 3473--3483, Aug. 2013.Google ScholarGoogle ScholarCross RefCross Ref
  8. C. Calero and M. Piattini, Green in Software Engineering, 1st ed. Cham: Springer, 2015. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. C. Calero and M. Piattini, "Introduction to Green in Software Engineering," in Green in Software Engineering, 1st ed., Calero et al., Ed. Cham: Springer International Publishing, 2015, pp. 3--27.Google ScholarGoogle Scholar
  10. G. A. G. Mireles, M. A. Moraga, F. Garcia, and M. Piattini, "A classification approach of sustainability aware requirements methods," in 2017 12th Iberian Conference on Information Systems and Technologies (CISTI), 2017, pp. 1--6.Google ScholarGoogle Scholar
  11. S. A. Koçak, G. I. Alptekin, and A. B. Bener, "Integrating Environmental Sustainability in Software Product Quality," in the Fourth International Workshop on Requirements Engineering for Sustainable Systems, 2015, pp. 17--24.Google ScholarGoogle Scholar
  12. J. Kasurinen, M. Palacin-Silva, and E. Vanhala, "What Concerns Game Developers? A Study on Game Development Processes, Sustainability and Metrics," in 2017 IEEE/ACM 8th Workshop on Emerging Trends in Software Metrics (WETSoM), 2017, pp. 15--21. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. T. R. D. Saputri and S. Lee, "Incorporating Sustainability Design in Requirements Engineering Process: A Preliminary Study," in Third Asia-Pacific Symposium, APRES 2016, 2016, pp. 53--67.Google ScholarGoogle Scholar
  14. S. Druskat, "A Proposal for the Measurement and Documentation of Research Software Sustainability in Interactive Metadata Repositories," in 4th Workshop on Sustainable Software for Science: Practice and Experiences, 2016, pp. 12--14.Google ScholarGoogle Scholar
  15. M. Salam and S. U. Khan, "Challenges in the development of green and sustainable software for software multisourcing vendors: Findings from a systematic literature review and industrial survey," J. Softw. Evol. Process, no. December 2017, p. e1939, Feb. 2018.Google ScholarGoogle Scholar
  16. C. Calero, M. F. Bertoa, and M. A. Moraga, "A systematic literature review for software sustainability measures," in 2013 2nd International Workshop on Green and Sustainable Software (GREENS), 2013, pp. 46--53. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. B. Penzenstadler, V. Bauer, C. Calero, and X. Franch, "Sustainability in software engineering: a systematic literature review," in 16th International Conference on Evaluation & Assessment in Software Engineering (EASE 2012), 2012, pp. 32--41.Google ScholarGoogle Scholar
  18. R. Ahmad, F. Baharom, and A. Hussain, "A Systematic Literature Review on Sustainability Studies in Software Engineering," in KMICe, 2014.Google ScholarGoogle Scholar
  19. B. Penzenstadler, A. Raturi, D. Richardson, C. Calero, H. Femmer, and X. Franch, "Systematic mapping study on software engineering for sustainability (SE4S)," in Proceedings of the 18th International Conference on Evaluation and Assessment in Software Engineering - EASE '14, 2014, no. May, pp. 1--14. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. K. R. Berntsen, M. R. Olsen, N. Limbu, A. T. Tran, and R. Colomo-Palacios, "Sustainability in Software Engineering - A Systematic Mapping," in Trends and Applications in Software Engineering-Proceedings of CIMPS 2016, 537th ed. Cham: Springer, 2017, pp. 23--32.Google ScholarGoogle Scholar
  21. G. A. García-Mireles, "Environmental Sustainability in Software Process Improvement: a Systematic Mapping Study," in Trends and Applications in Software Engineering- Proceedings of CIMPS 2016, 537th ed., Cham: Springer, 2017, pp. 69--78.Google ScholarGoogle Scholar
  22. G. A. García-Mireles, M. Á. Moraga, F. García, C. Calero, and M. Piattini, "Interactions between environmental sustainability goals and software product quality: A mapping study," Inf. Softw. Technol., vol. 95, no. April 2017, pp. 108--129, Mar. 2018.Google ScholarGoogle ScholarCross RefCross Ref
  23. G. A. García-Mireles and H. A. Villa-Martínez, "Practices for Addressing Environmental Sustainability through Requirements Processes," in Advances in Intelligent Systems and Computing, vol. 688, 2018, pp. 61--70.Google ScholarGoogle ScholarCross RefCross Ref
  24. C. C. Venters, N. Seyff, C. Becker, S. Betz, R. Chitchyan, L. Duboc, D. Mcmtyre, and B. Penzenstadler, "Characterising Sustainability Requirements: A New Species Red Herring or Just an Odd Fish?," in 2017 IEEE/ACM 39th International Conference on Software Engineering: Software Engineering in Society Track (ICSE-SEIS), 2017, pp. 3--12. Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. A. Aldabjan, R. Haines, and C. Jay, "How should we measure the relationship between code quality and software sustainability?," in WSSSPE4, 2016, pp. 1--2.Google ScholarGoogle Scholar
  26. S. Alhozaimy, R. Haines, and C. Jay, "Track 1 Lightning Talk : Forking as a Tool for Software Sustainability: An Empirical Study," in WSSSPE5.1, 2017, pp. 10--12.Google ScholarGoogle Scholar
  27. F. Ahmed, H. Mahmood, and A. Aslam, "Green computing and Software Defects in open source software: An Empirical study," in 2014 International Conference on Open Source Systems & Technologies, 2014, pp. 65--69.Google ScholarGoogle Scholar
  28. C. M. Schweik and E. Raymond, "Sustainability in Open Source Software Commons : Lessons Learned from an Empirical Study of SourceForge Projects," Technol. Innov. Manag. Rev., vol. 3, no. 1, pp. 13--19, 2013.Google ScholarGoogle ScholarCross RefCross Ref
  29. J. Long and M. J. Yuan, "Are All Open Source Projects Created Equal? Understanding the Sustainability of Open Source Software Development Model," in AMCIS 2005, 2005, p. 435.Google ScholarGoogle Scholar
  30. S. A. Oyedeji, "Early Investigation Towards Defining and Measuring Sustainability as a Quality Attribute in Software Systems," Master Thesis, Lappeenranta University of Technology, 2016.Google ScholarGoogle Scholar
  31. M. Mohankumar and M. A. KUMAR, "Empirical Study on Green and Sustainable Software Engineering," in 14th International Conference on Software Engineering, Parallel and Distributed Systems · SEPADS 2015, 2015, pp. 95--105.Google ScholarGoogle Scholar
  32. E. Kern, M. Dick, S. Naumann, and A. Filler, "Labelling Sustainable Software Products and Websites : Ideas, Approaches, and Challenges," in 29th International Conference on Informatics for Environmental Protection, 2015, pp. 82--91.Google ScholarGoogle Scholar
  33. R. Chitchyan, C. Becker, S. Betz, L. Duboc, B. Penzenstadler, N. Seyff, and C. C. Venters, "Sustainability design in requirements engineering: state of practice," in 38th International Conference on Software Engineering Companion (ICSE '16), 2016, pp. 533--542. Google ScholarGoogle ScholarDigital LibraryDigital Library
  34. B. Penzenstadler and H. Femmer, "A generic model for sustainability with process- and product-specific instances," in Proceedings of the 2013 workshop on Green in/by software engineering - GIBSE '13, 2013, pp. 3--8. Google ScholarGoogle ScholarDigital LibraryDigital Library
  35. N. Condori-Fernandez and P. Lago, "Characterizing the contribution of quality requirements to software sustainability," J. Syst. Softw., vol. 137, pp. 289--305, Mar. 2018.Google ScholarGoogle ScholarCross RefCross Ref
  36. P. Lago, S. A. Koçak, I. Crnkovic, and B. Penzenstadler, "Framing sustainability as a property of software quality," Commun. ACM, vol. 58, no. 10, pp. 70--78, Sep. 2015. Google ScholarGoogle ScholarDigital LibraryDigital Library
  37. I. Groher and R. Weinreich, "An Interview Study on Sustainability Concerns in Software Development Projects," in 2017 43rd Euromicro Conference on Software Engineering and Advanced Applications (SEAA), 2017, pp. 350--358.Google ScholarGoogle Scholar
  38. G. Burford, E. Hoover, I. Velasco, S. Janoušková, A. Jimenez, G. Piggot, D. Podger, and M. Harder, "Bringing the `Missing Pillar' into Sustainable Development Goals: Towards Intersubjective Values-Based Indicators," Sustainability, vol. 5, no. 7, pp. 3035--3059, Jul. 2013.Google ScholarGoogle ScholarCross RefCross Ref
  39. B. Littig and E. Grießler, "Social sustainability: a catchword between political pragmatism and social theory," Int. J. Sustain. Dev., vol. 8, no. 1/2, pp. 65--79, 2005.Google ScholarGoogle ScholarCross RefCross Ref
  40. M. Al Hinai, "Quantification of social sustainability in software," in 2014 IEEE 22nd International Requirements Engineering Conference (RE), 2014, pp. 456--460.Google ScholarGoogle Scholar
  41. N. Duxbury, E. Gillette, and K. Pepper, "Exploring the Cultural Dimensions of Sustainability," 2007. {Online}. Available: https://www.creativecity.ca/publications/ccnc-special-editions.php. {Accessed: 23-Dec-2017}.Google ScholarGoogle Scholar
  42. British Standards Institution, "BS 6079-1:2010: BSI Standards Publication Project management - Part 1 : Principles and guidelines for the management of projects." British Standards Institution, London, England, p. 72, 2010.Google ScholarGoogle Scholar
  43. C. Davino and L. Fabbris, Survey Data Collection and Integration, 1st ed. Berlin: Springer, 2013.Google ScholarGoogle ScholarCross RefCross Ref
  44. M. R. De Souza, R. Haines, and C. Jay, "Defining Sustainability through Developers' Eyes : Recommendations from an Interview Study," Manchester, 2014.Google ScholarGoogle Scholar
  45. M. L. Gibson, C. C. Venters, L. Duboc, S. Betz, R. Chitchyan, M. Palacin-Silva, B. Penzenstadler, and N. Seyff, "Mind the Chasm: A FishEye Lens View of Sustainable Software Engineering in UK Higher Education," in 6th International Workshop on Requirements Engineering for Sustainable Systems, 2017, pp. 15--24.Google ScholarGoogle Scholar
  46. R. Chitchyan, I. Groher, and J. Noppen, "Uncovering sustainability concerns in software product lines," J. Softw. Evol. Process, vol. 29, no. 2, p. e1853, Feb. 2017.Google ScholarGoogle ScholarCross RefCross Ref
  47. C. Calero, M. A. Moraga, and M. F. Bertoa, "Towards a Software Product Sustainability Model," WSSSPE'1: First workshop on sustainable software for science: practice and experiences, 2013. {Online}. Available: http://wssspe.researchcomputing.org.uk/. {Accessed: 26-May-2016}.Google ScholarGoogle Scholar
  48. H. Hygerth, "Sustainable Software Engineering: An Investigation Into the Technical Sustainability Dimension," KTH Royal Institute of Technology, 2016.Google ScholarGoogle Scholar
  49. C. Becker, R. Chitchyan, L. Duboc, S. Easterbrook, B. Penzenstadler, N. Seyff, and C. C. Venters, "Sustainability Design and Software: The Karlskrona Manifesto," in 2015 IEEE/ACM 37th IEEE International Conference on Software Engineering, 2015, vol. 2, pp. 467--476. Google ScholarGoogle ScholarDigital LibraryDigital Library
  50. R. Ferenc, L. Lango, I. Siket, T. Gyimothy, and T. Bakota, "Source Meter Sonar Qube Plug-in," in 2014 IEEE 14th International Working Conference on Source Code Analysis and Manipulation, 2014, pp. 77--82. Google ScholarGoogle ScholarDigital LibraryDigital Library
  51. C. Raibulet and F. A. Fontana, "Collaborative and Teamwork Software Development in an Undergraduate Software Engineering Course," J. Syst. Softw., Jul. 2018.Google ScholarGoogle ScholarDigital LibraryDigital Library
  52. J. Yli-Huumo, A. Maglyas, and K. Smolander, "How do software development teams manage technical debt? - An empirical study," J. Syst. Softw., vol. 120, pp. 195--218, Oct. 2016. Google ScholarGoogle ScholarDigital LibraryDigital Library
  53. N. Wolfram, P. Lago, and F. Osborne, "Sustainability in Software Engineering," in SustainIT 2017, 2017, pp. 1--5.Google ScholarGoogle Scholar
  54. C. B. Seaman, "Qualitative methods in empirical studies of software engineering," IEEE Trans. Softw. Eng., vol. 25, no. 4, pp. 557--572, 1999. Google ScholarGoogle ScholarDigital LibraryDigital Library
  55. A. N. Ghazi, K. Petersen, S. S. V. R. Reddy, and H. Nekkanti, "Survey Research in Software Engineering: Problems and Strategies," e-Informatica Softw. Eng. J., no. February, 2017.Google ScholarGoogle Scholar
  56. J. Cummings and C. Sibona, "Crowdsourcing Surveys: Alternative Approaches to Survey Collection," J. Inf. Syst. Appl. Res., vol. 10, no. 1, pp. 44--54, 2017.Google ScholarGoogle Scholar
  57. P. V. Marsden and J. D. Wright, Handbook of Survey Research, 2nd ed. Bingley: Emerald Group Publishing Limited, 2010.Google ScholarGoogle Scholar
  58. J. Hair, M. Wolfinbarger, D. Ortinau, and R. Bush, Essentials of Marketing Research, 2nd ed. New York: McGraw-Hill/Irwin, 2010.Google ScholarGoogle Scholar
  59. C. Wohlin, P. Runeson, M. Höst, M. C. Ohlsson, B. Regnell, and A. Wesslén, Experimentation in Software Engineering, 1st ed. Berlin: Springer, 2012. Google ScholarGoogle ScholarDigital LibraryDigital Library
  60. N. Duxbury and E. Gillette, "Culture as a Key Dimension of Sustainability: Exploring Concepts, Themes, and Models," Vancouver, Canada, 1, 2007.Google ScholarGoogle Scholar
  61. C. Calero, M. Bertoa, and M. Moraga, "Sustainability and quality: Icing on the cake," in In Proceedings of the 2013 Workshop on Requirements Engineering for Sustainable Systems, 2013, pp. 50--59.Google ScholarGoogle Scholar
  62. K. Roher and D. Richardson, "Sustainability requirement patterns," in 2013 3rd International Workshop on Requirements Patterns (RePa), 2013, pp. 8--11.Google ScholarGoogle Scholar
  63. M. Al Hinai and R. Chitchyan, "Engineering Requirements for Social Sustainability," in 4th International Conference on ICT for Sustainability (ICT4S 2016), 2016, pp. 79--88.Google ScholarGoogle Scholar
  64. M. Al Hinai and R. Chitchyan, "Social sustainability indicators for software: Initial review," CEUR Workshop Proc., vol. 1216, pp. 21--27, 2014.Google ScholarGoogle Scholar
  65. M. Al Hinai and R. Chitchyan, "Building social sustainability into software: Case of equality," in 2015 IEEE Fifth International Workshop on Requirements Patterns (RePa), 2015, pp. 32--38. Google ScholarGoogle ScholarDigital LibraryDigital Library
  66. R. Ahmad, A. Hussain, and F. Baharom, "Goal Oriented Measurement for Software Sustainable Evaluation Metric Focused on Environmental Dimension," in KMICe, 2016, no. August, pp. 405--410.Google ScholarGoogle Scholar
  67. I. Manotas, C. Bird, R. Zhang, D. Shepherd, C. Jaspan, C. Sadowski, L. Pollock, and J. Clause, "An empirical study of practitioners' perspectives on green software engineering," in ICSE '16, 2016, pp. 237--248. Google ScholarGoogle ScholarDigital LibraryDigital Library
  68. P. Stoll, "Exploring Sustainable Industrial Software System Development within the Software Architecture Environment," Malardalen University, 2009.Google ScholarGoogle Scholar
  69. D. Torre, G. Procaccianti, D. Fucci, S. Lutovac, and G. Scanniello, "On the Presence of Green and Sustainable Software Engineering in Higher Education Curricula," in 1st International Workshop on Software Engineering Curricula for Millennials, 2017, pp. 54--60. Google ScholarGoogle ScholarDigital LibraryDigital Library
  70. B. Singh and S. P. Kannojia, "A Review on Software Quality Models," in 2013 International Conference on Communication Systems and Network Technologies, 2013, pp. 801--806. Google ScholarGoogle ScholarDigital LibraryDigital Library
  71. B. Penzenstadler, A. Raturi, D. Richardson, and B. Tomlinson, "Safety, Security, Now Sustainability: The Nonfunctional Requirement for the 21st Century," IEEE Softw., vol. 31, no. 3, pp. 40--47, May 2014.Google ScholarGoogle ScholarCross RefCross Ref
  72. A. Holzinger, "Usability engineering methods for software developers," Commun ACM, vol. 48, no. 1, pp. 71--74, Jan. 2005. Google ScholarGoogle ScholarDigital LibraryDigital Library
  73. C. Braz, A. Seffah, and D. M'Raihi, "Designing a Trade-Off Between Usability and Security: A Metrics Based-Model," in Human-Computer Interaction - INTERACT 2007, 2007, pp. 114--126. Google ScholarGoogle ScholarDigital LibraryDigital Library
  74. E. C. Groen, S. Kopczynska, M. P. Hauer, T. D. Krafft, and J. Doerr, "Users --- The Hidden Software Product Quality Experts?: A Study on How App Users Report Quality Aspects in Online Reviews," in 2017 IEEE 25th International Requirements Engineering Conference (RE), 2017, pp. 80--89.Google ScholarGoogle Scholar
  75. B. Penzenstadler, M. Khurum, and K. Petersen, "Towards Incorporating Sustainability while Taking Software Product Management Decisions," in International Workshop on Software Product Management (IWSPM 2013), 2013.Google ScholarGoogle Scholar
  76. R. C. Seacord, J. Elm, W. Goethert, G. A. Lewis, D. Plakosh, J. Robert, L. Wrage, and M. Lindvall, "Measuring software sustainability," in ICSM 2003., 2003, pp. 450--459. Google ScholarGoogle ScholarDigital LibraryDigital Library
  77. C. C. Venters, R. Capilla, S. Betz, B. Penzenstadler, T. Crick, S. Crouch, E. Y. Nakagawa, C. Becker, and C. Carrillo, "Software sustainability: Research and practice from a software architecture viewpoint," J. Syst. Softw., vol. 138, pp. 174--188, Apr. 2018.Google ScholarGoogle ScholarCross RefCross Ref
  78. N. Amsel, Z. Ibrahim, A. Malik, and B. Tomlinson, "Toward sustainable software engineering," in ICSE '11, 2011, pp. 976--979. Google ScholarGoogle ScholarDigital LibraryDigital Library
  79. M. Z. Huber, L. M. Hilty, and M. Glinz, "Uncovering sustainability requirements: An exploratory case study in canteens," in Fourth International Workshop on Requirements Engineering for Sustainable Systems, 2015, pp. 35--44.Google ScholarGoogle Scholar

Index Terms

  1. An exploratory study of software sustainability dimensions and characteristics: end user perspectives in the kingdom of Saudi Arabia (KSA)

      Recommendations

      Comments

      Login options

      Check if you have access through your login credentials or your institution to get full access on this article.

      Sign in
      • Published in

        cover image ACM Conferences
        ESEM '18: Proceedings of the 12th ACM/IEEE International Symposium on Empirical Software Engineering and Measurement
        October 2018
        487 pages
        ISBN:9781450358231
        DOI:10.1145/3239235

        Copyright © 2018 ACM

        Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        • Published: 11 October 2018

        Permissions

        Request permissions about this article.

        Request Permissions

        Check for updates

        Qualifiers

        • research-article

        Acceptance Rates

        Overall Acceptance Rate130of594submissions,22%

      PDF Format

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader