skip to main content
10.1145/3624007.3624058acmconferencesArticle/Chapter ViewAbstractPublication PagesgpceConference Proceedingsconference-collections
research-article

Unleashing the Power of Implicit Feedback in Software Product Lines: Benefits Ahead

Published:22 October 2023Publication History

ABSTRACT

Software Product Lines (SPLs) facilitate the development of a complete range of software products through systematic reuse. Reuse involves not only code but also the transfer of knowledge gained from one product to others within the SPL. This transfer includes bug fixing, which, when encountered in one product, affects the entire SPL portfolio. Similarly, feedback obtained from the usage of a single product can inform beyond that product to impact the entire SPL portfolio. Specifically, implicit feedback refers to the automated collection of data on software usage or execution, which allows for the inference of customer preferences and trends. While implicit feedback is commonly used in single-product development, its application in SPLs has not received the same level of attention. This paper promotes the investigation of implicit feedback in SPLs by identifying a set of SPL activities that can benefit the most from it. We validate this usefulness with practitioners using a questionnaire-based approach (n=8). The results provide positive insights into the advantages and practical implications of adopting implicit feedback at the SPL level.

References

  1. Mustafa Al-Hajjaji, Thomas Thüm, Malte Lochau, Jens Meinicke, and Gunter Saake. 2019. Effective product-line testing using similarity-based product prioritization. Softw. Syst. Model., 18, 1 (2019), 499–521. https://doi.org/10.1007/s10270-016-0569-2 Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Hamad I. Alsawalqah, Sungwon Kang, and Jihyun Lee. 2014. A method to optimize the scope of a software product platform based on end-user features. J. Syst. Softw., 98 (2014), 79–106. https://doi.org/10.1016/j.jss.2014.08.034 Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Maurizio Astegher, Paolo Busetta, Anna Perini, and Angelo Susi. 2021. Specifying Requirements for Data Collection and Analysis in Data-Driven RE. A Research Preview. In Requirements Engineering: Foundation for Software Quality - 27th International Working Conference, REFSQ 2021, Essen, Germany, April 12-15, 2021, Proceedings, Fabiano Dalpiaz and Paola Spoletini (Eds.) (Lecture Notes in Computer Science, Vol. 12685). Springer, 182–188. https://doi.org/10.1007/978-3-030-73128-1_13 Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Goetz Botterweck and Andreas Pleuss. 2014. Evolution of Software Product Lines. In Evolving Software Systems, Tom Mens, Alexander Serebrenik, and Anthony Cleve (Eds.). Springer, 265–295. https://doi.org/10.1007/978-3-642-45398-4_9 Google ScholarGoogle ScholarCross RefCross Ref
  5. Victor R Basili1 Gianluigi Caldiera and H Dieter Rombach. 1994. The goal question metric approach. Encyclopedia of software engineering, 528–532. Google ScholarGoogle Scholar
  6. Houssem Chemingui, Camille Salinesi, Inès Gam, Raul Mazo, and Henda Ghezala. 2021. Devising Configuration Guidance with Process Mining Support. Google ScholarGoogle Scholar
  7. Paul Clements and Linda M. Northrop. 2002. Software product lines - practices and patterns. Addison-Wesley. isbn:978-0-201-70332-0 Google ScholarGoogle Scholar
  8. Anas Dakkak, David Issa Mattos, and Jan Bosch. 2021. Perceived benefits of Continuous Deployment in Software-Intensive Embedded Systems. In IEEE 45th Annual Computers, Software, and Applications Conference, COMPSAC 2021, Madrid, Spain, July 12-16, 2021. IEEE, 934–941. https://doi.org/10.1109/COMPSAC51774.2021.00126 Google ScholarGoogle ScholarCross RefCross Ref
  9. Anas Dakkak, Hongyi Zhang, David Issa Mattos, Jan Bosch, and Helena Holmström Olsson. 2021. Towards Continuous Data Collection from In-service Products: Exploring the Relation Between Data Dimensions and Collection Challenges. In 28th Asia-Pacific Software Engineering Conference, APSEC 2021, Taipei, Taiwan, December 6-9, 2021. IEEE, 243–252. https://doi.org/10.1109/APSEC53868.2021.00032 Google ScholarGoogle ScholarCross RefCross Ref
  10. Oscar Díaz, Raul Medeiros, and Mustafa Al-Hajjaji. 2023. How can feature usage be tracked across product variants? Implicit Feedback in Software Product Lines. 43. arxiv:2309.04278 Manuscript submitted for publication Google ScholarGoogle Scholar
  11. Sebastian Eder, Henning Femmer, Benedikt Hauptmann, and Maximilian Junker. 2014. Which Features Do My Users (Not) Use? In 30th IEEE International Conference on Software Maintenance and Evolution, Victoria, BC, Canada, September 29 - October 3, 2014. IEEE Computer Society, 446–450. https://doi.org/10.1109/ICSME.2014.71 Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. José Angel Galindo, David Benavides, Pablo Trinidad, Antonio Manuel Gutiérrez-Fernández, and Antonio Ruiz-Cortés. 2019. Automated analysis of feature models: Quo vadis? Computing, 101, 5 (2019), 387–433. https://doi.org/10.1007/s00607-018-0646-1 Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Loveleen Gaur, Gurinder Singh, Jeyta, and Shubhankar Kumar. 2016. Google Analytics: A Tool to make websites more Robust. In ICTCS. 45:1–45:7. https://doi.org/10.1145/2905055.2905251 Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Ruben Heradio, David Fernandez-Amoros, José A Galindo, David Benavides, and Don Batory. 2022. Uniform and scalable sampling of highly configurable systems. Empirical Software Engineering, 27, 2 (2022), 44. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Philipp Hoffmann, Kai Spohrer, and Armin Heinzl. 2020. Analyzing Usage Data in Enterprise Cloud Software: An Action Design Research Approach. Springer International Publishing, Cham. 257–274. isbn:978-3-030-45819-5 https://doi.org/10.1007/978-3-030-45819-5_11 Google ScholarGoogle ScholarCross RefCross Ref
  16. José Miguel Horcas, Mónica Pinto, and Lidia Fuentes. 2023. Empirical analysis of the tool support for software product lines. Softw. Syst. Model., 22, 1 (2023), 377–414. https://doi.org/10.1007/s10270-022-01011-2 Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Jan Ole Johanssen, Anja Kleebaum, Bernd Bruegge, and Barbara Paech. 2018. Feature Crumbs: Adapting Usage Monitoring to Continuous Software Engineering. In Product-Focused Software Process Improvement - 19th International Conference, PROFES 2018, Wolfsburg, Germany, November 28-30, 2018, Proceedings, Marco Kuhrmann, Kurt Schneider, Dietmar Pfahl, Sousuke Amasaki, Marcus Ciolkowski, Regina Hebig, Paolo Tell, Jil Klünder, and Steffen Küpper (Eds.) (Lecture Notes in Computer Science, Vol. 11271). Springer, 263–271. https://doi.org/10.1007/978-3-030-03673-7_19 Google ScholarGoogle ScholarCross RefCross Ref
  18. Jan Ole Johanssen, Anja Kleebaum, Bernd Bruegge, and Barbara Paech. 2019. How do Practitioners Capture and Utilize User Feedback During Continuous Software Engineering? In 27th IEEE International Requirements Engineering Conference, RE 2019, Jeju Island, Korea (South), September 23-27, 2019, Daniela E. Damian, Anna Perini, and Seok-Won Lee (Eds.). IEEE, 153–164. https://doi.org/10.1109/RE.2019.00026 Google ScholarGoogle ScholarCross RefCross Ref
  19. Azaz Ahmed Kiani, Yaser Hafeez, Muhammad Imran, and Sadia Ali. 2021. A dynamic variability management approach working with agile product line engineering practices for reusing features. J. Supercomput., 77, 8 (2021), 8391–8432. https://doi.org/10.1007/s11227-021-03627-5 Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. Charles W. Krueger. 2006. New methods in software product line practice. Commun. ACM, 49, 12 (2006), 37–40. https://doi.org/10.1145/1183236.1183262 Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. Luciano Marchezan, Elder Rodrigues, Wesley Klewerton Guez Assunção, Maicon Bernardino, Fábio Paulo Basso, and João Carbonell. 2022. Software product line scoping: A systematic literature review. J. Syst. Softw., 186 (2022), 111189. https://doi.org/10.1016/j.jss.2021.111189 Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Jabier Martinez, Daniel Strüber, José Miguel Horcas, Alexandru Burdusel, and Steffen Zschaler. 2022. Acapulco: an extensible tool for identifying optimal and consistent feature model configurations. In SPLC ’22: 26th ACM International Systems and Software Product Line Conference, Graz, Austria, September 12 - 16, 2022, Volume B, Alexander Felfernig, Lidia Fuentes, Jane Cleland-Huang, Wesley K. G. Assunção, Clément Quinton, Jianmei Guo, Klaus Schmid, Marianne Huchard, Inmaculada Ayala, José Miguel Rojas, Viet-Man Le, and José Miguel Horcas (Eds.). ACM, 50–53. https://doi.org/10.1145/3503229.3547067 Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. Silverio Martínez-Fernández, Anna Maria Vollmer, Andreas Jedlitschka, Xavier Franch, Lidia López, Prabhat Ram, Pilar Rodríguez, Sanja Aaramaa, Alessandra Bagnato, Michal Choras, and Jari Partanen. 2019. Continuously Assessing and Improving Software Quality With Software Analytics Tools: A Case Study. IEEE Access, 7 (2019), 68219–68239. https://doi.org/10.1109/ACCESS.2019.2917403 Google ScholarGoogle ScholarCross RefCross Ref
  24. Sarah Nadi, Thorsten Berger, Christian Kästner, and Krzysztof Czarnecki. 2015. Where Do Configuration Constraints Stem From? An Extraction Approach and an Empirical Study. IEEE Trans. Software Eng., 41, 8 (2015), 820–841. https://doi.org/10.1109/TSE.2015.2415793 Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. Helena Holmström Olsson and Jan Bosch. 2013. Towards Data-Driven Product Development: A Multiple Case Study on Post-deployment Data Usage in Software-Intensive Embedded Systems. In Lean Enterprise Software and Systems - 4th International Conference, LESS 2013, Galway, Ireland, December 1-4, 2013, Proceedings, Brian Fitzgerald, Kieran Conboy, Ken Power, Ricardo Valerdi, Lorraine Morgan, and Klaas-Jan Stol (Eds.) (Lecture Notes in Business Information Processing, Vol. 167). Springer, 152–164. https://doi.org/10.1007/978-3-642-44930-7_10 Google ScholarGoogle ScholarCross RefCross Ref
  26. Helena Holmström Olsson and Jan Bosch. 2015. Towards Continuous Customer Validation: A Conceptual Model for Combining Qualitative Customer Feedback with Quantitative Customer Observation. In Software Business - 6th International Conference, ICSOB 2015, Braga, Portugal, June 10-12, 2015, Proceedings, João M. Fernandes, Ricardo J. Machado, and Krzysztof Wnuk (Eds.) (Lecture Notes in Business Information Processing, Vol. 210). Springer, 154–166. https://doi.org/10.1007/978-3-319-19593-3_13 Google ScholarGoogle ScholarCross RefCross Ref
  27. Marc Oriol, Melanie J. C. Stade, Farnaz Fotrousi, Sergi Nadal, Jovan Varga, Norbert Seyff, Alberto Abelló, Xavier Franch, Jordi Marco, and Oleg Schmidt. 2018. FAME: Supporting Continuous Requirements Elicitation by Combining User Feedback and Monitoring. In 26th IEEE International Requirements Engineering Conference, RE 2018, Banff, AB, Canada, August 20-24, 2018, Guenther Ruhe, Walid Maalej, and Daniel Amyot (Eds.). IEEE Computer Society, 217–227. https://doi.org/10.1109/RE.2018.00030 Google ScholarGoogle ScholarCross RefCross Ref
  28. Juliana Alves Pereira, Mathieu Acher, Hugo Martin, Jean-Marc Jézéquel, Goetz Botterweck, and Anthony Ventresque. 2021. Learning software configuration spaces: A systematic literature review. J. Syst. Softw., 182 (2021), 111044. https://doi.org/10.1016/j.jss.2021.111044 Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. Juliana Alves Pereira, Pawel Matuszyk, Sebastian Krieter, Myra Spiliopoulou, and Gunter Saake. 2018. Personalized recommender systems for product-line configuration processes. Comput. Lang. Syst. Struct., 54 (2018), 451–471. https://doi.org/10.1016/j.cl.2018.01.003 Google ScholarGoogle ScholarDigital LibraryDigital Library
  30. Daniel Strüber, Mukelabai Mukelabai, Jacob Krüger, Stefan Fischer, Lukas Linsbauer, Jabier Martinez, and Thorsten Berger. 2019. Facing the truth: benchmarking the techniques for the evolution of variant-rich systems. In Proceedings of the 23rd International Systems and Software Product Line Conference, SPLC 2019, Volume A, Paris, France, September 9-13, 2019, Thorsten Berger, Philippe Collet, Laurence Duchien, Thomas Fogdal, Patrick Heymans, Timo Kehrer, Jabier Martinez, Raúl Mazo, Leticia Montalvillo, Camille Salinesi, Xhevahire Tërnava, Thomas Thüm, and Tewfik Ziadi (Eds.). ACM, 26:1–26:12. https://doi.org/10.1145/3336294.3336302 Google ScholarGoogle ScholarDigital LibraryDigital Library
  31. Tassio Vale, Bruno Cabral, Loreno Freitas Matos Alvim, Larissa Rocha Soares, Alcemir Rodrigues Santos, Ivan do Carmo Machado, Iuri Santos Souza, Ivonei Freitas da Silva, and Eduardo Santana de Almeida. 2014. SPLICE: A Lightweight Software Product Line Development Process for Small and Medium Size Projects. In Eighth Brazilian Symposium on Software Components, Architectures and Reuse, SBCARS 2014, Maceió, Alagoas, Brazil, September 29-30, 2014. IEEE Computer Society, 42–52. https://doi.org/10.1109/SBCARS.2014.11 Google ScholarGoogle ScholarDigital LibraryDigital Library
  32. Simon van Oordt and Emitza Guzman. 2021. On the Role of User Feedback in Software Evolution: a Practitioners’ Perspective. In 29th IEEE International Requirements Engineering Conference, RE 2021, Notre Dame, IN, USA, September 20-24, 2021. IEEE, 221–232. https://doi.org/10.1109/RE51729.2021.00027 Google ScholarGoogle ScholarCross RefCross Ref
  33. Mahsa Varshosaz, Mustafa Al-Hajjaji, Thomas Thüm, Tobias Runge, Mohammad Reza Mousavi, and Ina Schaefer. 2018. A classification of product sampling for software product lines. In Proceeedings of the 22nd International Systems and Software Product Line Conference - Volume 1, SPLC 2018, Gothenburg, Sweden, September 10-14, 2018, Thorsten Berger, Paulo Borba, Goetz Botterweck, Tomi Männistö, David Benavides, Sarah Nadi, Timo Kehrer, Rick Rabiser, Christoph Elsner, and Mukelabai Mukelabai (Eds.). ACM, 1–13. https://doi.org/10.1145/3233027.3233035 Google ScholarGoogle ScholarDigital LibraryDigital Library
  34. Norha M. Villegas, Cristian Sánchez, Javier Díaz-Cely, and Gabriel Tamura. 2018. Characterizing context-aware recommender systems: A systematic literature review. Knowl. Based Syst., 140 (2018), 173–200. https://doi.org/10.1016/j.knosys.2017.11.003 Google ScholarGoogle ScholarDigital LibraryDigital Library
  35. Yu Zhou, Xinying Yang, Taolue Chen, Zhiqiu Huang, Xiaoxing Ma, and Harald C. Gall. 2022. Boosting API Recommendation With Implicit Feedback. IEEE Trans. Software Eng., 48, 6 (2022), 2157–2172. https://doi.org/10.1109/TSE.2021.3053111 Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Unleashing the Power of Implicit Feedback in Software Product Lines: Benefits Ahead

        Recommendations

        Comments

        Login options

        Check if you have access through your login credentials or your institution to get full access on this article.

        Sign in
        • Published in

          cover image ACM Conferences
          GPCE 2023: Proceedings of the 22nd ACM SIGPLAN International Conference on Generative Programming: Concepts and Experiences
          October 2023
          152 pages
          ISBN:9798400704062
          DOI:10.1145/3624007

          Copyright © 2023 ACM

          Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

          Publisher

          Association for Computing Machinery

          New York, NY, United States

          Publication History

          • Published: 22 October 2023

          Permissions

          Request permissions about this article.

          Request Permissions

          Check for updates

          Qualifiers

          • research-article

          Acceptance Rates

          Overall Acceptance Rate56of180submissions,31%
        • Article Metrics

          • Downloads (Last 12 months)61
          • Downloads (Last 6 weeks)3

          Other Metrics

        PDF Format

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader