skip to main content
10.1145/3510454.3522677acmconferencesArticle/Chapter ViewAbstractPublication PagesicseConference Proceedingsconference-collections
short-paper

Finding appropriate user feedback analysis techniques for multiple data domains

Published:19 October 2022Publication History

ABSTRACT

Software products now have more users than ever. This means more people to please, more use-cases to consider, and more requirements to fulfill. These users can then write feedback on software in any number of public or private online repositories. Many tools have been proposed for classifying, embedding, clustering, and characterizing this feedback in aid of generating requirements from it. I am investigating which techniques and machine learning models are most appropriate for enabling these analyses across multiple feedback platforms and data domains.

References

  1. David M Blei, Andrew Y Ng, and Michael I Jordan. 2003. Latent dirichlet allocation. the Journal of machine Learning research 3 (2003), 993--1022.Google ScholarGoogle Scholar
  2. Daniel Cer, Yinfei Yang, Sheng-yi Kong, Nan Hua, Nicole Limtiaco, Rhomni St John, Noah Constant, Mario Guajardo-Céspedes, Steve Yuan, Chris Tar, et al. 2018. Universal sentence encoder. arXiv preprint arXiv:1803.11175 (2018).Google ScholarGoogle Scholar
  3. Ning Chen, Jialiu Lin, Steven CH Hoi, Xiaokui Xiao, and Boshen Zhang. 2014. ARminer: mining informative reviews for developers from mobile app marketplace. In Proceedings of the 36th international conference on software engineering. 767--778.Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Adelina Ciurumelea, Andreas Schaufelbühl, Sebastiano Panichella, and Harald C Gall. 2017. Analyzing reviews and code of mobile apps for better release planning. In 2017 IEEE 24th International Conference on Software Analysis, Evolution and Reengineering (SANER). IEEE, 91--102.Google ScholarGoogle ScholarCross RefCross Ref
  5. Daniela Damian and James Chisan. 2006. An empirical study of the complex relationships between requirements engineering processes and other processes that lead to payoffs in productivity, quality, and risk management. IEEE Transactions on Software Engineering 32, 7 (2006), 433--453.Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Peter Devine, Yun Sing Koh, and Kelly Blincoe. 2021a. Evaluating Software User Feedback Classifiers on Unseen Apps, Datasets, and Metadata. arXiv:2112.13497 [cs.SE]Google ScholarGoogle Scholar
  7. Peter Devine, Yun Sing Koh, and Kelly Blincoe. 2021b. Evaluating Unsupervised Text Embeddings on Software User Feedback. In 2021 IEEE 29th International Requirements Engineering Conference Workshops (REW). IEEE, 87--95.Google ScholarGoogle Scholar
  8. Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2018. Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805 (2018).Google ScholarGoogle Scholar
  9. Venkatesh T Dhinakaran, Raseshwari Pulle, Nirav Ajmeri, and Pradeep K Murukannaiah. 2018. App review analysis via active learning: reducing supervision effort without compromising classification accuracy. In 2018 IEEE 26th international requirements engineering conference (RE). IEEE, 170--181.Google ScholarGoogle Scholar
  10. Kawin Ethayarajh. 2018. Unsupervised random walk sentence embeddings: A strong but simple baseline. In Proceedings of The Third Workshop on Representation Learning for NLP. 91--100.Google ScholarGoogle ScholarCross RefCross Ref
  11. Cuiyun Gao, Jichuan Zeng, Michael R Lyu, and Irwin King. 2018. Online app review analysis for identifying emerging issues. In Proceedings of the 40th International Conference on Software Engineering. 48--58.Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Cuiyun Gao, Jichuan Zeng, Zhiyuan Wen, David Lo, Xin Xia, Irwin King, and Michael R Lyu. 2020. Emerging App Issue Identification via Online Joint Sentiment-Topic Tracing. arXiv preprint arXiv:2008.09976 (2020).Google ScholarGoogle Scholar
  13. Emitza Guzman, Muhammad El-Haliby, and Bernd Bruegge. 2015. Ensemble methods for app review classification: An approach for software evolution (n). In 2015 30th IEEE/ACM International Conference on Automated Software Engineering (ASE). IEEE, 771--776.Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Karen Sparck Jones. 1972. A statistical interpretation of term specificity and its application in retrieval. Journal of documentation (1972).Google ScholarGoogle Scholar
  15. Mengmeng Lu and Peng Liang. 2017. Automatic classification of non-functional requirements from augmented app user reviews. In Proceedings of the 21st International Conference on Evaluation and Assessment in Software Engineering. 344--353.Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Walid Maalej, Zijad Kurtanović, Hadeer Nabil, and Christoph Stanik. 2016. On the automatic classification of app reviews. Requirements Engineering 21, 3 (2016), 311--331.Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Bashar Nuseibeh and Steve Easterbrook. 2000. Requirements engineering: a roadmap. In Proceedings of the Conference on the Future of Software Engineering. 35--46.Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Dennis Pagano and Walid Maalej. 2013. User feedback in the appstore: An empirical study. In 2013 21st IEEE international requirements engineering conference (RE). IEEE, 125--134.Google ScholarGoogle Scholar
  19. Sebastiano Panichella, Andrea Di Sorbo, Emitza Guzman, Corrado A Visaggio, Gerardo Canfora, and Harald C Gall. 2016. Ardoc: App reviews development oriented classifier. In Proceedings of the 2016 24th ACM SIGSOFT international symposium on foundations of software engineering. 1023--1027.Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. Sebastiano Panichella and Marcela Ruiz. 2020. Requirements-collector: automating requirements specification from elicitation sessions and user feedback. In 2020 IEEE 28th International Requirements Engineering Conference (RE). IEEE, 404--407.Google ScholarGoogle ScholarCross RefCross Ref
  21. Łukasz Radliński. 2012. Empirical analysis of the impact of requirements engineering on software quality. In International Working Conference on Requirements Engineering: Foundation for Software Quality. Springer, 232--238.Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Simone Scalabrino, Gabriele Bavota, Barbara Russo, Massimiliano Di Penta, and Rocco Oliveto. 2017. Listening to the crowd for the release planning of mobile apps. IEEE Transactions on Software Engineering 45, 1 (2017), 68--86.Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. Christoph Stanik, Tim Pietz, and Walid Maalej. 2021. Unsupervised Topic Discovery in User Comments. In 2021 IEEE 29th International Requirements Engineering Conference (RE). IEEE, 150--161.Google ScholarGoogle Scholar
  24. James Tizard, Tim Rietz, and Kelly Blincoe. 2020. Voice of the users: A demographic study of software feedback behaviour. In 2020 IEEE 28th International Requirements Engineering Conference (RE). IEEE, 55--65.Google ScholarGoogle ScholarCross RefCross Ref
  25. James Tizard, Hechen Wang, Lydia Yohannes, and Kelly Blincoe. 2019. Can a conversation paint a picture? mining requirements in software forums. In 2019 IEEE 27th International Requirements Engineering Conference (RE). IEEE, 17--27.Google ScholarGoogle ScholarCross RefCross Ref
  26. Grant Williams and Anas Mahmoud. 2017. Mining twitter feeds for software user requirements. In 2017 IEEE 25th International Requirements Engineering Conference (RE). IEEE, 1--10.Google ScholarGoogle ScholarCross RefCross Ref
  27. Grant Williams, Miroslav Tushev, Fahimeh Ebrahimi, and Anas Mahmoud. 2020. Modeling user concerns in Sharing Economy: the case of food delivery apps. Automated Software Engineering 27, 3 (2020), 229--263.Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. Xiaohui Yan, Jiafeng Guo, Yanyan Lan, and Xueqi Cheng. 2013. A biterm topic model for short texts. In Proceedings of the 22nd international conference on World Wide Web. 1445--1456.Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. Wenpeng Yin, Jamaal Hay, and Dan Roth. 2019. Benchmarking zero-shot text classification: Datasets, evaluation and entailment approach. arXiv preprint arXiv:1909.00161 (2019).Google ScholarGoogle Scholar

Index Terms

  1. Finding appropriate user feedback analysis techniques for multiple data domains
        Index terms have been assigned to the content through auto-classification.

        Recommendations

        Comments

        Login options

        Check if you have access through your login credentials or your institution to get full access on this article.

        Sign in
        • Published in

          cover image ACM Conferences
          ICSE '22: Proceedings of the ACM/IEEE 44th International Conference on Software Engineering: Companion Proceedings
          May 2022
          394 pages
          ISBN:9781450392235
          DOI:10.1145/3510454

          Copyright © 2022 ACM

          Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

          Publisher

          Association for Computing Machinery

          New York, NY, United States

          Publication History

          • Published: 19 October 2022

          Permissions

          Request permissions about this article.

          Request Permissions

          Check for updates

          Qualifiers

          • short-paper

          Acceptance Rates

          Overall Acceptance Rate276of1,856submissions,15%

          Upcoming Conference

          ICSE 2025
        • Article Metrics

          • Downloads (Last 12 months)37
          • Downloads (Last 6 weeks)4

          Other Metrics

        PDF Format

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader