Skip to main content

Developers’ Responses to App Review Feedback – A Study of Communication Norms in App Development

  • Conference paper
  • First Online:
Coordination, Organizations, Institutions, Norms, and Ethics for Governance of Multi-Agent Systems XIII (COIN 2017, COINE 2020)

Abstract

Norms are general expectations of behavior in societies. Huge amount of computer-mediated interaction data available in the social media domain provides an opportunity to extract and study communication norms, both to understand their prevalence and to make informed decisions about adopting them. While interactions in social media platforms such as Twitter and Facebook have been widely studied, only recently researchers have started examining app reviews provided by users and the responses provided by developers in the domain of app development. In this vein, a lot of attention has been devoted to study the nature of user reviews, however, little is known about developer responses to such reviews. Additionally, no other prior work has scrutinized the nature of communication norms in this domain. Towards addressing these gaps, this work pursues three objectives using a dataset comprising user reviews and developer responses from Google’s top-20 apps used to track running with a total of 24,407 reviews and 2,668 responses. First, based on prior literature in computer-mediated interactions, the study identifies 12 norms in responses provided by developers in three categories (obligation norms, prohibition norms and domain-specific response norms). Second, it scrutinizes the awareness and adoption of these norms. Third, based on the results obtained, this study identifies the need for creating a response recommendation system that generates responses to user reviews either automatically, or with some help from the developers. The proposed response recommendation system is a normative system that will generate responses that abide by the norms identified in this work, and will also monitor potential norm violations (if the responses were to be modified by the developers). Development of such a system forms the focus of future work.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    https://techcrunch.com/2017/01/24/apple-will-finally-let-developers-respond-to-app-store-reviews/.

  2. 2.

    Examples of prohibitions of canned responses are listed in the guidelines for reviews by Amazon and TripAdvisor (refer to: https://www.amazon.com/gp/community-help/official-comment-guidelines and http://www.reviewtrackers.com/ultimate-guide-responding-tripadvisor-reviews/).

  3. 3.

    We acknowledge that a developer may have followed a norm in question without consciously being aware of a norm. For example, a developer using salutation may have been exposed to that norm in a different domain (e.g. writing emails). However, in this work, we do not distinguish between the two situations. fo are multiple developers of an app, not all of them may be aware of the norm. This work assumes that if one of the developers is aware of the norm, there is norm awareness among the developers of an app. These aspects can be scrutinized further in a future work, for example by interviewing app developers.

  4. 4.

    https://www.gingersoftware.com/.

  5. 5.

    A prototypical implementation of the system and the user evaluation are described in a subsequent work [35].

References

  1. Maalej, W., Nabil, H.: Bug report, feature request, or simply praise? On automatically classifying app reviews. In: RE, 2015 Conference, pp. 116–125 (2015)

    Google Scholar 

  2. Lewin-Jones, J., Mason, V.: Understanding style, language and etiquette in email communication in higher education: a survey. Res. PC Educ. 19, 75–90 (2014)

    Google Scholar 

  3. Waldvogel, J.: Greetings and closings in workplace email. J. Comput.-Mediated Commun. 12, 456–477 (2007)

    Article  Google Scholar 

  4. Chen, N., Lin, J., Hoi, S.C., Xiao, X., Zhang, B.: AR-miner: mining informative reviews for developers from mobile app marketplace. In: ICSE Conference, pp. 767–778. ACM (2014)

    Google Scholar 

  5. McIlroy, S., Shang, W., Ali, N., Hassan, A.: Is it worth responding to reviews? A case study of the top free apps in the Google Play store. IEEE Software (2015)

    Google Scholar 

  6. Bailey, K.: Out of the mouths of users: examining user-developer feedback loops facilitated by app stores (2015)

    Google Scholar 

  7. Panichella, S., Di Sorbo, A., Guzman, E., Visaggio, C.A., Canfora, G., Gall, H.C.: How can I improve my app? Classifying user reviews for software maintenance and evolution. In: ICSME Conference pp. 281–290. IEEE (2015)

    Google Scholar 

  8. Markus, M.L.: Finding a happy medium: explaining the negative effects of electronic communication on social life at work. ACM TOIS 12, 119–149 (1994)

    Article  Google Scholar 

  9. Kooti, F., Aiello, L.M., Grbovic, M., Lerman, K., Mantrach, A.: Evolution of conversations in the age of email overload. In: WWW Conference, pp. 603–613. ACM (2015)

    Google Scholar 

  10. Bjørge, A.K.: Power distance in English lingua franca email communication1. Int. J. Appl. Ling. 17, 60–80 (2007)

    Article  Google Scholar 

  11. Kooti, F., Yang, H., Cha, M., Gummadi, P.K., Mason, W.A.: The emergence of conventions in online social networks. In: ICWSM Conference (2012)

    Google Scholar 

  12. Pérez-Sabater, C.: The linguistics of social networking: a study of writing conventions on Facebook. Linguistik Online 56 (2013)

    Google Scholar 

  13. Squire, M.: How the FLOSS research community uses email archives. Int. J. Open Source Softw. Processes (IJOSSP) 4, 37–59 (2012)

    Article  Google Scholar 

  14. Guzman, E., Alkadhi, R., Seyff, N.: A needle in a haystack: what do Twitter users say about software? In: RE Conference, pp. 96–105. IEEE (2016)

    Google Scholar 

  15. Chan, N.L., Guillet, B.D.: Investigation of social media marketing: how does the hotel industry in Hong Kong perform in marketing on social media websites? J. Travel Tour. Market. 28, 345–368 (2011)

    Article  Google Scholar 

  16. Ye, Q., Gu, B., Chen, W., Law, R.: Measuring the value of managerial responses to online reviews-a natural experiment of two online travel agencies. In: ICIS Conference (2008)

    Google Scholar 

  17. Andrighetto, G., Governatori, G., Noriega, P., van der Torre, L.W.: Normative multi-agent systems. Schloss Dagstuhl-Leibniz-Zentrum fuer Informatik (2013)

    Google Scholar 

  18. Singh, M.P., et al.: The uses of norms. Schloss Dagstuhl LZI (2013)

    Google Scholar 

  19. Gao, X., Singh, M.P.: Extracting normative relationships from business contracts. In: AAMAS Conference, pp. 101–108 (2014)

    Google Scholar 

  20. Hashmi, M.: A methodology for extracting legal norms from regulatory documents. In: EDOCW Workshop, pp. 41–50 (2015)

    Google Scholar 

  21. Sadiq, S., Governatori, G.: In: vom Brocke, J., Rosemann, M. (eds.) Handbook on Business Process Management 2. IHIS, pp. 265–288. Springer, Heidelberg (2015). https://doi.org/10.1007/978-3-642-45103-4_11

  22. Avery, D., Dam, H.K., Savarimuthu, B.T.R., Ghose, A.: Externalization of software behavior by the mining of norms. In: MSR Conference, pp. 223–234 (2016)

    Google Scholar 

  23. Dam, H.K., Savarimuthu, B.T.R., Avery, D., Ghose, A.: Mining software repositories for social norms. In: ICSE Conference, pp. 627–630 (2016)

    Google Scholar 

  24. Savarimuthu, B.T.R., Dam, H.K.: Towards mining norms in open source software repositories. In: Cao, L., Zeng, Y., Symeonidis, A.L., Gorodetsky, V., Müller, J.P., Yu, P.S. (eds.) ADMI 2013. LNCS (LNAI), vol. 8316, pp. 26–39. Springer, Heidelberg (2014). https://doi.org/10.1007/978-3-642-55192-5_3

  25. Ye, Q., Law, R., Gu, B.: The impact of online user reviews on hotel room sales. Int. J. Hosp. Manag. 28, 180–182 (2009)

    Article  Google Scholar 

  26. Sparks, B.A., So, K.K.F., Bradley, G.L.: Responding to negative online reviews: the effects of hotel responses on customer inferences of trust and concern. Tour. Manage. 53, 74–85 (2016)

    Article  Google Scholar 

  27. Basuroy, S., Chatterjee, S., Ravid, S.A.: How critical are critical reviews? The box office effects of film critics, star power, and budgets. J. Market. 67, 103–117 (2003)

    Article  Google Scholar 

  28. Khoo-Lattimore, C., Ekiz, E.H.: Power in praise: exploring online compliments on luxury hotels in Malaysia. Tour. Hospital. Res. 14, 152–159 (2014)

    Article  Google Scholar 

  29. Matzat, U., Snijders, C.: Rebuilding trust in online shops on consumer review sites: sellers’ responses to user-generated complaints. J. CMC 18, 62–79 (2012)

    Google Scholar 

  30. Malthouse, E.C., Haenlein, M., Skiera, B., Wege, E., Zhang, M.: Managing customer relationships in the social media era: introducing the social CRM house. J. Interact. Market. 27, 270–280 (2013)

    Article  Google Scholar 

  31. Merriam, S.B., Tisdell, E.J.: Qualitative Research: A Guide to Design and Implementation. Wiley, Hoboken (2015)

    Google Scholar 

  32. Landis, J.R., Koch, G.G.: The measurement of observer agreement for categorical data. Biometrics 159–174 (1977)

    Google Scholar 

  33. Miller, R.B.: Response time in man-computer conversational transactions. In: FJCC Conference, pp. 267–277 (1968)

    Google Scholar 

  34. Arnold, K.C., Gajos, K.Z., Kalai, A.T.: On suggesting phrases vs. predicting words for mobile text composition. In: UIST Symposium, pp. 603–608. ACM (2016)

    Google Scholar 

  35. Greenheld, G., Savarimuthu, B.T.R., Licorish, S.A.: Automating developers’ responses to app reviews. In: 25th Australasian Software Engineering Conference (ASWEC), pp. 66–70 (2018)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Bastin Tony Roy Savarimuthu .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2021 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Savarimuthu, B.T.R., Licorish, S.A., Devananda, M., Greenheld, G., Dignum, V., Dignum, F. (2021). Developers’ Responses to App Review Feedback – A Study of Communication Norms in App Development. In: Aler Tubella, A., Cranefield, S., Frantz, C., Meneguzzi, F., Vasconcelos, W. (eds) Coordination, Organizations, Institutions, Norms, and Ethics for Governance of Multi-Agent Systems XIII. COIN COINE 2017 2020. Lecture Notes in Computer Science(), vol 12298. Springer, Cham. https://doi.org/10.1007/978-3-030-72376-7_4

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-72376-7_4

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-72375-0

  • Online ISBN: 978-3-030-72376-7

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics