research-article

Mining User Reviews for Mobile App Comparisons

Authors:

Xiangqun ChenAuthors Info & Claims

Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, Volume 1, Issue 3

Article No.: 75, Pages 1 - 15

https://doi.org/10.1145/3130935

Published: 11 September 2017 Publication History

Abstract

As the number of mobile apps keeps increasing, users often need to compare many apps, in order to choose one that best fits their needs. Fortunately, as there are so many users sharing an app market, it is likely that some other users with the same preferences have already made the comparisons and shared their opinions. For example, a user may state that an app is better in power consumption than another app in a review, then the review would help other users who care about battery life while choosing apps. This paper presents a method to identify comparative reviews for mobile apps from an app market, which can be used to provide fine-grained app comparisons based on different topics. According to experiments on 5 million reviews from Google Play and manual assessments on 900 reviews, our method is able to identify opinions accurately and provide meaningful comparisons between apps, which could in turn help users find desired apps based on their preferences.

References

[1]

LLC Blanc Media. 2017. The Sweet Setup: We recommend the best apps for your iPhone, iPad, and Mac. (2017). Retrieved July 1, 2017 from http://thesweetsetup.com/

[2]

David M Blei, Andrew Y Ng, and Michael I Jordan. 2003. Latent dirichlet allocation. Journal of machine Learning research 3, Jan (2003), 993--1022.

Digital Library

[3]

Ning Chen, Jialiu Lin, Steven C. H. Hoi, Xiaokui Xiao, and Boshen Zhang. 2014. AR-miner: Mining Informative Reviews for Developers from Mobile App Marketplace. In ICSE 2014. 767--778.

Digital Library

[4]

CMU CHIMPS Lab. 2014. PrivacyGrade: Grading The Privacy Of Smartphone Apps. (2014). Retrieved May 1, 2017 from http://privacygrade.org/

[5]

Murthy Ganapathibhotla and Bing Liu. 2008. Mining Opinions in Comparative Sentences. In COLING ’08. 241--248. http://dl.acm.org/citation.cfm?id=1599081.1599112

Digital Library

[6]

Emitza Guzman and Walid Maalej. 2014. How do users like this feature? a fine grained sentiment analysis of app reviews. In 2014 IEEE 22nd international requirements engineering conference (RE). 153--162.

[7]

Thomas Hofmann. 1999. Probabilistic Latent Semantic Analysis. In Proceedings of the Fifteenth Conference on Uncertainty in Artificial Intelligence (UAI’99). Morgan Kaufmann Publishers Inc., 289--296. http://dl.acm.org/citation.cfm?id=2073796.2073829

Digital Library

[8]

Claudia Iacob, Varsha Veerappa, and Rachel Harrison. 2013. What Are You Complaining About?: A Study of Online Reviews of Mobile Applications. In Proceedings of the 27th International BCS Human Computer Interaction Conference (BCS-HCI ’13). Article 29, 6 pages. http://dl.acm.org/citation.cfm?id=2578048.2578086

Digital Library

[9]

Reyhaneh Jabbarvand, Alireza Sadeghi, Joshua Garcia, Sam Malek, and Paul Ammann. 2015. EcoDroid: An Approach for Energy-based Ranking of Android Apps. In Proceedings of the Fourth International Workshop on Green and Sustainable Software (GREENS ’15). 8--14. http://dl.acm.org/citation.cfm?id=2820158.2820161

Digital Library

[10]

Haojian Jin, Tetsuya Sakai, and Koji Yatani. 2014. ReviewCollage: A Mobile Interface for Direct Comparison Using Online Reviews. In Proceedings of the 16th International Conference on Human-computer Interaction with Mobile Devices 8 Services (MobileHCI ’14). 349--358.

Digital Library

[11]

Nitin Jindal and Bing Liu. 2006. Identifying Comparative Sentences in Text Documents. In SIGIR ’06. 244--251.

Digital Library

[12]

Hammad Khalid, Emad Shihab, Meiyappan Nagappan, and Ahmed E Hassan. 2015. What do mobile app users complain about? IEEE Software 32, 3 (2015), 70--77.

Digital Library

[13]

Thomas K Landauer, Peter W Foltz, and Darrell Laham. 1998. An introduction to latent semantic analysis. Discourse processes 25, 2-3 (1998), 259--284.

[14]

Shasha Li, Chin-Yew Lin, Young-In Song, and Zhoujun Li. 2013. Comparable entity mining from comparative questions. IEEE Transactions On Knowledge And Data Engineering 25, 7 (2013), 1498--1509.

Digital Library

[15]

Tomas Mikolov, Kai Chen, Greg Corrado, and Jeffrey Dean. 2013. Efficient estimation of word representations in vector space. arXiv preprint arXiv:1301.3781 (2013).

[16]

Dennis Pagano and Walid Maalej. 2013. User feedback in the appstore: An empirical study. In 2013 21st IEEE international requirements engineering conference (RE 2013). 125--134.

[17]

Bo Pang and Lillian Lee. 2008. Opinion Mining and Sentiment Analysis. Found. Trends Inf. Retr. 2, 1-2 (Jan. 2008), 1--135.

Digital Library

[18]

Dae Hoon Park and Catherine Blake. 2012. Identifying Comparative Claim Sentences in Full-text Scientific Articles. In Proceedings of the Workshop on Detecting Structure in Scholarly Discourse (ACL ’12). 1--9. http://dl.acm.org/citation.cfm?id=2391171.2391173

Digital Library

[19]

Dae Hoon Park, Mengwen Liu, ChengXiang Zhai, and Haohong Wang. 2015. Leveraging User Reviews to Improve Accuracy for Mobile App Retrieval. In Proceedings of the 38th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR ’15). 533--542.

Digital Library

[20]

Yonggang Qiu and Hans-Peter Frei. 1993. Concept Based Query Expansion. In SIGIR ’93. 160--169.

Digital Library

[21]

Richard Socher, Alex Perelygin, Jean Y Wu, Jason Chuang, Christopher D Manning, Andrew Y Ng, and Christopher Potts. 2013. Recursive deep models for semantic compositionality over a sentiment treebank. In EMNLP, Vol. 1631. 1642.

[22]

Rajesh Vasa, Leonard Hoon, Kon Mouzakis, and Akihiro Noguchi. 2012. A Preliminary Analysis of Mobile App User Reviews. In Proceedings of the 24th Australian Computer-Human Interaction Conference (OzCHI ’12). 241--244.

Digital Library

[23]

Phong Minh Vu, Tam The Nguyen, Hung Viet Pham, and Tung Thanh Nguyen. 2015. Mining User Opinions in Mobile App Reviews: A Keyword-Based Approach (T). In ASE 2015. 749--759.

Digital Library

[24]

Wikipedia. 2017. App Store. (2017). Retrieved July 1, 2017 from https://en.wikipedia.org/wiki/App_Store_(iOS)

[25]

Wikipedia. 2017. Google Play. (2017). Retrieved July 1, 2017 from https://en.wikipedia.org/wiki/Google_Play

[26]

Jinxi Xu and W. Bruce Croft. 1996. Query Expansion Using Local and Global Document Analysis. In SIGIR ’96. 4--11.

Digital Library

[27]

Kaiquan Xu, Stephen Shaoyi Liao, Jiexun Li, and Yuxia Song. 2011. Mining comparative opinions from customer reviews for Competitive Intelligence. Decision support systems 50, 4 (2011), 743--754.

Digital Library

[28]

LLC. PCMag Digital Group Ziff Davis. 2017. PCMAG: Reviews of mobile apps. (2017). Retrieved July 1, 2017 from http://www.pcmag. com/reviews/mobile-apps

Cited By

Kouaho WEpstein D(2024)Investigating Perspectives of and Experiences with Low Cost Commercial Fitness WearablesProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36997408:4(1-22)Online publication date: 21-Nov-2024
https://dl.acm.org/doi/10.1145/3699740
Arambepola NMunasinghe LWarnajith N(2024)Factors Influencing Mobile App User Experience: An Analysis of Education App User Reviews2024 4th International Conference on Advanced Research in Computing (ICARC)10.1109/ICARC61713.2024.10499727(223-228)Online publication date: 21-Feb-2024
https://doi.org/10.1109/ICARC61713.2024.10499727
Sharma NAli AKabir M(2024)A review of sentiment analysis: tasks, applications, and deep learning techniquesInternational Journal of Data Science and Analytics10.1007/s41060-024-00594-xOnline publication date: 1-Jul-2024
https://doi.org/10.1007/s41060-024-00594-x
Show More Cited By

Index Terms

Mining User Reviews for Mobile App Comparisons

Recommendations

AR-miner: mining informative reviews for developers from mobile app marketplace
ICSE 2014: Proceedings of the 36th International Conference on Software Engineering

With the popularity of smartphones and mobile devices, mobile application (a.k.a. “app”) markets have been growing exponentially in terms of number of users and downloads. App developers spend considerable effort on collecting and exploiting user ...
A preliminary analysis of mobile app user reviews
OzCHI '12: Proceedings of the 24th Australian Computer-Human Interaction Conference

The advent of online software distribution channels like Apple Inc.'s App Store and Google Inc.'s Google Play has offered developers a single, low cost, and powerful distribution mechanism. These online stores help users discover apps as well as leave a ...
Do Android app users care about accessibility?: an analysis of user reviews on the Google play store
IHC '19: Proceedings of the 18th Brazilian Symposium on Human Factors in Computing Systems

Mobile applications (or apps) have become a popular platform to provide users with information, digital content and services. Unfortunately, many studies have shown that even popular mobile applications still have many accessibility issues. A particular ...

Comments

Information & Contributors

Information

Published In

cover image Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies

Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies Volume 1, Issue 3

September 2017

2023 pages

EISSN:2474-9567

DOI:10.1145/3139486

Issue’s Table of Contents

Copyright © 2017 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 11 September 2017

Accepted: 01 July 2017

Revised: 01 May 2017

Received: 01 February 2017

Published in IMWUT Volume 1, Issue 3

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed

Funding Sources

National Natural Science Foundation of China

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

16
Total Citations
View Citations
562
Total Downloads

Downloads (Last 12 months)42
Downloads (Last 6 weeks)6

Reflects downloads up to 27 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Kouaho WEpstein D(2024)Investigating Perspectives of and Experiences with Low Cost Commercial Fitness WearablesProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36997408:4(1-22)Online publication date: 21-Nov-2024
https://dl.acm.org/doi/10.1145/3699740
Arambepola NMunasinghe LWarnajith N(2024)Factors Influencing Mobile App User Experience: An Analysis of Education App User Reviews2024 4th International Conference on Advanced Research in Computing (ICARC)10.1109/ICARC61713.2024.10499727(223-228)Online publication date: 21-Feb-2024
https://doi.org/10.1109/ICARC61713.2024.10499727
Sharma NAli AKabir M(2024)A review of sentiment analysis: tasks, applications, and deep learning techniquesInternational Journal of Data Science and Analytics10.1007/s41060-024-00594-xOnline publication date: 1-Jul-2024
https://doi.org/10.1007/s41060-024-00594-x
Alturayeif NAljamaan HHassine J(2023)An automated approach to aspect-based sentiment analysis of apps reviews using machine and deep learningAutomated Software Engineering10.1007/s10515-023-00397-730:2Online publication date: 9-Sep-2023
https://dl.acm.org/doi/10.1007/s10515-023-00397-7
Zhou WWang YGao CYang F(2022)Emerging topic identification from app reviews via adaptive online biterm topic modeling基于自适应在线双词主题模型的应用程序评论新兴主题识别Frontiers of Information Technology & Electronic Engineering10.1631/FITEE.210046523:5(678-691)Online publication date: 11-Apr-2022
https://doi.org/10.1631/FITEE.2100465
Xiao JLi HWu MJin HDeen MCao J(2022)A Survey on Wireless Device-free Human Sensing: Application Scenarios, Current Solutions, and Open IssuesACM Computing Surveys10.1145/353068255:5(1-35)Online publication date: 3-Dec-2022
https://dl.acm.org/doi/10.1145/3530682
Wang HChen CXing ZGrundy J(2022)DiffTech: Differencing Similar Technologies From Crowd-Scale Comparison DiscussionsIEEE Transactions on Software Engineering10.1109/TSE.2021.305988548:7(2399-2416)Online publication date: 1-Jul-2022
https://doi.org/10.1109/TSE.2021.3059885
Hu YWang HJi TXiao XLuo XGao PGuo Y(2021)CHAMPProceedings of the 43rd International Conference on Software Engineering10.1109/ICSE43902.2021.00089(933-945)Online publication date: 22-May-2021
https://dl.acm.org/doi/10.1109/ICSE43902.2021.00089
Alturaief NAljamaan HBaslyman M(2021)AWARE: Aspect-Based Sentiment Analysis Dataset of Apps Reviews for Requirements Elicitation2021 36th IEEE/ACM International Conference on Automated Software Engineering Workshops (ASEW)10.1109/ASEW52652.2021.00049(211-218)Online publication date: Nov-2021
https://doi.org/10.1109/ASEW52652.2021.00049
Al-Hawari ANajadat HShatnawi R(2020)Classification of application reviews into software maintenance tasks using data mining techniquesSoftware Quality Journal10.1007/s11219-020-09529-8Online publication date: 28-Aug-2020
https://doi.org/10.1007/s11219-020-09529-8
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Issue’s Table of Contents