skip to main content
10.1145/3027063.3053097acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
abstract

Modeling User Satisfaction from the Extraction of User Experience Elements in Online Product Reviews

Authors Info & Claims
Published:06 May 2017Publication History

ABSTRACT

With the abundance of product reviews available online, online review data represent invaluable resources for understanding the user experience of various products in their real usage environments. Extant online review studies have considered UX elements mostly related to emotions. We collected 64,772 sentences from 4,380 online reviews of three electronic products, and analyzed the content of the online reviews using LIWC in order to extract various UX elements going beyond emotions. The study results show that UX elements extracted from online reviews had significant effects on user satisfaction. In addition to the emotional factors (hedonic, user burden), the results show that expectation confirmation and pragmatic factors play significant roles in determining user satisfaction.

References

  1. Lauralee Alben. 1996. Quality of experience: defining the criteria for effective interaction design. Interactions 3, 3. 11--15.Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Javier A. Bargas-Avila and Kasper Hornbæk. Old wine in new bottles or novel challenges: a critical analysis of empirical studies of user experience. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '11). ACM, New York, NY, USA, 2689--2698. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Anol Battacherjee. 2001. Understanding Information Systems Continuance: An ExpectationConfirmation Model. MIS Quarterly 25, 3. 351--370.Google ScholarGoogle Scholar
  4. Fred D Davis. 1989. Perceived usefulness, perceived ease of use, and user acceptance of information technology. MIS Quarterly 13, 3. 319-- 340.Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Liqiong Deng, Douglas E Turner, Robert Gehling, and Brad Prince. 2010. User experience, satisfaction, and continual usage intention of IT. European Journal of Information Systems 19, 1. 60--75.Google ScholarGoogle ScholarCross RefCross Ref
  6. Marc Hassenzahl. 2003. The Thing and I: Understanding the Relationship Between User and Product, Funology: From Usability to Enjoyment. 31--42.Google ScholarGoogle Scholar
  7. Marc Hassenzahl and Noam Tractinsky. 2006. User experience - a research agenda. Behaviour & Information Technology 25, 2. 91--97.Google ScholarGoogle ScholarCross RefCross Ref
  8. Steffen Hedegaard and JG Simonsen. 2013. Extracting usability and user experience information from online user reviews. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '13). ACM, New York, NY, USA, 2089--2098. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Nan Hu, Pa Pavlou, and Jennifer Zhang. 2006. Can online reviews reveal a product's true quality?: empirical findings and analytical modeling of Online word-of-mouth communication. In Proceedings of the 7th ACM conference on Electronic commerce (EC '06). ACM, New York, NY, USA, 324--330. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Jincheul Jang, Dapeng Zhao, Woneui Hong, Youkyoung Park, and Mun Yong Yi. 2016. Uncovering the Underlying Factors of Smart TV UX over Time: A Multi-study, Mixed-method Approach. In Proceedings of the ACM International Conference on Interactive Experiences for TV and Online Video (TVX '16). ACM, New York, NY, USA, 3--12. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Ingrid Lunden. 6.1B Smartphone Users Globally by 2020, Overtaking Basic Fixed Phone Subscriptions. 2015. https://techcrunch.com/2015/06/02/6--1bsmartphone-users-globally-by-2020-overtakingbasic-fixed-phone-subscriptions/Google ScholarGoogle Scholar
  12. John McCarthy and Peter Wright. 2004. Technology as experience. Interactions 11, 5. 42--43.Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Richard L. Oliver. 1980. A Cognitive Model of the Antecedents and Consequences of Satisfaction Decisions. Journal of Marketing Research 17, 4. 460--469.Google ScholarGoogle ScholarCross RefCross Ref
  14. James W. Pennebaker, Ryan L. Boyd, Kayla Jordan, and Kate Blackburn. 2015. The Development and Psychometric Properties of LIWC2015.Google ScholarGoogle Scholar
  15. Hyewon Suh, Nina Shahriaree, Eric B. Hekler, and Julie A. Kientz. 2016. Developing and Validating the User Burden Scale: A Tool for Assessing User Burden in Computing Systems. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '16). ACM, New York, NY, USA, 3988--3999. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Alexandre N. Tuch, Rune Trusell, and Kasper Hornbæk. 2013. Analyzing users' narratives to understand experience with interactive products. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '13). ACM, New York, NY, USA, 2079--2088. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Dezhi Yin, Samuel D Bond, and Han Zhang. 2014. Anxious or angry? Effects of discrete emotions on the perceived helpfulness of online reviews. MIS Quarterly 38, 2: 539--560.Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Local Consumer Review Survey 2016. https://www.brightlocal.com/learn/local-consumerreview-survey/Google ScholarGoogle Scholar

Index Terms

  1. Modeling User Satisfaction from the Extraction of User Experience Elements in Online Product Reviews

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in
    • Published in

      cover image ACM Conferences
      CHI EA '17: Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems
      May 2017
      3954 pages
      ISBN:9781450346566
      DOI:10.1145/3027063

      Copyright © 2017 Owner/Author

      Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 6 May 2017

      Check for updates

      Qualifiers

      • abstract

      Acceptance Rates

      CHI EA '17 Paper Acceptance Rate1,000of5,000submissions,20%Overall Acceptance Rate6,164of23,696submissions,26%

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader