skip to main content
10.1145/3679318.3685369acmotherconferencesArticle/Chapter ViewAbstractPublication PagesnordichiConference Proceedingsconference-collections
research-article

Less Typing, More Tagging: Investigating Tag-based Interfaces in Online Accommodation Review Creation and Perception

Published: 13 October 2024 Publication History

Abstract

When booking accommodations such as hotel rooms or vacation houses online, users heavily rely on the experiences of prior customers through reviews. However, such reviews are often short or lacking important details since most UIs limit users to text-only input, making review creation laborious and time-consuming. The quality of the review can therefore vary, depending on the skill and intrinsic motivation of the reviewer. Instead of relying on these two variables, we explore the effects of a tag enriched UI, both for creating and presenting review information. In the process, we evaluate tags – short descriptive text snippets such as “centrally located” – as additional input components to open text fields and rating scales. These tags aim to trigger users’ memory of details and experiences and support them in creating comprehensive reviews without having to generate long texts. In an initial user study, we asked participants to generate reviews with and without the tag support. In a second user study, they evaluated reviews created with and without tags. Our results show that tags were perceived as helpful in creating reviews and increased the level of detail in the experiences reported. We discuss the implications of review quality, helpfulness, and potential limitations.

References

[1]
Eytan Adar, Jaime Teevan, and Susan T. Dumais. 2008. Large scale analysis of web revisitation patterns(CHI ’08). Association for Computing Machinery, New York, NY, USA, 1197–1206. https://doi.org/10.1145/1357054.1357241
[2]
Sarah Alismail and Hengwei Zhang. 2018. The use of emoji in electronic user experience questionnaire: An exploratory case study. In Proceedings of the 51st Hawaii International Conference on System Sciences. Hawaii, Honolulu, HI, USA, 3366–3375. http://hdl.handle.net/10125/50315
[3]
Latha Banda and K.K. Bharadwaj. 2014. An Approach to Enhance the Quality of Recommendation Using Collaborative Tagging. International Journal of Computational Intelligence Systems 7, 4 (2014), 650–659. https://doi.org/10.1080/18756891.2014.960225
[4]
Inès Blal and Michael C Sturman. 2014. The differential effects of the quality and quantity of online reviews on hotel room sales. Cornell Hospitality Quarterly 55, 4 (2014), 365–375. https://doi.org/10.1177/1938965514533419
[5]
Judith Bridges and Camilla Vásquez. 2018. If nearly all Airbnb reviews are positive, does that make them meaningless?Current Issues in Tourism 21, 18 (2018), 2057–2075. https://doi.org/10.1080/13683500.2016.1267113
[6]
John Brooke. 1995. SUS: A quick and dirty usability scale. Usability Eval. Ind. 189 (11 1995).
[7]
Frederik Brudy, Suppachai Suwanwatcharachat, Wenyu Zhang, Steven Houben, and Nicolai Marquardt. 2018. EagleView: A Video Analysis Tool for Visualising and Querying Spatial Interactions of People and Devices. In Proceedings of the 2018 ACM International Conference on Interactive Surfaces and Spaces (Tokyo, Japan) (ISS ’18). Association for Computing Machinery, New York, NY, USA, 61–72. https://doi.org/10.1145/3279778.3279795
[8]
Dimitrios Buhalis and Rob Law. 2008. Progress in information technology and tourism management: 20 years on and 10 years after the Internet—The state of eTourism research. Tourism management 29, 4 (2008), 609–623. https://doi.org/10.1016/j.tourman.2008.01.005
[9]
Man Yee Cheung, Chuan Luo, Choon Ling Sia, and Huaping Chen. 2009. Credibility of electronic word-of-mouth: Informational and normative determinants of on-line consumer recommendations. International journal of electronic commerce 13, 4 (2009), 9–38. https://doi.org/10.2753/JEC1086-4415130402
[10]
Gilbert A Churchill, Jr. 1979. A paradigm for developing better measures of marketing constructs. Journal of marketing research 16, 1 (1979), 64–73. https://doi.org/10.1177/002224377901600110
[11]
Dimitar Dimitrov, Denis Helic, and Markus Strohmaier. 2018. Tag-Based Navigation and Visualization. Springer International Publishing, Cham, 181–212. https://doi.org/10.1007/978-3-319-90092-6_6
[12]
Franz Faul, Edgar Erdfelder, Albert-Georg Lang, and Axel Buchner. 2007. G* Power 3: A flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behavior research methods 39, 2 (2007), 175–191. https://doi.org/10.3758/BF03193146
[13]
Raffaele Filieri. 2015. What makes online reviews helpful? A diagnosticity-adoption framework to explain informational and normative influences in e-WOM. Journal of business research 68, 6 (2015), 1261–1270. https://doi.org/10.1016/j.jbusres.2014.11.006
[14]
Raffaele Filieri, Salma Alguezaui, and Fraser McLeay. 2015. Why do travelers trust TripAdvisor? Antecedents of trust towards consumer-generated media and its influence on recommendation adoption and word of mouth. Tourism management 51 (2015), 174–185. https://doi.org/10.1016/j.tourman.2015.05.007
[15]
Diana Gavilan, Maria Avello, and Gema Martinez-Navarro. 2018. The influence of online ratings and reviews on hotel booking consideration. Tourism Management 66 (2018), 53–61. https://doi.org/10.1016/j.tourman.2017.10.018
[16]
Duarte Gonçalves, Rui Jesus, and Nuno Correia. 2008. A Gesture Based Game for Image Tagging. In CHI ’08 Extended Abstracts on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 2685–2690. https://doi.org/10.1145/1358628.1358745
[17]
Daniel Kailer, Peter Mandl, and Alexander Schill. 2013. Rated Tags: Adding rating capability to collaborative tagging. In 2013 International Conference on Cloud and Green Computing (New York, New York, USA). IEEE, 249–255. https://doi.org/10.1109/CGC.2013.46
[18]
Daniel Kailer, Peter Mandl, and Alexander Schill. 2014. Supporting Customers’ Decision Making with Rated Tags. In Proceedings of the Sixteenth International Conference on Electronic Commerce (Philadelphia, PA, USA) (ICEC ’14). Association for Computing Machinery, New York, NY, USA, 33–40. https://doi.org/10.1145/2617848.2617849
[19]
Stephen W Litvin, Ronald E Goldsmith, and Bing Pan. 2008. Electronic word-of-mouth in hospitality and tourism management. Tourism management 29, 3 (2008), 458–468. https://doi.org/10.1016/j.tourman.2007.05.011
[20]
Maliha Mahbub, Najia Manjur, and Julita Vassileva. 2021. Towards better rating scale design: An experimental analysis of the influence of user preference and visual cues on user response. In International Conference on Persuasive Technology. Springer, Cham, 150–163. https://doi.org/10.1007/978-3-030-79460-6_12
[21]
G A Miller. 1956. The magical number seven plus or minus two: some limits on our capacity for processing information. Psychol Rev 63, 2 (March 1956), 81–97.
[22]
Bennet B Murdock Jr. 1962. The serial position effect of free recall. Journal of experimental psychology 64, 5 (1962), 482. https://doi.org/10.1037/h0045106
[23]
Beng Soo Ong. 2012. The perceived influence of user reviews in the hospitality industry. Journal of Hospitality Marketing & Management 21, 5 (2012), 463–485. https://doi.org/10.1080/19368623.2012.626743
[24]
Paul Phillips, Stuart Barnes, Krystin Zigan, and Roland Schegg. 2017. Understanding the impact of online reviews on hotel performance: an empirical analysis. Journal of Travel Research 56, 2 (2017), 235–249. https://doi.org/10.1177/0047287516636481
[25]
Rajinesh Ravendran, Ian MacColl, and Michael Docherty. 2012. A Comparative Usability Study of a Tag-Based Interface in the Mobile Banking Context. In Proceedings of the 13th International Conference of the NZ Chapter of the ACM’s Special Interest Group on Human-Computer Interaction (Dunedin, New Zealand) (CHINZ ’12). Association for Computing Machinery, New York, NY, USA, 80–83. https://doi.org/10.1145/2379256.2379269
[26]
Rajinesh Ravendran, Ian MacColl, and Michael Docherty. 2012. Tag-based interaction in online and mobile banking: a preliminary study of the effect on usability. In Proceedings of the 10th Asia Pacific Conference on Computer Human Interaction (Matsue-city, Shimane, Japan) (APCHI ’12). Association for Computing Machinery, New York, NY, USA, 35–40. https://doi.org/10.1145/2350046.2350056
[27]
Rajinesh Ravendran, Ian MacColl, and Michael Docherty. 2012. Usability Evaluation of a Tag-Based Interface. J. Usability Studies 7, 4 (aug 2012), 143–160.
[28]
Simon André Scherr, Svenja Polst, Lisa Müller, Konstantin Holl, and Frank Elberzhager. 2019. The Perception of Emojis for Analyzing App Feedback. International Journal of Interactive Mobile Technologies 13, 2 (2019), 18. https://www.learntechlib.org/p/207545/
[29]
Martin Schrepp, Andreas Hinderks, and Jörg Thomaschewski. 2014. Applying the User Experience Questionnaire (UEQ) in Different Evaluation Scenarios. In Design, User Experience, and Usability. Theories, Methods, and Tools for Designing the User Experience, Aaron Marcus (Ed.). Springer International Publishing, Cham, 383–392.
[30]
Beverley A Sparks and Victoria Browning. 2011. The impact of online reviews on hotel booking intentions and perception of trust. Tourism management 32, 6 (2011), 1310–1323. https://doi.org/10.1016/j.tourman.2010.12.011
[31]
Florian Spiess, Ralph Gasser, Heiko Schuldt, and Luca Rossetto. 2023. The Best of Both Worlds: Lifelog Retrieval with a Desktop-Virtual Reality Hybrid System. In Proceedings of the 6th Annual ACM Lifelog Search Challenge. Association for Computing Machinery, New York, NY, USA, 65–68. https://doi.org/10.1145/3592573.3593107
[32]
Vera Toepoel, Brenda Vermeeren, and Baran Metin. 2019. Smileys, Stars, Hearts, Buttons, Tiles or Grids: Influence of Response Format on Substantive Response, Questionnaire Experience and Response Time. Bulletin of Sociological Methodology/Bulletin de Méthodologie Sociologique 142, 1 (2019), 57–74. https://doi.org/10.1177/0759106319834665
[33]
Alexander Toet and Jan BF van Erp. 2019. The EmojiGrid as a tool to assess experienced and perceived emotions. Psych 1, 1 (2019), 469–481. https://doi.org/10.3390/psych1010036
[34]
Christoph Trattner, Yi-ling Lin, Denis Parra, Zhen Yue, William Real, and Peter Brusilovsky. 2012. Evaluating Tag-Based Information Access in Image Collections. In Proceedings of the 23rd ACM Conference on Hypertext and Social Media (Milwaukee, Wisconsin, USA) (HT ’12). Association for Computing Machinery, New York, NY, USA, 113–122. https://doi.org/10.1145/2309996.2310016
[35]
Shawn Tseng and B. J. Fogg. 1999. Credibility and Computing Technology. Commun. ACM 42, 5 (may 1999), 39–44. https://doi.org/10.1145/301353.301402
[36]
Ivar E Vermeulen and Daphne Seegers. 2009. Tried and tested: The impact of online hotel reviews on consumer consideration. Tourism management 30, 1 (2009), 123–127. https://doi.org/10.1016/j.tourman.2008.04.008
[37]
Jesse Vig, Matthew Soukup, Shilad Sen, and John Riedl. 2010. Tag Expression: Tagging with Feeling. In Proceedings of the 23nd Annual ACM Symposium on User Interface Software and Technology (New York, New York, USA) (UIST ’10). Association for Computing Machinery, New York, NY, USA, 323–332. https://doi.org/10.1145/1866029.1866079
[38]
Richard Y Wang and Diane M Strong. 1996. Beyond accuracy: What data quality means to data consumers. Journal of management information systems 12, 4 (1996), 5–33. https://doi.org/10.1080/07421222.1996.11518099
[39]
Sung-Byung Yang, Seung-Hun Shin, Youhee Joun, and Chulmo Koo. 2017. Exploring the comparative importance of online hotel reviews’ heuristic attributes in review helpfulness: a conjoint analysis approach. Journal of Travel & Tourism Marketing 34, 7 (2017), 963–985. https://doi.org/10.1080/10548408.2016.1251872
[40]
Qiang Ye, Rob Law, and Bin Gu. 2009. The impact of online user reviews on hotel room sales. International Journal of Hospitality Management 28, 1 (2009), 180–182. https://doi.org/10.1016/j.ijhm.2008.06.011
[41]
Xiaobin Zhang and Hak-Seon Kim. 2021. Customer experience and satisfaction of Disneyland hotel through big data analysis of online customer reviews. Sustainability 13, 22 (2021), 12699. https://doi.org/10.3390/su132212699

Index Terms

  1. Less Typing, More Tagging: Investigating Tag-based Interfaces in Online Accommodation Review Creation and Perception

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image ACM Other conferences
      NordiCHI '24: Proceedings of the 13th Nordic Conference on Human-Computer Interaction
      October 2024
      1236 pages
      ISBN:9798400709661
      DOI:10.1145/3679318
      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 13 October 2024

      Permissions

      Request permissions for this article.

      Check for updates

      Author Tags

      1. online reviews
      2. user experience
      3. user interface design

      Qualifiers

      • Research-article
      • Research
      • Refereed limited

      Conference

      NordiCHI 2024

      Acceptance Rates

      Overall Acceptance Rate 379 of 1,572 submissions, 24%

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • 0
        Total Citations
      • 24
        Total Downloads
      • Downloads (Last 12 months)24
      • Downloads (Last 6 weeks)4
      Reflects downloads up to 17 Feb 2025

      Other Metrics

      Citations

      View Options

      Login options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      HTML Format

      View this article in HTML Format.

      HTML Format

      Figures

      Tables

      Media

      Share

      Share

      Share this Publication link

      Share on social media