skip to main content
10.1145/3437120.3437308acmotherconferencesArticle/Chapter ViewAbstractPublication PagespciConference Proceedingsconference-collections
research-article

Ranking Online User Reviews for Tourism Based on Usefulness

Published: 04 March 2021 Publication History

Abstract

The growth of Web 2.0 services has lead to an increase in the volume of user-generated content in the form of online user reviews. Web platforms offering users the ability to evaluate the services of hotels have increased in popularity, as a large percentage of travellers offer their feedback or read hotel reviews to assist their decision making process. Users usually do not have time to go through the sheer volume of available hotel reviews and would prefer to read the most useful ones, whereas review usefulness is subjective and depends on the reader’s needs and preferences. Therefore, the need for automatically detecting hotel review helpfulness arises.
In this paper, we propose the use of features that capture both textual content and review metadata for predicting hotel review helpfulness of Greek and English reviews. A novel approach for representing text as a word embeddings-based vector is introduced and review association with certain hotel service aspects is mapped. Evaluating the performance of our approach using Machine Learning and Neural classifiers yields promising results for the review helpfulness classification task.

References

[1]
[n.d.]. FastText: Pre-trained word vectors for 157 languages. https://fasttext.cc/docs/en/crawl-vectors
[2]
[n.d.]. Php-ML: Machine Learning Library for PHP. https://github.com/jorgecasas/php-ml
[3]
[n.d.]. TripAdvisor: Number of Reviews 2019. https://www.statista.com/statistics/684862/tripadvisor-number-of-reviews/
[4]
Wasim Ahmad and Jin Sun. 2018. Modeling Consumer Distrust of Online Hotel Reviews. International Journal of Hospitality Management 71 (April 2018), 77–90. https://doi.org/10.1016/j.ijhm.2017.12.005
[5]
Muhammad Bilal, Mohsen Marjani, Ibrahim Abaker Targio Hashem, Akibu Mahmoud Abdullahi, Muhammad Tayyab, and Abdullah Gani. 2019. Predicting Helpfulness of Crowd-Sourced Reviews: A Survey. In 2019 13th International Conference on Mathematics, Actuarial Science, Computer Science and Statistics (MACS). 1–8. https://doi.org/10.1109/MACS48846.2019.9024814
[6]
Bin Fang, Qiang Ye, Deniz Kucukusta, and Rob Law. 2016. Analysis of the Perceived Value of Online Tourism Reviews: Influence of Readability and Reviewer Characteristics. Tourism Management 52 (Feb. 2016), 498–506. https://doi.org/10.1016/j.tourman.2015.07.018
[7]
Hong Hong, Di Xu, G. Alan Wang, and Weiguo Fan. 2017. Understanding the Determinants of Online Review Helpfulness: A Meta-Analytic Investigation. Decision Support Systems 102 (Oct. 2017), 1–11. https://doi.org/10.1016/j.dss.2017.06.007
[8]
Feng Hu. 2020. What Makes a Hotel Review Helpful? An Information Requirement Perspective. Journal of Hospitality Marketing & Management 29, 5 (July 2020), 571–591. https://doi.org/10.1080/19368623.2019.1661931
[9]
Ya-Han Hu and Kuanchin Chen. 2016. Predicting Hotel Review Helpfulness: The Impact of Review Visibility, and Interaction between Hotel Stars and Review Ratings. International Journal of Information Management 36, 6, Part A (Dec. 2016), 929–944. https://doi.org/10.1016/j.ijinfomgt.2016.06.003
[10]
Linchi Kwok and Karen L. Xie. 2016. Factors Contributing to the Helpfulness of Online Hotel Reviews: Does Manager Response Play a Role?International Journal of Contemporary Hospitality Management 28, 10 (Jan. 2016), 2156–2177. https://doi.org/10.1108/IJCHM-03-2015-0107
[11]
Pei-Ju Lee, Ya-Han Hu, and Kuan-Ting Lu. 2018. Assessing the Helpfulness of Online Hotel Reviews: A Classification-Based Approach. Telematics and Informatics 35, 2 (May 2018), 436–445. https://doi.org/10.1016/j.tele.2018.01.001
[12]
Sai Liang, Markus Schuckert, and Rob Law. 2019. How to Improve the Stated Helpfulness of Hotel Reviews? A Multilevel Approach. International Journal of Contemporary Hospitality Management 31, 2 (Jan. 2019), 953–977. https://doi.org/10.1108/IJCHM-02-2018-0134
[13]
Zhiwei Liu and Sangwon Park. 2015. What Makes a Useful Online Review? Implication for Travel Product Websites. Tourism Management 47 (April 2015), 140–151. https://doi.org/10.1016/j.tourman.2014.09.020
[14]
Yufeng Ma, Zheng Xiang, Qianzhou Du, and Weiguo Fan. 2018. Effects of User-Provided Photos on Hotel Review Helpfulness: An Analytical Approach with Deep Leaning. International Journal of Hospitality Management 71 (April 2018), 120–131. https://doi.org/10.1016/j.ijhm.2017.12.008
[15]
Lionel Martin and Pearl Pu. 2014. Prediction of Helpful Reviews Using Emotions Extraction. In Proceedings of the Twenty-Eighth AAAI Conference on Artificial Intelligence(AAAI’14). AAAI Press, Québec City, Québec, Canada, 1551–1557.
[16]
Michael P. O’Mahony and Barry Smyth. 2009. Learning to Recommend Helpful Hotel Reviews. In Proceedings of the Third ACM Conference on Recommender Systems(RecSys ’09). Association for Computing Machinery, New York, NY, USA, 305–308. https://doi.org/10.1145/1639714.1639774
[17]
Seunghun Shin, Qianzhou Du, and Zheng Xiang. 2019. What’s Vs. How’s in Online Hotel Reviews: Comparing Information Value of Content and Writing Style with Machine Learning. In Information and Communication Technologies in Tourism 2019, Juho Pesonen and Julia Neidhardt (Eds.). Springer International Publishing, Cham, 321–332. https://doi.org/10.1007/978-3-030-05940-8_25
[18]
Konstantinos Tsamis, Andreas Komninos, and John Garofalakis. 2019. Leveraging Social Media Linguistic Features for Bilingual Microblog Sentiment Classification. In 2019 10th International Conference on Information, Intelligence, Systems and Applications (IISA). 1–8. https://doi.org/10.1109/IISA.2019.8900674
[19]
Zheng Xiang, Qianzhou Du, Yufeng Ma, and Weiguo Fan. 2017. A Comparative Analysis of Major Online Review Platforms: Implications for Social Media Analytics in Hospitality and Tourism. Tourism Management 58 (Feb. 2017), 51–65. https://doi.org/10.1016/j.tourman.2016.10.001
[20]
Sung-Byung Yang, Seung-Hun Shin, Youhee Joun, and Chulmo Koo. 2017. Exploring the Comparative Importance of Online Hotel Reviews’ Heuristic Attributes in Review Helpfulness: A Conjoint Analysis Approach. Journal of Travel & Tourism Marketing 34, 7 (Sept. 2017), 963–985. https://doi.org/10.1080/10548408.2016.1251872

Cited By

View all
  • (2023)A novel method based on knowledge adoption model and non-kernel SVM for predicting the helpfulness of online reviewsJournal of the Operational Research Society10.1080/01605682.2023.2239855(1-18)Online publication date: 28-Jul-2023

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences
PCI '20: Proceedings of the 24th Pan-Hellenic Conference on Informatics
November 2020
433 pages
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 04 March 2021

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Machine learning
  2. Natural language processing
  3. Neural networks
  4. Review helpfulness classification
  5. User-generated content

Qualifiers

  • Research-article
  • Research
  • Refereed limited

Funding Sources

  • Hellenic Government and European Regional Development Fund

Conference

PCI 2020
PCI 2020: 24th Pan-Hellenic Conference on Informatics
November 20 - 22, 2020
Athens, Greece

Acceptance Rates

Overall Acceptance Rate 190 of 390 submissions, 49%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)12
  • Downloads (Last 6 weeks)0
Reflects downloads up to 08 Mar 2025

Other Metrics

Citations

Cited By

View all
  • (2023)A novel method based on knowledge adoption model and non-kernel SVM for predicting the helpfulness of online reviewsJournal of the Operational Research Society10.1080/01605682.2023.2239855(1-18)Online publication date: 28-Jul-2023

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media