skip to main content
10.1145/3334480.3383097acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
abstract

Hybrid Wizard of Oz: Concept Testing a Recommender System

Published:25 April 2020Publication History

ABSTRACT

In this paper, we report the results from a Hybrid Wizard of Oz experiment consisting of a critical incident interview and an in-situ simulation. The study aimed at validating the need for a contextualised and personalised Point-Of-Interest (POI) recommender and understanding the detailed user needs for it. Our key findings include: feeling bored as a key trigger to search for POIs, trust issues with the existing recommendation sources, intent to find free activities, information needs on areas-of-interest beyond points-of-interest, support for socialising, and language barriers. With this study, we also exemplify a cost- and time-effective approach for design of intelligent systems.

References

  1. Carlos Lamsfus, Dan Wang, Aurkene AlzuaSorzabal, and Zheng Xiang. 2015. Going Mobile: Defining Context for On-the-Go Travelers. Journal of Travel Research 54, 6: 691--701. https://doi.org/10.1177/0047287514538839Google ScholarGoogle ScholarCross RefCross Ref
  2. David Maulsby, Saul Greenberg, and Richard Mander. 1993. Prototyping an intelligent agent through Wizard of Oz. In Proceedings of the SIGCHI conference on Human factors in computing systems - CHI '93, 277--284. https://doi.org/10.1145/169059.169215Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Julie Anne Séguin, Alec Scharff, and Kyle Pedersen. 2019. Triptech: A Method for Evaluating Early Design Concepts. In Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems - CHI EA '19, 1--8. https://doi.org/10.1145/3290607.3299061Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Simone Stumpf, Vidya Rajaram, Lida Li, Margaret Burnett, Thomas Dietterich, Erin Sullivan, Russell Drummond, and Jonathan Herlocker. 2007. Toward harnessing user feedback for machine learning. In Proceedings of the 12th international conference on Intelligent user interfaces - IUI '07, 82. https://doi.org/10.1145/1216295.1216316Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Jacob T. Browne. 2019. Wizard of Oz Prototyping for Machine Learning Experiences. In Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems - CHI EA '19, 1--6. https://doi.org/10.1145/3290607.3312877Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Jed R Wood and Larry E Wood. 2008. Card Sorting: Current Practices and Beyond. 4, 1: 6. https://doi.org/10.5555/2835577.2835578Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Dwayne D. Gremler. 2004. The Critical Incident Technique in Service Research. Journal of Service Research 7, 1: 65--89. https://doi.org/10.1177/1094670504266138Google ScholarGoogle ScholarCross RefCross Ref
  8. Barkhuus, L., Wohn, D.Y. Making the city my own: uses and practices of mobile location technologies for exploration of a new city. Pers Ubiquit Comput 23, 269--278 (2019) https://doi.org/10.1007/s00779-018-01191-zGoogle ScholarGoogle ScholarDigital LibraryDigital Library
  9. Virginia Braun and Victoria Clarke. 2006. Using thematic analysis in psychology. Qualitative Research in Psychology 3, 2: 77--101. https://doi.org/10.1191/1478088706qp063oaGoogle ScholarGoogle ScholarCross RefCross Ref
  10. Sruthi Viswanathan, Cecile Boulard, and Antonietta Maria Grasso. 2019. Ageing Clouds: Novel yet Natural Support for Urban Exploration. In Companion Publication of the 2019 on Designing Interactive Systems Conference 2019 Companion - DIS '19 Companion, 313--317. https://doi.org/10.1145/3301019.3323885Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Sihem Amer-Yahia, Ria M. Borromeo, Shady Elbassuoni, Behrooz Omidvar-Tehrani, and Sruthi Viswanathan. 2020. Interactive Generation and Cus-tomization of Travel Packages for Individuals and Groups. In25th Interna-tional Conference on Intelligent User Interfaces Companion (IUI '20 Compan-ion), March 17--20, 2020, Cagliari, Italy.ACM, New York, NY, USA, 2 pages. https://doi.org/10.1145/3379336.3381456Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Behrooz Omidvar-Tehrani, Sruthi Viswanathan, Frederic Roulland, Jean- Michel Renders. 2020. SAGE: Interactive State-aware Point-of-Interest Rec- ommendation. In WSDM Workshop SUM'20: State-based User Modelling, Feb- ruary 7, 2020, Houston, Texas, TX, USA. ACM, New York, NY, USA, 6 pages. https://www.k4all.org/wpcontent/uploads/2020/01/WSDMSUM20_paper_SA GE_Interactive_State_awarePoint_of_Interest_Recommendation.pdfGoogle ScholarGoogle Scholar
  13. Jie Bao, Yu Zheng, David Wilkie, and Mohamed Mokbel. Recommendations in location-based social networks: a survey. GeoInformatica, 2015 https://doi.org/10.1007/s10707-014-0220--8Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Hybrid Wizard of Oz: Concept Testing a Recommender System

      Recommendations

      Comments

      Login options

      Check if you have access through your login credentials or your institution to get full access on this article.

      Sign in
      • Published in

        cover image ACM Conferences
        CHI EA '20: Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems
        April 2020
        4474 pages
        ISBN:9781450368193
        DOI:10.1145/3334480

        Copyright © 2020 Owner/Author

        Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        • Published: 25 April 2020

        Check for updates

        Qualifiers

        • abstract

        Acceptance Rates

        Overall Acceptance Rate6,164of23,696submissions,26%

        Upcoming Conference

        CHI '24
        CHI Conference on Human Factors in Computing Systems
        May 11 - 16, 2024
        Honolulu , HI , USA

      PDF Format

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      HTML Format

      View this article in HTML Format .

      View HTML Format