Skip to main content
Springer Nature Link
Log in

Electroencephalography and Self-assessment Evaluation of Engagement with Online Exhibitions: Case Study of Google Arts and Culture

  • Conference paper
  • First Online:
Culture and Computing (HCII 2022)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 13324))

Included in the following conference series:

Abstract

The COVID-19 pandemic has and will continue to have an unprecedented impact on museums and exhibition galleries worldwide, with online visitors to museums and exhibitions increasing significantly. The most common method used by web user experience researchers to study user engagement is questionnaires, usually conducted after the user has completed the website experience and relying on the user’s memory and lingering feelings. Therefore, the purpose of this paper is to propose a new method of assessment based on a combination of user electroencephalography (EEG) signals and a self-assessment questionnaire (UES-SF). Since EEG signal measurement is a practical method to detect sequential changes in brain activity without significant time delays, it can comprehend visitors’ unconscious and sensory responses to online exhibitions. This paper employed the Google Arts & Culture (GA&C) website as an example to study 4 different exhibition formats and their impact on user engagement. The questionnaire results showed that the “game interaction” was significantly higher (p < 0.05) in terms of participation than the “2D information Kiosks” and “3D virtual exhibitions” and was the marginally significant (0.05 < p < 0.10) than “video explanation”. However, when we combined the EEG data, we could determine that “game interaction” had the highest user engagement, followed by “video explanation”, “3D virtual exhibition”, and the “2D information kiosk”. Therefore, our new evaluation approach can assist online exhibition user experience researchers in understanding the impact of different forms of interaction on engagement more comprehensively.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. United Nations Educational, Scientific and Cultural Organisation: UNESCO Report: Museums around the world in the face of COVID-19. UNESCO (2020). https://unesdoc.unesco.org/ark:/48223/pf0000373530/PDF/373530eng.pdf.multi

  2. United Nations Educational, Scientific and Cultural Organisation: UNESCO Report: Museums around the world in the face of COVID-19. UNESCO (2021). https://unesdoc.unesco.org/ark:/48223/pf0000376729_eng/PDF/376729eng.pdf.multi

  3. International Council of Museums: ICOM Report: Museums, museum professionals and Covid-19: third survey. ICOM (2021). https://icom.museum/wp-content/uploads/2021/07/Museums-and-Covid-19_third-ICOM-report.pdf

  4. Johnson, H.: Arts and culture in a ‘new normal.’ Psychologist 33, 98–99 (2020)

    Google Scholar 

  5. LaRocco, J., Le, M.D., Paeng, D.-G.: A systemic review of available low-cost EEG headsets used for drowsiness detection. Front. Neuroinform. 42 (2020)

    Google Scholar 

  6. King, E., et al.: Digital responses of UK museum exhibitions to the COVID-19 crisis, March–June 2020. Curator: Museum J. 64, 487–504 (2021)

    Google Scholar 

  7. O’Brien, H.L., Toms, E.G.: What is user engagement? A conceptual framework for defining user engagement with technology. J. Am. Soc. Inform. Sci. Technol. 59(6), 938–955 (2008)

    Article  Google Scholar 

  8. Jacques, R.D.: The nature of engagement and its role in hypermedia evaluation and design. Diss. South Bank University (1996)

    Google Scholar 

  9. O’Brien, H.: Defining and measuring engagement in user experiences with technology. ProQuest (2009)

    Google Scholar 

  10. Webster, J., Ho, H.: Audience engagement in multimedia presentations. ACM SIGMIS Database: Database Adv. Inf. Syst. 28(2), 63–77 (1997)

    Article  Google Scholar 

  11. O’Brien, H.L., Toms, E.G.: The development and evaluation of a survey to measure user engagement. J. Am. Soc. Inform. Sci. Technol. 61(1), 50–69 (2010)

    Article  Google Scholar 

  12. Baldauf, D., Burgard, E., Wittmann, M.: Time perception as a workload measure in simulated car driving. Appl. Ergon. 40(5), 929–935 (2009)

    Article  Google Scholar 

  13. Jennett, C., et al.: Measuring and defining the experience of immersion in games. Int. J. Hum.-Comput. Stud. 66(9), 641–661 (2008)

    Article  Google Scholar 

  14. Csikszentmihalyi, M., Csikzentmihaly, M.: Flow: The Psychology of Optimal Experience, vol. 1990. Harper & Row, New York (1990)

    Google Scholar 

  15. Ikehara, C.S., Crosby, M.E.: Assessing cognitive load with physiological sensors. In: Proceedings of the 38th Annual Hawaii International Conference on System Sciences. IEEE (2005)

    Google Scholar 

  16. Lewis, J.R.: Measuring perceived usability: SUS, UMUX, and CSUQ ratings for four everyday products. Int. J. Hum.-Comput. Interact. 35(15), 1404–1419 (2019)

    Article  Google Scholar 

  17. Jennings, M.: Theory and models for creating engaging and immersive ecommerce websites. In: Proceedings of the 2000 ACM SIGCPR Conference on Computer Personnel Research (2000)

    Google Scholar 

  18. Tractinsky, N., Katz, A.S., Ikar, D.: What is beautiful is usable. Interact. Comput. 13(2), 127–145 (2000)

    Article  Google Scholar 

  19. Read, J.C., MacFarlane, S., Casey, C.: Endurability, engagement and expectations: measuring children’s fun. In: Interaction Design and Children, vol. 2, no. 2002. Shaker Publishing, Eindhoven (2002)

    Google Scholar 

  20. Peterson, E.T.: How do you calculate engagement? Part I. Web Analytics Demystified (blog) (2006). http://blog.webanalyticsdemystified.com/weblog/2006/12/how-do-you-calculate-engagement-part-i.html. Accessed Oct 2009

  21. Piwowarski, B., Dupret, G., Jones, R.: Mining user web search activity with layered Bayesian networks or how to capture a click in its context. In: Proceedings of the Second ACM International Conference on Web Search and Data Mining (2009)

    Google Scholar 

  22. White, R.W., Dumais, S.T.: Characterizing and predicting search engine switching behavior. In: Proceedings of the 18th ACM Conference on Information and Knowledge Management (2009)

    Google Scholar 

  23. Huang, M.-H.: Designing website attributes to induce experiential encounters. Comput. Hum. Behav. 19(4), 425–442 (2003)

    Google Scholar 

  24. Said, N.S.: An engaging multimedia design model. In: Proceedings of the 2004 Conference on Interaction Design and Children: Building a Community (2004)

    Google Scholar 

  25. Attfield, S., et al.: Towards a science of user engagement (position paper). In: WSDM Workshop on User Modelling for Web Applications (2011)

    Google Scholar 

  26. Jap, B.T., et al.: Using EEG spectral components to assess algorithms for detecting fatigue. Expert Syst. Appl. 36(2), 2352–2359 (2009)

    Article  Google Scholar 

  27. Lalmas, M., O’Brien, H., Yom-Tov, E.: Measuring user engagement. Synth. Lect. Inf. Concepts Retrieval Serv. 6(4), 1–132 (2014)

    Google Scholar 

  28. O’Brien, H.L., Cairns, P., Hall, M.: A practical approach to measuring user engagement with the refined user engagement scale (UES) and new UES short form. Int. J. Hum. Comput. Stud. 112, 28–39 (2018)

    Article  Google Scholar 

  29. WIKIPEDIA, Google Arts & Culture Page. https://en.wikipedia.org/wiki/Google_Arts_%26_Culture#cite_note-15

  30. St. Francis College Library, Google Arts & Culture Page. https://library.sfc.edu/Google/artsandculture

  31. Carmo, M.B., Cláudio, A.P.: 3D virtual exhibitions. DESIDOC J. Libr. Inf. Technol. 33(3), 1–14 (2013)

    Google Scholar 

  32. Khurana, V., et al.: EEG based word familiarity using features and frequency bands combination. Cogn. Syst. Res. 49, 33–48 (2018)

    Article  MathSciNet  Google Scholar 

  33. EMOTIV. EPOC X. Product information page. https://www.emotiv.com/epoc-x/

  34. Andujar, M., Gilbert, J.E.: Let’s learn! Enhancing user’s engagement levels through passive brain-computer interfaces. In: CHI 2013 Extended Abstracts on Human Factors in Computing Systems, pp. 703–708 (2013)

    Google Scholar 

  35. Hart, J., Sutcliffe, A., di Angeli, A.: Evaluating user engagement theory (2012)

    Google Scholar 

  36. Denilson, B.T., Nouchi, R., Kawashima, R.: Does video gaming have impacts on the brain: evidence from a systematic review. Brain Sci. 9(10), 251 (2019)

    Article  Google Scholar 

  37. Aboulafia, A., Bannon, L.J.: Understanding affect in design: an outline conceptual framework. Theor. Issues Ergon. Sci. 5(1), 4–15 (2004)

    Article  Google Scholar 

  38. O’Brien, H.L., Toms, E.G.: Examining the generalizability of the User Engagement Scale (UES) in exploratory search. Inf. Process. Manag. 49(5), 1092–1107 (2013)

    Article  Google Scholar 

  39. Kowatari, Y., et al.: Neural networks involved in artistic creativity. Hum. Brain Mapp. 30(5), 1678–1690 (2009)

    Article  Google Scholar 

Download references

Acknowledgements

This work was supported by JST SPRING (grant number JPMJSP2124), and CREST (grant number JPMJCR19F2).

Author information

Authors and Affiliations

  1. Library and Information Media, University of Tsukuba, Tsukuba, Japan

    Jingjing Li, Vargas Meza Xanat & Yoichi Ochiai

  2. Zhejiang University, Hangzhou, Zhejiang, China

    Chengbo Sun

Authors
  1. Jingjing Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Chengbo Sun
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Vargas Meza Xanat
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Yoichi Ochiai
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Jingjing Li .

Editor information

Editors and Affiliations

  1. Eindhoven University of Technology, Eindhoven, The Netherlands

    Matthias Rauterberg

Rights and permissions

Reprints and permissions

Copyright information

© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Li, J., Sun, C., Xanat, V.M., Ochiai, Y. (2022). Electroencephalography and Self-assessment Evaluation of Engagement with Online Exhibitions: Case Study of Google Arts and Culture. In: Rauterberg, M. (eds) Culture and Computing. HCII 2022. Lecture Notes in Computer Science, vol 13324. Springer, Cham. https://doi.org/10.1007/978-3-031-05434-1_21

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-05434-1_21

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-05433-4

  • Online ISBN: 978-3-031-05434-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics