Skip to main content
Springer Nature Link
Log in

Using AR Headset Camera to Track Museum Visitor Attention: Initial Development Phase

  • Conference paper
  • First Online:
Virtual, Augmented and Mixed Reality: Applications in Education, Aviation and Industry (HCII 2022)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 13318))

Included in the following conference series:

  • 2146 Accesses

Abstract

Augmented Reality (AR) has become one of the mainstream media volumes. In museums, AR applications are being implemented to enhance visitor experience. Analyzing the museum visitor experience is crucial for a museum to provide better service to society. Head-mounted cameras and eye-tracking headsets can be used to analyze visitor experience. With the AR headsets becoming part of museum exhibitions, one can utilize these headsets to track and analyze visitor experience. This research aims to improve on the existing work on tracking museum visitor experience using AR headsets. Specifically, this paper discusses an experiment performed at the Jule Collins Museum of Fine Arts at Auburn, Alabama. Visitors’ attention towards exhibits was measured using an AR headset camera. Visitor exit surveys were collected reflecting on the visitor experience. This paper illustrates the applicability and failures of analyzing visitor experience with AR headset camera for different exhibits and scenarios. This paper also provides insight into the following issues: privacy concerns with using AR headsets in museums and the ways AR headsets affect visitor experience and behavior.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Al-Baddai, S., Ströhl, B., Lang, E.W., Ludwig, B.: Do museum visitors see what educators want them to see? In: Adjunct Publication of the 25th Conference on User Modeling, Adaptation and Personalization (2017)

    Google Scholar 

  2. Michael, B., et al.: Automatic recognition and augmentation of attended objects in real-time using eye tracking and a head-mounted display. In: ACM Symposium on Eye Tracking Research and Applications (2021)

    Google Scholar 

  3. Desai, N.: Recreation of history using augmented reality. ACCENTS Trans. Image Process. Comput. Vis. 4(10), 1–5 (2018)

    Article  Google Scholar 

  4. Ding, M.: Augmented Reality in Museums, pp. 3–8. Arts Management and Technology Laboratory, Heinz College (2017)

    Google Scholar 

  5. Eghbal-Azar, K., Widlok, T.: Potentials and limitations of mobile eye tracking in visitor studies: evidence from field research at two museum exhibitions in Germany. Soc. Sci. Comput. Rev. 31(1), 103–118 (2013)

    Article  Google Scholar 

  6. Raphaela, G., Amrhein, A., Krug, M., Pitsch, K.: Towards using eyetracking data as basis for conversation analysis on real-world museum interaction. In: SAGA-International Workshop on Solutions for Automatic Gaze Data Analysis: Proceedings (2015)

    Google Scholar 

  7. Hieronymus, G.H.L.M, Van Opstal, A.J.: Human eye-head coordination in two dimensions under different sensorimotor conditions. Exper. Brain Res. 114.3, 542–560 (1997)

    Google Scholar 

  8. Peter, G.: Mixed Reality Lynx R-1 Gets Huge Price Drop, Launching September Kickstarter. VRFocus (2021). https://www.vrfocus.com/2021/07/mixed-reality-lynx-r-1-gets-huge-price-drop-launching-september-kickstarter/

  9. Luiza, P.I., Borza, A.: Factors influencing museum sustainability and indicators for museum sustainability measurement. Sustainability 8.1, 101 (2016)

    Google Scholar 

  10. Sebastian, K., et al.: ARETT: augmented reality eye tracking toolkit for head mounted displays. Sensors 21.6, 2234 (2021)

    Google Scholar 

  11. Magic Leap: Reality Is Just Beginning. Spatial Computing for Enterprise—Magic Leap. www.magicleap.com/en-us

  12. Marius’t Bernard, H., et al.: Gaze allocation in natural stimuli: comparing free exploration to head-fixed viewing conditions. Vis. Cogn. 17.6–7, 1132–1158 (2009)

    Google Scholar 

  13. Merriman, N.: Museum collections and sustainability. Cultural Trends 17(1), 3–21 (2008)

    Article  Google Scholar 

  14. Microsoft HoloLens: Mixed Reality Technology for Business. Microsoft HoloLens; Mixed Reality Technology for Business. www.microsoft.com/en-us/hololens?icid=SSM_AS_Promo_Devices_HoloLens2

  15. Moverio BT-350 Smart Glasses. Moverio BT-350 Smart Glasses; Smart Glasses; Wearables; For Work; Epson US. www.epson.com/For-Work/Wearables/Smart-Glasses/Moverio-BT-350-Smart-Glasses/p/V11H837020#

  16. Naspetti, S., Pierdicca, R., Mandolesi, S., Paolanti, M., Frontoni, E., Zanoli, R.: Automatic analysis of eye-tracking data for augmented reality applications: a prospective outlook. In: De Paolis, L.T., Mongelli, A. (eds.) AVR 2016. LNCS, vol. 9769, pp. 217–230. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-40651-0_17

  17. Francis, Q., Ehrich, R., Lockhart, T.: As go the feet... on the estimation of attentional focus from stance. In: Proceedings of the 10th International Conference on Multimodal Interfaces (2008)

    Google Scholar 

  18. Ali, S.R., et al.: Estimating attention in exhibitions using wearable cameras. In: 2014 22nd International Conference on Pattern Recognition. IEEE (2014)

    Google Scholar 

  19. Beverly, S.: Paying attention: the duration and allocation of visitors’ time in museum exhibitions. Curator Museum J. 40.2, 108–125 (1997)

    Google Scholar 

  20. Clara, S., et al.: Using a head-mounted camera to infer attention direction. Int. J. Behav. Dev. 37.5, 468–474 (2013)

    Google Scholar 

  21. The Future of Mixed Reality, Now. Lynx. https://lynx-r.com/

  22. Wessel, D., Mayr, E., Knipfer, K.: Re-viewing the museum visitor’s view. Workshop Research Methods in Informal and Mobile Learning. Institute of Education, London, UK (2007)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Auburn University, Auburn, USA

    Nikolay Sargsyan & Cheryl Seals

Authors
  1. Nikolay Sargsyan
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Cheryl Seals
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Nikolay Sargsyan .

Editor information

Editors and Affiliations

  1. U.S. Army Research Laboratory, Aberdeen Proving Ground, MD, USA

    Jessie Y. C. Chen

  2. U.S. Army Combat Capabilities Development Command Soldier Center, Orlando, FL, USA

    Gino Fragomeni

Rights and permissions

Reprints and permissions

Copyright information

© 2022 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Sargsyan, N., Seals, C. (2022). Using AR Headset Camera to Track Museum Visitor Attention: Initial Development Phase. In: Chen, J.Y.C., Fragomeni, G. (eds) Virtual, Augmented and Mixed Reality: Applications in Education, Aviation and Industry. HCII 2022. Lecture Notes in Computer Science, vol 13318. Springer, Cham. https://doi.org/10.1007/978-3-031-06015-1_6

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-06015-1_6

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-06014-4

  • Online ISBN: 978-3-031-06015-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics