skip to main content
10.1145/3639701.3656320acmconferencesArticle/Chapter ViewAbstractPublication PagesimxConference Proceedingsconference-collections
research-article

CoAR-TV: Design and Evaluation of Asynchronous Collaboration in AR-Supported TV Experiences

Published: 07 June 2024 Publication History

Abstract

Television has long since been a uni-directional medium. However, when TV is used for educational purposes, like in edutainment shows, interactivity could enhance the learning benefit for the viewer. In recent years, AR has been increasingly explored in HCI research to enable interaction among viewers as well as viewers and hosts. Yet, how to implement this collaborative AR (CoAR) experience remains an open research question. This paper explores four approaches to asynchronous collaboration based on the Cognitive Apprenticeship Model: scaffolding, coaching, modeling, and collaborating. We developed a pilot show for a fictional edutainment series and evaluated the concept with two TV experts. In a wizard-of-oz study, we test our AR prototype with eight users and evaluate the perception of the four collaboration styles. The AR-enhanced edutainment concept was well-received by the participants, and the coaching collaboration style was perceived as favorable and could possibly be combined with the modeling style.

References

[1]
Ismo Alakärppä, Elisa Jaakkola, Jani Väyrynen, and Jonna Häkkilä. 2017. Using nature elements in mobile AR for education with children. In Proceedings of the 19th International Conference on Human-Computer Interaction with Mobile Devices and Services. ACM, Vienna Austria, 1–13. https://doi.org/10.1145/3098279.3098547
[2]
Rafael Ballagas, Thérèse E. Dugan, Glenda Revelle, Koichi Mori, Maria Sandberg, Janet Go, Emily Reardon, and Mirjana Spasojevic. 2013. Electric agents: fostering sibling joint media engagement through interactive television and augmented reality. In Proceedings of the 2013 conference on Computer supported cooperative work - CSCW ’13. ACM Press, San Antonio, Texas, USA, 225. https://doi.org/10.1145/2441776.2441803
[3]
Joey Benedek and Trish Miner. 2002. Measuring Desirability: New methods for evaluating desirability in a usability lab setting. Proceedings of Usability Professionals Association 2003, 8-12 (2002), 57.
[4]
Niels Ole Bernsen, Hans Dybkjær, and Laila Dybkjær. 1994. Wizard of oz prototyping: How and when. Proc. CCI Working Papers Cognit. Sci./HCI 1 (1994), 1–11.
[5]
John Brooke. 1996. Sus: a ‘quick and dirty’ usability. Usability evaluation in industry 189, 3 (1996), 189–194.
[6]
James Dean Brown. 2011. Likert items and scales of measurement. Statistics 15, 1 (2011), 10–14.
[7]
John Seely Brown, Allan Collins, and Paul Duguid. 1989. Situated cognition and the culture of learning. 1989 18, 1 (1989), 32–42.
[8]
Chien-Hsu Chen, Chun-Yen Huang, and Yin-Yu Chou. 2017. Integrating Augmented Reality into Blended Learning for Elementary Science Course. In Proceedings of the 5th International Conference on Information and Education Technology - ICIET ’17. ACM Press, Tokyo, Japan, 68–72. https://doi.org/10.1145/3029387.3029417
[9]
Jonathan Chow, Haoyang Feng, Robert Amor, and Burkhard C Wunsche. 2013. Music Education using Augmented Reality with a Head Mounted Display. User Interfaces 139 (2013), 73–79.
[10]
Richard K Coll, Bev France, and Ian Taylor. 2005. The role of models/and analogies in science education: implications from research. International Journal of Science Education 27, 2 (2005), 183–198.
[11]
Fernanda Dobal and Vali Lalioti. 2021. Circular Species: Designing critical thinking into children’s science education through biomaterials and augmented reality. In Interaction Design and Children. ACM, Athens Greece, 8–17. https://doi.org/10.1145/3459990.3460698
[12]
Andreas Dünser, Lawrence Walker, Heather Horner, and Daniel Bentall. 2012. Creating interactive physics education books with augmented reality. In Proceedings of the 24th Australian Computer-Human Interaction Conference on - OzCHI ’12. ACM Press, Melbourne, Australia, 107–114. https://doi.org/10.1145/2414536.2414554
[13]
Min Fan and Alissa N. Antle. 2020. An english language learning study with rural chinese children using an augmented reality app. In Proceedings of the Interaction Design and Children Conference. ACM, London United Kingdom, 385–397. https://doi.org/10.1145/3392063.3394409
[14]
Xu Han, Yayun Liu, Hongzhu Li, Zhenying Fan, and Heng Luo. 2020. Augmenting the Makerspace: Designing Collaborative Inquiry Through Augmented Reality. In Blended Learning. Education in a Smart Learning Environment(Lecture Notes in Computer Science), Simon K. S. Cheung, Richard Li, Kongkiti Phusavat, Naraphorn Paoprasert, and Lam‑For Kwok (Eds.). Springer International Publishing, Cham, 148–159. https://doi.org/10.1007/978-3-030-51968-1_13
[15]
Sarah Hatton, David Birchfield, and M. Colleen Megowan-Romanowicz. 2008. Learning Metaphor through Mixed-Reality Game Design and Game Play. In Proceedings of the 2008 ACM SIGGRAPH Symposium on Video Games (Los Angeles, California) (Sandbox ’08). Association for Computing Machinery, New York, NY, USA, 67–74. https://doi.org/10.1145/1401843.1401857
[16]
George E Hein. 1991. Constructivist learning theory. ICOM/CECA Annual Conference „The Museum and the Needs of People“ 1 (1991), 89–94.
[17]
Anthony Herrington and Jan Herrington. 2005. What is an authentic learning environment?IGI Global, Wollongong, Australia. 1–13 pages. https://doi.org/10.4018/978-1-59140-594-8.ch001
[18]
Jan Herrington and Lisa Kervin. 2007. Authentic learning supported by technology: Ten suggestions and cases of integration in classrooms. Educational Media International 44 (2007), 219–236. Issue 3. https://doi.org/10.1080/09523980701491666
[19]
Wu-Yuin Hwang, Yi-Jing Lin, Anh Hoang, Rio Nurtantyana, and Oscar Lin. 2022. Facilitating Geometry Learning Through Real-Time Collaborative Activities with Augmented Reality in Authentic Context. In Innovative Technologies and Learning(Lecture Notes in Computer Science), Yueh-Min Huang, Shu-Chen Cheng, João Barroso, and Frode Eika Sandnes (Eds.). Springer International Publishing, Cham, 79–87. https://doi.org/10.1007/978-3-031-15273-3_9
[20]
Sylvia Irawati, Sengpyo Hong, Jinwook Kim, and Heedong Ko. 2008. 3D edutainment environment: learning physics through VR/AR experiences. In Proceedings of the 2008 International Conference in Advances on Computer Entertainment Technology - ACE ’08. ACM Press, Yokohama, Japan, 21. https://doi.org/10.1145/1501750.1501755
[21]
David W. Johnson and Roger T. Johnson. 2009. An Educational Psychology Success Story: Social Interdependence Theory and Cooperative Learning. Educational Researcher 38, 5 (June 2009), 365–379. https://doi.org/10.3102/0013189X09339057
[22]
Juan A. Juanes, Daniel Hernández, Pablo Ruisoto, Elena García, Gabriel Villarrubia, and Alberto Prats. 2014. Augmented reality techniques, using mobile devices, for learning human anatomy. In Proceedings of the Second International Conference on Technological Ecosystems for Enhancing Multiculturality - TEEM ’14. ACM Press, Salamanca, Spain, 7–11. https://doi.org/10.1145/2669711.2669870
[23]
Hannes Kaufmann and Bernd Meyer. 2008. Simulating educational physical experiments in augmented reality. In ACM SIGGRAPH ASIA 2008 educators programme on - SIGGRAPH Asia ’08. ACM Press, Singapore, 1. https://doi.org/10.1145/1507713.1507717
[24]
Hannes Kaufmann and Dieter Schmalstieg. 2002. Mathematics and geometry education with collaborative augmented reality. In ACM SIGGRAPH 2002 conference abstracts and applications. ACM Press, San Antonio, Texas, United States of America, 37–41.
[25]
Seungwon Kim, Gun Lee, Weidong Huang, Hayun Kim, Woontack Woo, and Mark Billinghurst. 2019. Evaluating the Combination of Visual Communication Cues for HMD-based Mixed Reality Remote Collaboration. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. ACM, Glasgow Scotland Uk, 1–13. https://doi.org/10.1145/3290605.3300403
[26]
Bettina Laugwitz, Theo Held, and Martin Schrepp. 2008. Construction and evaluation of a user experience questionnaire. In HCI and Usability for Education and Work: 4th Symposium of the Workgroup Human-Computer Interaction and Usability Engineering of the Austrian Computer Society, USAB 2008, Graz, Austria, November 20-21, 2008. Proceedings 4. Springer, Graz, Austria, 63–76.
[27]
Nai Li, Yuan Xun Gu, Leanne Chang, and Henry Been-Lirn Duh. 2011. Sociality of Mobile Collaborative AR: Augmenting a Dual-Problem Space for Social Interaction in Collaborative Social Learning. In 2011 IEEE 11th International Conference on Advanced Learning Technologies. IEEE, Athens, GA, USA, 467–469. https://doi.org/10.1109/ICALT.2011.145
[28]
Robb Lindgren and J. Michael Moshell. 2011. Supporting children’s learning with body-based metaphors in a mixed reality environment. In Proceedings of the 10th International Conference on Interaction Design and Children - IDC ’11. ACM Press, Ann Arbor, Michigan, 177–180. https://doi.org/10.1145/1999030.1999055
[29]
Breanne K. Litts and Whitney E. Lewis. 2019. Mobile Augmented Reality: Exploring a new genre of learning. GetMobile: Mobile Computing and Communications 22, 3 (Jan. 2019), 5–9. https://doi.org/10.1145/3308755.3308757
[30]
Wei Liu, Adrian David Cheok, Charissa Lim Mei-Ling, and Yin-Leng Theng. 2007. Mixed reality classroom: learning from entertainment. In Proceedings of the 2nd international conference on Digital interactive media in entertainment and arts - DIMEA ’07. ACM Press, Perth, Australia, 65. https://doi.org/10.1145/1306813.1306833
[31]
Maria Luisa Lorusso, Marisa Giorgetti, Simona Travellini, Luca Greci, Andrea Zangiacomi, Marta Mondellini, Marco Sacco, and Gianluigi Reni. 2016. Giok: an alien stimulates pragmatic and social skills in pre-school children. In Proceedings of the 4th Workshop on ICTs for improving Patients Rehabilitation Research Techniques - REHAB ’16. ACM Press, Lisbon, Portugal, 89–92. https://doi.org/10.1145/3051488.3051500
[32]
Thibault Louis, Jocelyne Troccaz, Amélie Rochet-Capellan, Nady Hoyek, and François Bérard. 2020. When High Fidelity Matters: AR and VR Improve the Learning of a 3D Object. In Proceedings of the International Conference on Advanced Visual Interfaces. ACM, Salerno Italy, 1–9. https://doi.org/10.1145/3399715.3399815
[33]
Jorge Martín-Gutiérrez, Peña Fabiani, Wanda Benesova, María Dolores Meneses, and Carlos E. Mora. 2015. Augmented reality to promote collaborative and autonomous learning in higher education. Computers in Human Behavior 51 (Oct. 2015), 752–761. https://doi.org/10.1016/j.chb.2014.11.093
[34]
Anjela Mayer, Théo Combe, Jean-Rémy Chardonnet, and Jivka Ovtcharova. 2022. Asynchronous Manual Work in Mixed Reality Remote Collaboration. In Extended Reality(Lecture Notes in Computer Science), Lucio Tommaso De Paolis, Pasquale Arpaia, and Marco Sacco (Eds.). Springer Nature Switzerland, Cham, 17–33. https://doi.org/10.1007/978-3-031-15553-6_2
[35]
Paul Milgram, Herman Colquhoun, 1999. A taxonomy of real and virtual world display integration. Mixed reality: Merging real and virtual worlds 1, 1999 (1999), 1–26.
[36]
Paul Milgram, Haruo Takemura, Akira Utsumi, and Fumio Kishino. 1995. Augmented reality: A class of displays on the reality-virtuality continuum. In Telemanipulator and telepresence technologies, Vol. 2351. International Society for Optics and Photonics, SPIE, Boston, MA, United States, 282–292. https://doi.org/10.1117/12.197321
[37]
Sebastian Oberdörfer, Anne Elsässer, Silke Grafe, and Marc Erich Latoschik. 2021. Grab the Frog: Comparing Intuitive Use and User Experience of a Smartphone-only, AR-only, and Tangible AR Learning Environment. In Proceedings of the 23rd International Conference on Mobile Human-Computer Interaction. ACM, Toulouse & Virtual France, 1–12. https://doi.org/10.1145/3447526.3472016
[38]
Yoon Jung Park, Yoonsik Yang, Hyocheol Ro, Jinwon Cha, Kyuri Kim, and Tack Don Han. 2018. ChildAR-bot: Educational Playing Projection-based AR Robot for Children. In Proceedings of the 26th ACM international conference on Multimedia. ACM, Seoul Republic of Korea, 1278–1282. https://doi.org/10.1145/3240508.3241362
[39]
José J. Pazos-Arias, Martín López-Nores, Jorge García-Duque, Rebeca P. Díaz-Redondo, Yolanda Blanco-Fernández, Manuel Ramos-Cabrer, Alberto Gil-Solla, and Ana Fernández-Vilas. 2008. Provision of distance learning services over Interactive Digital TV with MHP. Computers & Education 50, 3 (April 2008), 927–949. https://doi.org/10.1016/j.compedu.2006.09.008
[40]
Lyn Pemberton and Marcus Winter. 2009. Collaborative Augmented Reality in Schools. In Proceedings of the 9th International Conference on Computer Supported Collaborative Learning - Volume 2 (Rhodes, Greece) (CSCL’09). International Society of the Learning Sciences, Rhodes, Greece, 109–111.
[41]
Danakorn Nincarean Eh Phon, Mohamad Bilal Ali, and Noor Dayana Abd Halim. 2014. Collaborative Augmented Reality in Education: A Review. In 2014 International Conference on Teaching and Learning in Computing and Engineering. IEEE, Kuching, Malaysia, 78–83. https://doi.org/10.1109/LaTiCE.2014.23
[42]
Fadila Aulia Pritami and Izzati Muhimmah. 2018. Digital Game Based Learning using Augmented Reality for Mathematics Learning. In Proceedings of the 2018 7th International Conference on Software and Computer Applications. ACM, Kuantan Malaysia, 254–258. https://doi.org/10.1145/3185089.3185143
[43]
Iulian Radu, Tugce Joy, Yiran Bowman, Ian Bott, and Bertrand Schneider. 2021. A Survey of Needs and Features for Augmented Reality Collaborations in Collocated Spaces. Proceedings of the ACM on Human-Computer Interaction 5, CSCW1 (April 2021), 1–21. https://doi.org/10.1145/3449243
[44]
Iulian Radu and Bertrand Schneider. 2019. What Can We Learn from Augmented Reality (AR)? Benefits and Drawbacks of AR for Inquiry-Based Learning of Physics. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI ’19). Association for Computing Machinery, New York, NY, USA, 1–12. https://doi.org/10.1145/3290605.3300774
[45]
Mary Joy H. Ramos and Benilda Eleonor V. Comendador. 2019. ARTitser: A Mobile Augmented Reality in Classroom Interactive Learning Tool on Biological Science for Junior High School Students. In Proceedings of the 2019 5th International Conference on Education and Training Technologies - ICETT 2019. ACM Press, Seoul, Republic of Korea, 135–139. https://doi.org/10.1145/3337682.3337700
[46]
Thomas C. Reeves, Jan Herrington, and Ron Oliver. 2013. Authentic activities and online learning. Journal of Chemical Information and Modeling 53, 9 (2013), 1689–1699. https://doi.org/10.1017/CBO9781107415324.004 arxiv:arXiv:1011.1669v3
[47]
Mélanie Remmer, Maria Denami, and Pascal Marquet. 2017. Why Pokémon GO is the future of school education: Effects of AR on intrinsic motivation of children at elementary school. In Proceedings of the Virtual Reality International Conference - Laval Virtual 2017. ACM, Laval France, 1–5. https://doi.org/10.1145/3110292.3110293
[48]
Glenda Revelle, Emily Reardon, Kristin Cook, Lori Takeuchi, Rafael Ballagas, Koichi Mori, Hiroshi Horii, Hayes Raffle, Maria Sandberg, and Mirjana Spasojevic. 2014. Electric Agents: Combining Collaborative Mobile Augmented Reality and Web-Based Video to Reinvent Interactive Television. Computers in Entertainment 12, 3 (Sept. 2014), 1–21. https://doi.org/10.1145/2702109.2633413
[49]
Pejman Saeghe, Gavin Abercrombie, Bruce Weir, Sarah Clinch, Stephen Pettifer, and Robert Stevens. 2020. Augmented Reality and Television: Dimensions and Themes. In Proceedings of the 2020 ACM International Conference on Interactive Media Experiences (Cornella, Barcelona, Spain) (IMX ’20). Association for Computing Machinery, New York, NY, USA, 13–23. https://doi.org/10.1145/3391614.3393649
[50]
Hanna Kathrin Schraffenberger. 2018. Arguably augmented reality: relationships between the virtual and the real. Ph. D. Dissertation. University of Leiden.
[51]
Mickael Sereno, Xiyao Wang, Lonni Besancon, Michael J Mcguffin, and Tobias Isenberg. 2020. Collaborative Work in Augmented Reality: A Survey. IEEE Transactions on Visualization and Computer Graphics 28 (2020), 1–1. https://doi.org/10.1109/TVCG.2020.3032761
[52]
Tomer Sharon. 2013. The Rainbow Spreadsheet: A Collaborative Lean UX Research Tool. Smashingpost Magazine. https://www.smashingmagazine.com/2013/04/rainbow-spreadsheet-collaborative-ux-research-tool/.
[53]
Arezoo Shirazi and Amir H. Behzadan. 2013. Technology-enhanced learning in construction education using mobile context-aware augmented reality visual simulation. In 2013 Winter Simulations Conference (WSC). IEEE, Washington, DC, USA, 3074–3085. https://doi.org/10.1109/WSC.2013.6721675
[54]
Evropi Stefanidi, Maria Korozi, Asterios Leonidis, Dimitrios Arampatzis, Margherita Antona, and George Papagiannakis. 2021. When Children Program Intelligent Environments: Lessons Learned from a Serious AR Game. In Interaction Design and Children. ACM, Athens Greece, 375–386. https://doi.org/10.1145/3459990.3462463
[55]
Erin M Steffes and Philippe Duverger. 2012. Edutainment with videos and its positive effect on long term memory. Journal for Advancement of Marketing Education 20, 1 (2012), 1–10.
[56]
Radu-Daniel Vatavu, Pejman Saeghe, Teresa Chambel, Vinoba Vinayagamoorthy, and Marian F Ursu. 2020. Conceptualizing Augmented Reality Television for the Living Room. In Proceedings of the 2020 ACM International Conference on Interactive Media Experiences (Cornella, Barcelona, Spain) (IMX ’20). Association for Computing Machinery, New York, NY, USA, 1–12. https://doi.org/10.1145/3391614.3393660
[57]
Ana Villanueva, Zhengzhe Zhu, Ziyi Liu, Kylie Peppler, Thomas Redick, and Karthik Ramani. 2020. Meta-AR-App: An Authoring Platform for Collaborative Augmented Reality in STEM Classrooms. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI ’20). Association for Computing Machinery, New York, NY, USA, 1–14. https://doi.org/10.1145/3313831.3376146
[58]
Ana Villanueva, Zhengzhe Zhu, Ziyi Liu, Feiyang Wang, Subramanian Chidambaram, and Karthik Ramani. 2022. ColabAR: A Toolkit for Remote Collaboration in Tangible Augmented Reality Laboratories. Proceedings of the ACM on Human-Computer Interaction 6, CSCW1 (March 2022), 1–22. https://doi.org/10.1145/3512928
[59]
Rholeo O. Virata and Johan Daryll L. Castro. 2019. Augmented reality in science classroom: perceived effects in education, visualization and information processing. In Proceedings of the 10th International Conference on E-Education, E-Business, E-Management and E-Learning - IC4E ’19. ACM Press, Tokyo, Japan, 85–92. https://doi.org/10.1145/3306500.3306556
[60]
Katrin Vogt and Andrea Hechenleitner. 2007. Theorien des Lernens: Folgerungen für das Lehren. Broschüre des Staatsinstituts für Schulqualität und Bildungsforschung, München 1 (2007), 1–12. https://doi.org/10.1016/0885-3924(94)90124-4
[61]
Burkhard Vollmers. 1997. LEARNING BY DOING – PIAGETS KONSTRUKTIVISTISCHE LERNTHEORIE UND IHRE KONSEQUENZEN FÜR DIE PÄDAGOGISCHE PRAXIS. International review of education 43, 95 (1997), 73–85.
[62]
Simon von der Au, Leon Giering, Christina Schneegass, and Markus Ludwig. 2020. The SpaceStation App: Design and Evaluation of an AR Application for Educational Television. In ACM International Conference on Interactive Media Experiences. ACM, Cornella, Barcelona Spain, 24–33. https://doi.org/10.1145/3391614.3393655
[63]
Mikołaj P. Woźniak, Adam Lewczuk, Krzysztof Adamkiewicz, Jakub Józiewicz, Maya Malaya, and Piotr Ladonski. 2020. ARchemist: Aiding Experimental Chemistry Education Using Augmented Reality Technology. In Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems. ACM, Honolulu HI USA, 1–6. https://doi.org/10.1145/3334480.3381441
[64]
Nesra Yannier, Scott E. Hudson, Eliane Stampfer Wiese, and Kenneth R. Koedinger. 2016. Adding Physical Objects to an Interactive Game Improves Learning and Enjoyment: Evidence from EarthShake. ACM Trans. Comput.-Hum. Interact. 23, 4, Article 26 (Sept. 2016), 31 pages. https://doi.org/10.1145/2934668
[65]
Ying Li. 2010. Augmented Reality for remote education. In 2010 3rd International Conference on Advanced Computer Theory and Engineering(ICACTE), Vol. 3. IEEE, Chengdu, China, V3–187–V3–191. https://doi.org/10.1109/ICACTE.2010.5579661

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
IMX '24: Proceedings of the 2024 ACM International Conference on Interactive Media Experiences
June 2024
465 pages
ISBN:9798400705038
DOI:10.1145/3639701
  • Editors:
  • Asreen Rostami,
  • Donald McMillan,
  • Jonathan Hook,
  • Irene Viola,
  • Jun Nishida,
  • Hanuma Teja Maddali,
  • Alexis Clay
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 June 2024

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. AR
  2. collaboration
  3. edutainment
  4. interactive television
  5. mobile

Qualifiers

  • Research-article
  • Research
  • Refereed limited

Conference

IMX '24

Acceptance Rates

Overall Acceptance Rate 69 of 245 submissions, 28%

Upcoming Conference

IMX '25

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • 0
    Total Citations
  • 107
    Total Downloads
  • Downloads (Last 12 months)107
  • Downloads (Last 6 weeks)10
Reflects downloads up to 11 Feb 2025

Other Metrics

Citations

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media