skip to main content
10.1145/3313831.3376146acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
research-article

Meta-AR-App: An Authoring Platform for Collaborative Augmented Reality in STEM Classrooms

Published: 23 April 2020 Publication History

Abstract

Augmented Reality (AR) has become a valuable tool for education and training processes. Meanwhile, cloud-based technologies can foster collaboration and other interaction modalities to enhance learning. We combine the cloud capabilities with AR technologies to present Meta-AR-App, an authoring platform for collaborative AR, which enables authoring between instructors and students. Additionally, we introduce a new application of an established collaboration process, the pull-based development model, to enable sharing and retrieving of AR learning content. We customize this model and create two modalities of interaction for the classroom: local (student to student) and global (instructor to class) pull. Based on observations from our user studies, we organize a four-category classroom model which implements our system: Work, Design, Collaboration, and Technology. Further, our system enables an iterative improvement workflow of the class content and enables synergistic collaboration that empowers students to be active agents in the learning process.

Supplemental Material

MP4 File
MP4 File
Preview video
MP4 File
Supplemental video

References

[1]
Mohd Yusof Abdullah, Noor Rahamah Abu Bakar, and Maizatul Haizan Mahbob. 2012. Student's Participation in Classroom: What Motivates them to Speak up? Procedia-Social and Behavioral Sciences 51 (2012), 516--522.
[2]
Ronald T. Azuma. 1997. A survey of augmented reality. Presence: Teleoperators & Virtual Environments 6, 4 (1997), 355--385.
[3]
Elham Beheshti, David Kim, Gabrielle Ecanow, and Michael S Horn. 2017. Looking inside the wires: Understanding museum visitor learning with an augmented circuit exhibit. In Proceedings of the 2017 chi conference on human factors in computing systems. ACM, 1583--1594.
[4]
Bhaskar Bhattacharya. 2016. Automatic generation of augmented reality guided assembly instructions using expert demonstration. (2016).
[5]
Bhaskar Bhattacharya and Eliot Winer. 2015. A method for real-time generation of augmented reality work instructions via expert movements. In The Engineering Reality of Virtual Reality 2015, Vol. 9392. International Society for Optics and Photonics, 93920G.
[6]
Bhaskar Bhattacharya and Eliot H Winer. 2019. Augmented reality via expert demonstration authoring (AREDA). Computers in Industry 105 (2019), 61--79.
[7]
Josh Brown, Ryan Brown, and Chris Merrill. 2011. Science and technology educators' enacted curriculum: Areas of possible collaboration for an integrative STEM approach in public schools. Technology and Engineering Teacher 71, 4 (2011), 30.
[8]
Stuart K Card, Allen Newell, and Thomas P Moran. 1983. The Psychology of Human-Computer Interaction. (1983).
[9]
Hsin-Yi Chang, Hsin-Kai Wu, and Ying-Shao Hsu. 2013. Integrating a mobile augmented reality activity to contextualize student learning of a socioscientific issue. British Journal of Educational Technology 44, 3 (2013), E95--E99.
[10]
Tosti HC Chiang, Stephen JH Yang, and Gwo-Jen Hwang. 2014. Students' online interactive patterns in augmented reality-based inquiry activities. Computers & Education 78 (2014), 97--108.
[11]
Jinhyuk Choi, Youngsun Kim, Myonghee Lee, Gerard J. Kim, Yanghee Nam, and Yongmoo Kwon. 2010. k-MART: Authoring tool for mixed reality contents. In 2010 IEEE International Symposium on Mixed and Augmented Reality. IEEE, 219--220.
[12]
Manuel Condado, Isabel Morais, Ryan Quinn, Sahil Patel, Patricia Morreale, Ed Johnston, and Elizabeth Hyde. 2019. Integrating Historical Content with Augmented Reality in an Open Environment. In International Conference on Human-Computer Interaction. Springer, 196--205.
[13]
S Coquillart, M Göbel, and others. 2004. Authoring of mixed reality applications including multi-marker calibration for mobile devices. In Eurographics Symposium on Virtual Environments (2004). 1--9.
[14]
National Research Council and others. 2012. A framework for K-12 science education: Practices, crosscutting concepts, and core ideas. National Academies Press.
[15]
Matt Dunleavy, Chris Dede, and Rebecca Mitchell. 2009. Affordances and limitations of immersive participatory augmented reality simulations for teaching and learning. Journal of science Education and Technology 18, 1 (2009), 7--22.
[16]
Mesut Duran, Margret Höft, Dan B. Lawson, Brahim Medjahed, and Elsayed A Orady. 2014. Urban high school students' IT/STEM learning: Findings from a collaborative inquiry-and design-based afterschool program. Journal of Science Education and Technology 23, 1 (2014), 116--137.
[17]
Daniel Eckhoff, Christian Sandor, Christian Lins, Ulrich Eck, Denis Kalkofen, and Andreas Hein. 2018. TutAR: augmented reality tutorials for hands-only procedures. In Proceedings of the 16th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and its Applications in Industry. ACM, 8.
[18]
Hesham El-Rewini and Mostafa Abd-El-Barr. 2005. Advanced computer architecture and parallel processing. Vol. 42. John Wiley & Sons.
[19]
Barrett Ens, Fraser Anderson, Tovi Grossman, Michelle Annett, Pourang Irani, and George Fitzmaurice. 2017. Ivy: Exploring spatially situated visual programming for authoring and understanding intelligent environments. In Proceedings of the 43rd Graphics Interface Conference. Canadian Human-Computer Communications Society, 156--162.
[20]
Josephine A. Gasiewski, M. Kevin Eagan, Gina .A Garcia, Sylvia Hurtado, and Mitchell J. Chang. 2012. From gatekeeping to engagement: A multicontextual, mixed method study of student academic engagement in introductory STEM courses. Research in higher education 53, 2 (2012), 229--261.
[21]
Georgios Gousios, Martin Pinzger, and Arie van Deursen. 2014. An exploratory study of the pull-based software development model. In Proceedings of the 36th International Conference on Software Engineering. ACM, 345--355.
[22]
Georgios Gousios, Margaret-Anne Storey, and Alberto Bacchelli. 2016. Work practices and challenges in pull-based development: the contributor's perspective. In Software Engineering (ICSE), 2016 IEEE/ACM 38th International Conference on. IEEE, 285--296.
[23]
Georgios Gousios, Andy Zaidman, Margaret-Anne Storey, and Arie Van Deursen. 2015. Work practices and challenges in pull-based development: the integrator's perspective. In Proceedings of the 37th International Conference on Software Engineering-Volume 1. IEEE Press, 358--368.
[24]
Paul Grimm, Michael Haller, Volker Paelke, Silvan Reinhold, Christian Reimann, and R. Zauner. 2002. AMIRE-authoring mixed reality. In Augmented Reality Toolkit, The First IEEE International Workshop. IEEE, 2--pp.
[25]
Blippar Group. 2019a. Blippar. https://www.blippar.com/
[26]
Blippar Group. 2019b. Layar. https://www.layar.com/
[27]
Jens Grubert, Tobias Langlotz, and Raphaël Grasset. 2011. Augmented reality browser survey. Institute for computer graphics and vision, University of Technology Graz, technical report 1101 (2011).
[28]
Sinem Guven, Steven Feiner, and Ohan Oda. 2006. Mobile augmented reality interaction techniques for authoring situated media on-site. In 2006 IEEE/ACM International Symposium on Mixed and Augmented Reality. IEEE, 235--236.
[29]
Taejin Ha, Mark Billinghurst, and Woontack Woo. 2011. An interactive 3D movement path manipulation method in an augmented reality environment. Interacting with Computers 24, 1 (2011), 10--24.
[30]
Apple Inc. 2019a. ARKit2. https://developer.apple.com/arkit/
[31]
Epic Games. Inc. 2019b. Unreal Engine. https://www.unrealengine.com/
[32]
GitHub Inc. 2019c. GitHub. https://github.com/
[33]
Andrew Irlitti, Ross T Smith, Stewart Von Itzstein, Mark Billinghurst, and Bruce H Thomas. 2016. Challenges for Asynchronous Collaboration in Augmented Reality. In 2016 IEEE International Symposium on Mixed and Augmented Reality (ISMAR-Adjunct). IEEE, 31--35.
[34]
Eric Klopfer and Kurt Squire. 2008. Environmental Detectives the development of an augmented reality platform for environmental simulations. Educational technology research and development 56, 2 (2008), 203--228.
[35]
Pascal Knierim, Francisco Kiss, and Albrecht Schmidt. 2018. Look Inside: Understanding Thermal Flux Through Augmented Reality. In 2018 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct). IEEE, 170--171.
[36]
Tobias Langlotz, Mathäus Zingerle, Raphael Grasset, Hannes Kaufmann, and Gerhard Reitmayr. 2012. AR record&replay: situated compositing of video content in mobile augmented reality. In Proceedings of the 24th Australian Computer-Human Interaction Conference. ACM, 318--326.
[37]
Gun A. Lee, Gerard J. Kim, and Mark Billinghurst. 2005. Immersive authoring: What you experience is what you get (wyxiwyg). Commun. ACM 48, 7 (2005), 76--81.
[38]
Gun A. Lee, Claudia Nelles, Mark Billinghurst, Mark Billinghurst, and Gerard Jounghyun Kim. 2004. Immersive authoring of tangible augmented reality applications. In Proceedings of the 3rd IEEE/ACM international Symposium on Mixed and Augmented Reality. IEEE Computer Society, 172--181.
[39]
Gun A Lee, Ungyeon Yang, Yongwan Kim, Dongsik Jo, Ki-Hong Kim, Jae Ha Kim, and Jin Sung Choi. 2009. Freeze-Set-Go interaction method for handheld mobile augmented reality environments. In Proceedings of the 16th ACM Symposium on Virtual Reality Software and Technology. ACM, 143--146.
[40]
Google LLC. 2019. ARCore. https://developers.google.com/ar/
[41]
Yao Lu, Xinjun Mao, Gang Yin, Tao Wang, and Yu Bai. 2017. Using Pull-Based Collaborative Development Model in Software Engineering Courses: A Case Study. In International Conference on Database Systems for Advanced Applications. Springer, 399--410.
[42]
Blair MacIntyre, Maribeth Gandy, Steven Dow, and Jay David Bolter. 2004. DART: a toolkit for rapid design exploration of augmented reality experiences. In Proceedings of the 17th annual ACM symposium on User interface software and technology. ACM, 197--206.
[43]
Taylor Martin and Daniel L. Schwartz. 2005. Physically distributed learning: Adapting and reinterpreting physical environments in the development of fraction concepts. Cognitive science 29, 4 (2005), 587--625.
[44]
Richard E. Mayer and Roxana Moreno. 2003. Nine ways to reduce cognitive load in multimedia learning. Educational psychologist 38, 1 (2003), 43--52.
[45]
Maged Michael, Jose E. Moreira, Doron Shiloach, and Robert W. Wisniewski. 2007. Scale-up x scale-out: A case study using nutch/lucene. In 2007 IEEE International Parallel and Distributed Processing Symposium. IEEE, 1--8.
[46]
Peter Mohr, Bernhard Kerbl, Michael Donoser, Dieter Schmalstieg, and Denis Kalkofen. 2015. Retargeting technical documentation to augmented reality. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems. ACM, 3337--3346.
[47]
Peter Mohr, David Mandl, Markus Tatzgern, Eduardo Veas, Dieter Schmalstieg, and Denis Kalkofen. 2017. Retargeting Video Tutorials Showing Tools With Surface Contact to Augmented Reality. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. ACM, 6547--6558.
[48]
Katharina Mura, Nils Petersen, Markus Huff, and Tandra Ghose. 2013. IBES: a tool for creating instructions based on event segmentation. Frontiers in psychology 4 (2013), 994.
[49]
Alaeddin Nassani, Huidong Bai, Gun Lee, and Mark Billinghurst. 2015. Tag it!: AR annotation using wearable sensors. In SIGGRAPH Asia 2015 Mobile Graphics and Interactive Applications. ACM, 12.
[50]
Emmanuel Navarro, Franck Sajous, Bruno Gaume, Laurent Prévot, Hsieh ShuKai, Kuo Tzu-Yi, Pierre Magistry, and Huang Chu-Ren. 2009. Wiktionary and NLP: Improving synonymy networks. In Proceedings of the 2009 Workshop on The People's Web Meets NLP: Collaboratively Constructed Semantic Resources. Association for Computational Linguistics, 19--27.
[51]
Michael Nebeling and Maximilian Speicher. 2018. The Trouble with Augmented Reality/Virtual Reality Authoring Tools. In 2018 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct). IEEE, 333--337.
[52]
Jong-Seung Park. 2011. AR-Room: a rapid prototyping framework for augmented reality applications. Multimedia tools and applications 55, 3 (2011), 725--746.
[53]
Nils Petersen and Didier Stricker. 2012. Learning task structure from video examples for workflow tracking and authoring. In Mixed and Augmented Reality (ISMAR), 2012 IEEE International Symposium on. IEEE, 237--246.
[54]
Luke Phipps, Victor Alvarez, Sara de Freitas, Kevin Wong, Michael Baker, and Justin Pettit. 2016. Conserv-AR: A virtual and augmented reality mobile game to enhance students' awareness of wildlife conservation in Western Australia. Mobile Learning Futures--Sustaining Quality Research and Practice in Mobile Learning (2016), 214.
[55]
PTC. 2019. Vuforia Studio. https://studio.vuforia.com/
[56]
Kelly A. Rocca. 2010. Student participation in the college classroom: An extended multidisciplinary literature review. Communication education 59, 2 (2010), 185--213.
[57]
Hannu Salmi, Helena Thuneberg, and Mari-Pauliina Vainikainen. 2017. Making the invisible observable by Augmented Reality in informal science education context. International Journal of Science Education, Part B 7, 3 (2017), 253--268.
[58]
Dieter Schmalstieg, Anton Fuhrmann, Gerd Hesina, Zsolt Szalavári, L. Miguel Encarnaçao, Michael Gervautz, and Werner Purgathofer. 2002. The studierstube augmented reality project. Presence: Teleoperators & Virtual Environments 11, 1 (2002), 33--54.
[59]
Bertrand Schneider, Jenelle Wallace, Paulo Blikstein, and Roy Pea. 2013. Preparing for future learning with a tangible user interface: the case of neuroscience. IEEE Transactions on Learning Technologies 6, 2 (2013), 117--129.
[60]
Hartmut Seichter, Julian Looser, and Mark Billinghurst. 2008. ComposAR: An intuitive tool for authoring AR applications. In Proceedings of the 7th IEEE/ACM international symposium on mixed and augmented reality. IEEE Computer Society, 177--178.
[61]
Sofoklis Sotiriou and Franz X Bogner. 2008. Visualizing the invisible: augmented reality as an innovative science education scheme. Advanced Science Letters 1, 1 (2008), 114--122.
[62]
Andrew D Spaeth and Roderick S Black. 2012. Google Docs as a form of collaborative learning. (2012).
[63]
Kurt D Squire and Mingfong Jan. 2007. Mad City Mystery: Developing scientific argumentation skills with a place-based augmented reality game on handheld computers. Journal of science education and technology 16, 1 (2007), 5--29.
[64]
Jeffrey R Stowell, Terrah Oldham, and Dan Bennett. 2010. Using student response systems ("clickers") to combat conformity and shyness. Teaching of Psychology 37, 2 (2010), 135--140.
[65]
Unity Technologies. 2019. Unity Game Engine. https://unity3d.com/
[66]
Jayzon F Ty, Ma Mercedes T Rodrigo, and Marc Ericson C Santos. 2014. A Mobile Authoring Tool for AR Content Generation Using Images as Annotations. Philippine Information Technology Journal 7, 1 (2014), 61--70.
[67]
Jakob Voss. 2005. Measuring wikipedia. (2005).
[68]
Tory Williams, Jacqueline Krikorian, Jonathan Singer, Christopher Rakes, and Julia Ross. 2019. A High Quality Educative Curriculum in Engineering Fosters Pedagogical Growth. International Journal of Research in Education and Science 5, 2 (2019), 657--680.
[69]
Hsin-Kai Wu, Joseph S Krajcik, and Elliot Soloway. 2001. Promoting understanding of chemical representations: Students' use of a visualization tool in the classroom. Journal of Research in Science Teaching: The Official Journal of the National Association for Research in Science Teaching 38, 7 (2001), 821--842.
[70]
Hsin-Kai Wu, Silvia Wen-Yu Lee, Hsin-Yi Chang, and Jyh-Chong Liang. 2013. Current status, opportunities and challenges of augmented reality in education. Computers & education 62 (2013), 41--49.
[71]
Han Kyu Yoo and Jong Weon Lee. 2014. Mobile augmented reality system for in-situ 3D modeling and authoring. In 2014 International Conference on Big Data and Smart Computing (BIGCOMP). IEEE, 282--285.
[72]
Jeongmin Yu, Jin-u Jeon, Gabyong Park, Hyung-il Kim, and Woontack Woo. 2016. A Unified Framework for Remote Collaboration Using Interactive AR Authoring and Hands Tracking. In International Conference on Distributed, Ambient, and Pervasive Interactions. Springer, 132--141.
[73]
Yue Yu, Huaimin Wang, Vladimir Filkov, Premkumar Devanbu, and Bogdan Vasilescu. 2015. Wait for it: determinants of pull request evaluation latency on GitHub. In 2015 IEEE/ACM 12th Working Conference on Mining Software Repositories. IEEE, 367--371.
[74]
J Zhu, SK Ong, and AYC Nee. 2013. An authorable context-aware augmented reality system to assist the maintenance technicians. The International Journal of Advanced Manufacturing Technology 66, 9--12 (2013), 1699--1714.
[75]
J Zhu, Soh-Khim Ong, and Andrew YC Nee. 2015. A context-aware augmented reality assisted maintenance system. International Journal of Computer Integrated Manufacturing 28, 2 (2015), 213--225.

Cited By

View all
  • (2024)Integrating immersive technologies with STEM education: a systematic reviewFrontiers in Education10.3389/feduc.2024.14101639Online publication date: 20-Jun-2024
  • (2024)CoAR-TV: Design and Evaluation of Asynchronous Collaboration in AR-Supported TV ExperiencesProceedings of the 2024 ACM International Conference on Interactive Media Experiences10.1145/3639701.3656320(231-245)Online publication date: 7-Jun-2024
  • (2024)TouchEditorProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36314547:4(1-29)Online publication date: 12-Jan-2024
  • Show More Cited By

Index Terms

  1. Meta-AR-App: An Authoring Platform for Collaborative Augmented Reality in STEM Classrooms

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    CHI '20: Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems
    April 2020
    10688 pages
    ISBN:9781450367080
    DOI:10.1145/3313831
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 23 April 2020

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. augmented reality
    2. authoring
    3. classroom
    4. collaboration
    5. electrical circuitry
    6. git
    7. pull-based model
    8. stem
    9. version control

    Qualifiers

    • Research-article

    Funding Sources

    Conference

    CHI '20
    Sponsor:

    Acceptance Rates

    Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

    Upcoming Conference

    CHI 2025
    ACM CHI Conference on Human Factors in Computing Systems
    April 26 - May 1, 2025
    Yokohama , Japan

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)209
    • Downloads (Last 6 weeks)12
    Reflects downloads up to 25 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)Integrating immersive technologies with STEM education: a systematic reviewFrontiers in Education10.3389/feduc.2024.14101639Online publication date: 20-Jun-2024
    • (2024)CoAR-TV: Design and Evaluation of Asynchronous Collaboration in AR-Supported TV ExperiencesProceedings of the 2024 ACM International Conference on Interactive Media Experiences10.1145/3639701.3656320(231-245)Online publication date: 7-Jun-2024
    • (2024)TouchEditorProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36314547:4(1-29)Online publication date: 12-Jan-2024
    • (2024)Engaging recently incarcerated and gang affiliated Black and Latino/a young adults in designing social collocated applications for mixed reality smart glasses through community-based participatory design workshops.Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642895(1-17)Online publication date: 11-May-2024
    • (2024)“Oh My God! It’s Recreating Our Room!” Understanding Children’s Experiences with A Room-Scale Augmented Reality Authoring ToolkitProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642043(1-17)Online publication date: 11-May-2024
    • (2024)Exploring the Opportunity of Augmented Reality (AR) in Supporting Older Adults to Explore and Learn Smartphone ApplicationsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3641901(1-18)Online publication date: 11-May-2024
    • (2024)RoboVisAR: Immersive Authoring of Condition-based AR Robot VisualisationsProceedings of the 2024 ACM/IEEE International Conference on Human-Robot Interaction10.1145/3610977.3634972(462-471)Online publication date: 11-Mar-2024
    • (2024)Empowering Instructors: Augmented Reality Authoring Toolkit for Aviation Weather EducationIEEE Transactions on Learning Technologies10.1109/TLT.2024.348663017(2195-2206)Online publication date: 1-Jan-2024
    • (2024)Augmented reality interactive experiences for multi-level chemistry understandingInternational Journal of Child-Computer Interaction10.1016/j.ijcci.2024.10068142:COnline publication date: 1-Dec-2024
    • (2024)HoloCook: A Real-Time Remote Mixed Reality Cooking Tutoring SystemHCI International 2024 – Late Breaking Papers10.1007/978-3-031-76812-5_17(244-264)Online publication date: 15-Dec-2024
    • Show More Cited By

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    HTML Format

    View this article in HTML Format.

    HTML Format

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media