skip to main content
10.1145/3025453.3025722acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
research-article

MagicFace: Stepping into Character through an Augmented Reality Mirror

Published: 02 May 2017 Publication History

Abstract

Augmented Reality (AR) is coming of age and appearing in various smartphone apps. One emerging AR type uses the front-facing camera and overlays a user's face with digital features that transform the physical appearance, making the user look like someone else, such as a popstar or a historical character. However, little is known about how people react to such stepping into character and how convincing they perceive it to be. We developed an app with two Egyptian looks, MagicFace, which was situated both in an opera house and a museum. In the first setting, people were invited to use the app, while in the second setting they came across it on their own when visiting the exhibition. Our findings show marked differences in how people approach and experience the MagicFace in these different contexts. We discuss how realistic and compelling this kind of AR technology is, as well as its implications for educational and cultural settings.

Supplementary Material

suppl.mov (pn2352.mp4)
Supplemental video
MP4 File (p4838-javornik.mp4)

References

[1]
Louise Barkhuus and Chiara Rossitto. 2016. Acting with Technology: Rehearsing for Mixed-Media Live Performances. Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems: 864--875.
[2]
Marius Bulearca and Daniel Tamarjan. 2010. Augmented reality: A sustainable marketing tool. Global Business and Management Research: An International Journal 2, 2: 237--252.
[3]
Su Cai, Xu Wang, and Feng Kuang Chiang. 2014. A case study of Augmented Reality simulation system application in a chemistry course. Computers in Human Behavior 37: 31--40.
[4]
Kuo En Chang, Chia Tzu Chang, Huei Tse Hou, Yao Ting Sung, Huei Lin Chao, and Cheng Ming Lee. 2014. Development and behavioral pattern analysis of a mobile guide system with augmented reality for painting appreciation instruction in an art museum. Computers and Education 71: 185--197.
[5]
Chris Dede. 2009. Immersive Interfaces for Engagement and Learning. Science 323, 5910: 66--69.
[6]
Ángela Di Serio, María Blanca Ibáñez, and Carlos Delgado Kloos. 2013. Impact of an augmented reality system on students' motivation for a visual art course. Computers and Education 68: 585--596.
[7]
Christian Diaz, Mauricio Hincapié, and Gustavo Moreno. 2015. How the Type of Content in Educative Augmented Reality Application Affects the Learning Experience. Procedia Computer Science 75, Vare: 205--212.
[8]
Karen Freberg. 2016. Snapchat Branded Lense Campaigns: Best Practices and Strategies.
[9]
Melanie C. Green and Timothy C. Brock. 2000. The role of transportation in the persuasiveness of public narratives. Journal of personality and social psychology 79, 5: 701--721.
[10]
Michael Hitchens, Anders Drachen, and others. 2008. The many faces of role-playing games. International journal of role-playing 1, 1: 3--21.
[11]
Ana Javornik, Yvonne Rogers, Ana Maria Moutinho, and Russell Freeman. 2016. Revealing the Shopper Experience of Using a "Magic Mirror" Augmented Reality Make - Up Application. Proceedings of the 2016 ACM Conference on Designing Interactive Systems: 871--882.
[12]
Timothy Jung, Claudia M. Dieck, Hyunae Lee, and Namho Chung. 2016. Effects of Virtual Reality and Augmented Reality on Visitor Experiences in Museum. In Information and Communication Technologies in Tourism 2016, Alessandro Inversini and Roland Schegg (eds.). Springer, 621--635.
[13]
Yu-Wei Lin and Alan E Williams. 2014. Projecting the voice: observations of audience behaviours in ICTmediated contemporary opera. New Review of Hypermedia & Multimedia 20, 3: 207--223.
[14]
Paul Marshall, Richard Morris, Yvonne Rogers, Stefan Kreitmayer, Matt Davies, and Milton Keynes. 2011. Rethinking Multi-user: an In-the -Wild Study of How Groups Approach a Walk-Up-and-Use Tabletop Interface. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM. ACM, 3033--3042.
[15]
Ben Medler, Cherry St, and Brian Magerko. 2010. The Implications of Improvisational Acting and RolePlaying on Design Methodologies. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM. CHI'10, 483--492.
[16]
Joseph B. Pine and James H. Gilmore. 1999. The experience economy: work is theatre & every business a stage. Harvard Business Press.
[17]
Carlton Reeve. 2000. Presence in virtual theater. Presence 9, 2: 209--213.
[18]
Katie Rogers. 2016. X-Men: Apocalypse Takes Over Snapchat Lenses. Retrieved from http://www.nytimes.com/2016/05/24/business/x-menapocalypse-takes-over-snapchat-lenses.html?_r=0
[19]
Yvonne Rogers, Mike Scaife, Eric Harris, et al. 2002. Things aren't what they seem to be: innovation through technology inspiration. Proceedings of the conference on Designing interactive systems processes practices methods and techniques DIS 02, 373--378.
[20]
Joachim Scholz and Andrew N. Smith. 2016. Augmented reality: Designing immersive experiences that maximize consumer engagement. Business Horizons 59, 2: 149--161.
[21]
Venkatesh Shankar, Mirella Kleijnen, Suresh Ramanathan, Ross Rizley, Steve Holland, and Shawn Morrissey. 2016. Mobile Shopper Marketing: Key Issues, Current Insights, and Future Research Avenues. Journal of Interactive Marketing 34: 37--48.
[22]
Robyn Taylor, John Bowers, Bettina Nissen, et al. 2015. Making Magic: Designing for Open Interactions in Museum Settings. Proceedings of the 2015 ACM SIGCHI Conference on Creativity and Cognition: 313--322.
[23]
Gallayanee Yaoyuneyong, Jamye Foster, Erik Johnson, and David Johnson. 2016. Augmented Reality Marketing: Consumer Preferences and Attitudes Toward Hypermedia Print Ads. Journal of Interactive Advertising 16, 1: 16--30.
[24]
Rabia M. Yilmaz. 2016. Educational magic toys developed with augmented reality technology for early childhood education. Computers in Human Behavior 54: 240--248.

Cited By

View all
  • (2024)How Virtual Mirrors in Advertising Influence Attitudes about Beauty ProductsJournal of Advertising Research10.2501/JAR-2024-016(PAP_016)Online publication date: 24-Jun-2024
  • (2024)Mixed Reality, Gamified Presence, and Storytelling for Virtual MuseumsEncyclopedia of Computer Graphics and Games10.1007/978-3-031-23161-2_249(1150-1162)Online publication date: 5-Jan-2024
  • (2023)Smart Objects and Replicas: A Survey of Tangible and Embodied Interactions in Museums and Cultural Heritage SitesJournal on Computing and Cultural Heritage 10.1145/3631132Online publication date: 2-Nov-2023
  • Show More Cited By

Index Terms

  1. MagicFace: Stepping into Character through an Augmented Reality Mirror

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    CHI '17: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems
    May 2017
    7138 pages
    ISBN:9781450346559
    DOI:10.1145/3025453
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 02 May 2017

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. augmented reality
    2. in-the-wild study
    3. interface design
    4. opera characters

    Qualifiers

    • Research-article

    Funding Sources

    • EPSRC Impact Acceleration

    Conference

    CHI '17
    Sponsor:

    Acceptance Rates

    CHI '17 Paper Acceptance Rate 600 of 2,400 submissions, 25%;
    Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

    Upcoming Conference

    CHI 2025
    ACM CHI Conference on Human Factors in Computing Systems
    April 26 - May 1, 2025
    Yokohama , Japan

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)75
    • Downloads (Last 6 weeks)7
    Reflects downloads up to 13 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)How Virtual Mirrors in Advertising Influence Attitudes about Beauty ProductsJournal of Advertising Research10.2501/JAR-2024-016(PAP_016)Online publication date: 24-Jun-2024
    • (2024)Mixed Reality, Gamified Presence, and Storytelling for Virtual MuseumsEncyclopedia of Computer Graphics and Games10.1007/978-3-031-23161-2_249(1150-1162)Online publication date: 5-Jan-2024
    • (2023)Smart Objects and Replicas: A Survey of Tangible and Embodied Interactions in Museums and Cultural Heritage SitesJournal on Computing and Cultural Heritage 10.1145/3631132Online publication date: 2-Nov-2023
    • (2023)OperARtistry: An AR-based Interactive Application to Assist the Learning of Chinese Traditional Opera (Xiqu) MakeupProceedings of the Eleventh International Symposium of Chinese CHI10.1145/3629606.3629622(158-168)Online publication date: 13-Nov-2023
    • (2022)Remote evaluation of augmented reality interaction with personal health informationFrontiers in Computer Science10.3389/fcomp.2022.9346944Online publication date: 15-Aug-2022
    • (2022)Being an Avatar “for Real”: A Survey on Virtual Embodiment in Augmented RealityIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2021.309929028:12(5071-5090)Online publication date: 1-Dec-2022
    • (2021)Expanding the Design Space for Technology-Mediated Theatre ExperiencesProceedings of the 2021 ACM Designing Interactive Systems Conference10.1145/3461778.3462123(2026-2038)Online publication date: 28-Jun-2021
    • (2021)Rethinking the Senses: A Workshop on Multisensory Embodied Experiences and Disability InteractionsExtended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems10.1145/3411763.3441356(1-5)Online publication date: 8-May-2021
    • (2021)Relationships between the “Big Five” personality types and consumer attitudes in Indian students toward augmented reality advertisingAslib Journal of Information Management10.1108/AJIM-02-2021-004673:6(967-991)Online publication date: 16-Sep-2021
    • (2020)Virtual and Augmented Reality Mirrors for Mental Health TreatmentResearch Anthology on Rehabilitation Practices and Therapy10.4018/978-1-7998-3432-8.ch043(885-907)Online publication date: 21-Aug-2020
    • Show More Cited By

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media