research-article

Situated Storytelling with SLAM Enabled Augmented Reality

Authors:

Sarah Ketchell,

Winyu Chinthammit,

Ulrich EngelkeAuthors Info & Claims

VRCAI '19: Proceedings of the 17th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and its Applications in Industry

Article No.: 35, Pages 1 - 9

https://doi.org/10.1145/3359997.3365681

Published: 14 November 2019 Publication History

Abstract

This paper addresses the feasibility of situated storytelling using Simultaneous Localisation and Mapping (SLAM) enabled augmented reality (AR) on a mobile phone. We specifically focus on storytelling in the heritage context as it provides a rich environment for stories to be told in. We conducted expert interviews with several museum and heritage sites to identify major themes for storytelling in the heritage context. These themes informed the development of an AR based storytelling application for a mobile phone. We evaluated the application in a user study and gained further insight into the factors that users appreciate in AR based storytelling. From these insights we derive several high level design guidelines that may inform future system development for situated storytelling, especially in the heritage context.

References

[1]

Apple. 2018. ARKit. https://developer.apple.com/arkit/

[2]

Romao T-Martins T Barrenho, F and N Correia. 2006. InAuthoring environment: interfaces for creating spatial stories and gaming activities. Proceedings of the 2006 ACM SIGCHI international conference on Advances in computer entertainment technology(2006).

[3]

J Billock. 2017. Five Augmented Reality Experiences That Bring Museum Exhibits to Life’, Smithsonian. https://www.smithsonianmag.com/travel/expanding-exhibits-augmented-reality-180963810/

[4]

L. M Bimber O, Encarnacao and D Schmalstieg. 2003. The virtual showcase as a new platform for augmented reality digital storytelling. Proceedings of the 2006 ACM SIGCHI international conference on Advances in computer entertainment technology(2003), 87–95.

Digital Library

[5]

Biography. 2017. Confucius Biography. https://www.biography.com/people/confucius-9254926

[6]

V Braun and V Clarke. 2006. Using thematic analysis in psychology. Qualitative Research in Psychology 3 (2006), 77–101.

[7]

W Chinthammit and A Thomas. 2012. Using thematic analysis in psychology. IEEE International Symposium on Mixed and Augmented Reality - Arts, Media, and Humanities (ISMAR-AMH)(2012), 39–46.

[8]

Pan P Kam L Crow, M and G Davenport. 2003. M-Views: A System for Location-Based Storytelling. Proceedings of Ubiquitous Computing (Ubicomp) (2003), 31–34.

[9]

N. ElSayed, B. Thomas, K. Marriott, J. Piantadosi, and R. Smith. 2015. Situated Analytics. In Big Data Visual Analytics (BDVA). 1–8.

[10]

S Ganapathy. 2013. Design Guidelines for Mobile Augmented Reality: User Experience. Human Factors in Augmented Reality Environments (2013), 165–180.

[11]

Wan T.R Tang W Chen L Gao, Q.H and K.B Zhang. 2017. An Improved Augmented Reality Registration Method Based on Visual SLAM. Cham, Springer International Publishing(2017), 11–19.

[12]

Escamilla-Ambrosio P. J Webb M Mayol-Cuevas W Gee, A. P and A Calway. 2010. Augmented crime scenes: virtual annotation of physical environments for forensic investigation. Proceedings of the 2nd ACM workshop on Multimedia in forensics, security and intelligence (2010).

[13]

Google. 2018a. ARCore. https://developers.google.com/ar/

[14]

Google. 2018b. Augmented Reality Design Guidelines. https://designguidelines.withgoogle.com/ar-design/augmented-reality-design- guidelines/introduction-to-ar-arcore.html

[15]

Bichard J-Brunnberg L Juhlin O Gustafsson, A and M Combetto. 2006. Believable environments: generating interactive storytelling in vast location-based pervasive games. Proceedings of the 2006 ACM SIGCHI international conference on Advances in computer entertainment technology(2006).

[16]

O Haines. 2016. An Introduction to Simultaneous Localisation and Mapping | Kudan. https://www.kudan.eu/kudan-news/an-introduction-to-slam

[17]

H Hiker. 2018. Golden Rule Stories. http://www.harryhiker.com/stories.htm

[18]

Jabil. 2018. Where is Augmented and Virtual Reality Technology Headed. https://www.iotforall.com/future-of-augmented-virtual-reality-technology/

[19]

Andrews T Janes, C and M Adbel-Maguid. 2018. Designing an Augmented Reality Smartphone Application for the Enhancement of Asthma Care Education. Cham, Springer International Publishing(2018), 11–17.

[20]

A Javornik. 2018. The Mainstreaming of Augmented Reality: A Brief History. https://hbr.org/2016/10/the-mainstreaming-of-augmented-reality-a-brief- history

[21]

Microsoft. 2018. Microsoft HoloLens. https://www.microsoft.com/en- us/hololens

[22]

Fukuda T-Yabuki N Miyake, M and A Motamedi. 2017. Outdoor markerless augmented reality. Proceedings of the 22nd International Conference of the Association for Computer-Aided Architectural Design Research in Asia (CAADRIA) 2017 (2017), 95–105.

[23]

J Morgan. 2004. 5 Important Elements of a Short Story. http://users.aber.ac.uk/jpm/ellsa/ellsa_elements.html

[24]

Kothe T-Schneegass S Oberhuber, S and FM Alt. 2017. Augmented Games: Exploring Design Opportunities in AR Settings With Children. Proceedings of the 2017 Conference on Interaction Design and Children (2017), 371–377.

[25]

Taketomi T-Yamamoto G Dey A Sandor C Polvi, J and H Kato. 2015. SlidAR: A 3D positioning method for SLAM-based handheld augmented reality. ELSEVIER Computers and Graphics 55 (2016)(2015), 33–43.

[26]

Kljun M Pucihar, K and P Coulton. 2016. Playing with the Artworks: Engaging with Art through an Augmented Reality Gam. Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems(2016), 1842–1848.

[27]

T Reitmaier and G Marsden. 2009. Bringing Digital Storytelling to the Mobile. IFIP International Federation for Information Processing 2009 (2009), 750–753.

[28]

Scholastic. 2018. Confucius | The Golden Rule. https://www.scholastic.com/teachers/books/confucius-the-golden-rule-by-russell-freedman/

[29]

Park H Shin, J and W Woo. 2017. Connecting the Dots: Enhancing the Usability of Indexed Multimedia Data for AR Cultural Heritage Applications through Storytelling. Proceedings of the 15th International Workshop on Content-Based Multimedia Indexing (2017).

[30]

M Swider. 2017. Google Glass. https://www.techradar.com/au/reviews/gadgets/google-glass-1152283/review

[31]

Vines J-Balaam M Taylor N Smith T-Crivellaro C Mensah J Limon H Challis J Anderson L Clarke A Wood, G and P. C Wright. 2014. The department of hidden stories: Playful digital storytelling for children in a public library. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (2014).

Cited By

Tylosky NKnutas AWolff A(2023)Principles for Designing for Data Exploration for a Non-Expert Audience2023 46th MIPRO ICT and Electronics Convention (MIPRO)10.23919/MIPRO57284.2023.10159742(88-91)Online publication date: 22-May-2023
https://doi.org/10.23919/MIPRO57284.2023.10159742
Shin SBatch AButcher PRitsos PElmqvist N(2023)The Reality of the Situation: A Survey of Situated AnalyticsIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.328554630:8(5147-5164)Online publication date: 13-Jun-2023
https://dl.acm.org/doi/10.1109/TVCG.2023.3285546
Naik AJohnson A(2023)PSA: A Cross-Platform Framework for Situated Analytics in MR and VR2023 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct)10.1109/ISMAR-Adjunct60411.2023.00027(92-96)Online publication date: 16-Oct-2023
https://doi.org/10.1109/ISMAR-Adjunct60411.2023.00027
Show More Cited By

Index Terms

Situated Storytelling with SLAM Enabled Augmented Reality
1. Computing methodologies
  1. Computer graphics
    1. Graphics systems and interfaces
      1. Virtual reality
2. Human-centered computing

Index terms have been assigned to the content through auto-classification.

Recommendations

Interactive augmented reality storytelling guided by scene semantics

We present a novel interactive augmented reality (AR) storytelling approach guided by indoor scene semantics. Our approach automatically populates virtual contents in real-world environments to deliver AR stories, which match both the story plots and ...
Location-Aware Adaptation of Augmented Reality Narratives
CHI '23: Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems

The recent popularity of augmented reality (AR) devices has enabled players to participate in interactive narratives through virtual events and characters populated in a real-world environment, where different actions may lead to different story ...
A model for in-situ augmented reality content creation based on storytelling and gamification
MexIHC'16: Proceedings of the 6th Mexican Conference on Human-Computer Interaction

Augmented Reality (AR) has the potential to improve the user experience in different contexts. This paper describes SituAR, a model designed to facilitate the creation of stories with gamification elements and AR content. Our approach on AR content ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

VRCAI '19: Proceedings of the 17th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and its Applications in Industry

November 2019

354 pages

ISBN:9781450370028

DOI:10.1145/3359997

Conference Chairs:
Joaquim Jorge
INESC/ID & Univ Lisboa, Portugal
,
June Kim
University of New South Wales, Australia
,
Herman Van Eyken
Griffith University, Queensland, Australia
,
Editor:
Stephen N. Spencer
University of Washington
,
Program Chairs:
Mashhuda Glencross
University of Queensland, Australia
,
Kenny Mitchell
Disney Research, USA and Edinburgh Napier University, UK
,
Takuji Narumi
University of Tokyo, Japan

Copyright © 2019 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGGRAPH: ACM Special Interest Group on Computer Graphics and Interactive Techniques

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 14 November 2019

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

VRCAI '19

Sponsor:

SIGGRAPH

VRCAI '19: The 17th International Conference on Virtual-Reality Continuum and its Applications in Industry

November 14 - 16, 2019

QLD, Brisbane, Australia

Acceptance Rates

Overall Acceptance Rate 51 of 107 submissions, 48%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

10
Total Citations
View Citations
512
Total Downloads

Downloads (Last 12 months)30
Downloads (Last 6 weeks)3

Reflects downloads up to 03 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Tylosky NKnutas AWolff A(2023)Principles for Designing for Data Exploration for a Non-Expert Audience2023 46th MIPRO ICT and Electronics Convention (MIPRO)10.23919/MIPRO57284.2023.10159742(88-91)Online publication date: 22-May-2023
https://doi.org/10.23919/MIPRO57284.2023.10159742
Shin SBatch AButcher PRitsos PElmqvist N(2023)The Reality of the Situation: A Survey of Situated AnalyticsIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.328554630:8(5147-5164)Online publication date: 13-Jun-2023
https://dl.acm.org/doi/10.1109/TVCG.2023.3285546
Naik AJohnson A(2023)PSA: A Cross-Platform Framework for Situated Analytics in MR and VR2023 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct)10.1109/ISMAR-Adjunct60411.2023.00027(92-96)Online publication date: 16-Oct-2023
https://doi.org/10.1109/ISMAR-Adjunct60411.2023.00027
Yoo EKwon OYu J(2023)Evaluation of an Augmented Reality for Historical Context Experiences of 3D Restored Court PaintingsIEEE Access10.1109/ACCESS.2023.326852811(39197-39212)Online publication date: 2023
https://doi.org/10.1109/ACCESS.2023.3268528
Estrada JPaheding SYang XNiyaz Q(2022)Deep-Learning-Incorporated Augmented Reality Application for Engineering Lab TrainingApplied Sciences10.3390/app1210515912:10(5159)Online publication date: 20-May-2022
https://doi.org/10.3390/app12105159
Raeburn GTokarchuk L(2022)Comparing principally imagination and interaction versions of a play anywhere mobile AR location-based story2022 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW)10.1109/VRW55335.2022.00159(616-617)Online publication date: Mar-2022
https://doi.org/10.1109/VRW55335.2022.00159
Tan SNg K(2022)Gamified Mobile Sensing Storytelling Application for Enhancing Remote Cultural Experience and EngagementInternational Journal of Human–Computer Interaction10.1080/10447318.2022.214412140:6(1383-1396)Online publication date: 14-Nov-2022
https://doi.org/10.1080/10447318.2022.2144121
Krauß VJasche FSaßmannshausen SLudwig TBoden A(2021)Research and Practice Recommendations for Mixed Reality Design – Different Perspectives from the CommunityProceedings of the 27th ACM Symposium on Virtual Reality Software and Technology10.1145/3489849.3489876(1-13)Online publication date: 8-Dec-2021
https://dl.acm.org/doi/10.1145/3489849.3489876
Raeburn GTokarchuk L(2021)Varying user agency and interaction opportunities in a home mobile augmented virtuality story2021 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)10.1109/ISMAR52148.2021.00051(347-356)Online publication date: Oct-2021
https://doi.org/10.1109/ISMAR52148.2021.00051
Raeburn GTokarchuk LWelton M(2021)Creating Immersive Play Anywhere Location-Based Storytelling Using Mobile ARAugmented Reality, Virtual Reality, and Computer Graphics10.1007/978-3-030-87595-4_16(209-226)Online publication date: 7-Sep-2021
https://dl.acm.org/doi/10.1007/978-3-030-87595-4_16

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Figures

Tables

Media

View Table of Conten