skip to main content
10.1145/3123024.3129270acmconferencesArticle/Chapter ViewAbstractPublication PagesubicompConference Proceedingsconference-collections
extended-abstract

Combining semantics and augmented reality to support the human mind

Published:11 September 2017Publication History

ABSTRACT

Humans and machines work closer together as never before. Whether it is about sensors to expand humans' sensorium, exo-skeletons augmenting physical capabilities, augmented and digital worlds breaking with physical boundaries, or curated digital memories: the value of all these technologies rises and falls with their ability to synchronize with the user's current situation, understand the needs and provide appropriate support. In this position paper we want to outline how semantic technologies can be applied to add more context and meaning to the user's role and task, and use Augmented Reality to present this information to the user. Instead of proposing yet another framework representing world knowledge we describe how to build upon existing standards, descriptions of procedures and routines, and regulations that become machine accessible. This way, machines and humans should be able to work in symbiosis. In the following we describe our motivation, list upcoming challenges and provide a first direction of how to proceed.

References

  1. Herbert Bay, Tinne Tuytelaars, and Luc Van Gool. 2006. Surf: Speeded up robust features. Computer vision-ECCV 2006 (2006), 404--417. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Tim Berners-Lee, James Hendler, Ora Lassila, and others. 2001. The semantic web. Scientific american 284, 5 (2001), 28--37.Google ScholarGoogle Scholar
  3. Sebastian Büttner, Henrik Mucha, Markus Funk, Thomas Kosch, Mario Aehnelt, Sebastian Robert, and Carsten Röcker. 2017. The Design Space of Augmented and Virtual Reality Applications for Assistive Environments in Manufacturing: A Visual Approach. In Proceedings of the 10th International Conference on PErvasive Technologies Related to Assistive Environments. ACM, 433--440. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Thomas P Caudell and David W Mizell. 1992. Augmented reality: An application of heads-up display technology to manual manufacturing processes. In System Sciences, 1992. Proceedings of the Twenty-Fifth Hawaii International Conference on, Vol. 2. IEEE, 659--669.Google ScholarGoogle ScholarCross RefCross Ref
  5. Surbhi Dangi, Steven Ray, Ralph Hodgson, Gokhan Soydan, and Ankur Oberai. Using SPARQL/OWL for Validation of Smart Grid Standards.Google ScholarGoogle Scholar
  6. Markus Funk, Andreas Bächler, Liane Bächler, Thomas Kosch, Thomas Heidenreich, and Albrecht Schmidt. 2017. Working with Augmented Reality? A Long-Term Analysis of In-Situ Instructions at the Assembly Workplace. In Proceedings of the 10th ACM International Conference on PErvasive Technologies Related to Assistive Environments. ACM, New York, NY, USA. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Markus Funk, Sven Mayer, and Albrecht Schmidt. 2015. Using in-situ projection to support cognitively impaired workers at the workplace. In Proceedings of the 17th international ACM SIGACCESS conference on Computers & accessibility. 185--192. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Markus Funk and Albrecht Schmidt. 2015. Cognitive assistance in the workplace. IEEE Pervasive Computing 14, 3 (2015), 53--55.Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Markus Funk, Albrecht Schmidt, and Lars Erik Holmquist. 2013. Antonius: A mobile search engine for the physical world. In Proceedings of the 2013 ACM conference on Pervasive and ubiquitous computing adjunct publication. ACM, 179--182. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Kimberly García and Patrick Brézillon. 2017. From a Contextual Graph to a Tree Representation. In Modeling and Using Context - 10th International and Interdisciplinary Conference, CONTEXT 2017, Paris, France, June 20--23, 2017, Proceedings. 27--40.Google ScholarGoogle Scholar
  11. Kimberly García, Sonia Mendoza, Dominique Decouchant, and Patrick Brézillon. 2016. Facilitating resource sharing and selection in ubiquitous multi-user environments. Information Systems Frontiers (2016), 1--21.Google ScholarGoogle Scholar
  12. Chiara Ghidini, Viktoria Pammer, Peter Scheir, Luciano Serafini, and Stefanie Lindstaedt. 2007. APOSDLE: Learn@ work with semantic web technology. Proc. of the IMEDIA and I-SEMANTICS (2007), 262--269.Google ScholarGoogle Scholar
  13. Mika Hakkarainen, Charles Woodward, and Mark Billinghurst. 2008. Augmented assembly using a mobile phone. In Mixed and Augmented Reality, 2008. ISMAR 2008. 7th IEEE/ACM International Symposium on. IEEE, 167--168. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Taekgyeong Han and Kwang Mong Sim. 2010. An ontology-enhanced cloud service discovery system. In Proceedings of the International MultiConference of Engineers and Computer Scientists, Vol. 1. 17--19.Google ScholarGoogle Scholar
  15. Ian Horrocks. 2008. Ontologies and the semantic web. Commun. ACM 51, 12 (2008), 58--67. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Konstantinos Kotis and Artem Katasonov. 2012. An ontology for the automated deployment of applications in heterogeneous IoT environments. Semantic Web Journal (2012).Google ScholarGoogle Scholar
  17. Simon Mayer, Jack Hodges, Dan Yu, Mareike Kritzler, and Florian Michahelles. 2017. An Open Semantic Framework for the Industrial Internet of Things. IEEE Intelligent Systems 32, 1 (2017), 96--101. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Simon Mayer, Dominic Plangger, Florian Michahelles, and Simon Rothfuss. 2016. UberManufacturing: A Goal-Driven Collaborative Industrial Manufacturing Marketplace. In Proceedings of the 6th International Conference on the Internet of Things. 111--119. Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. Marvin Minsky. 1974. A framework for representing knowledge. (1974).Google ScholarGoogle Scholar
  20. Iori Mizutani, Mareike Kriztler, Kimberly García, and Florian Michahelles. 2017. Intuitive Interaction with Semantics using Augmented Reality - a Case Study of Workforce Management in an Industrial Setting. In Proceedings of the 7th International Conference on the Internet of Things.Google ScholarGoogle Scholar
  21. Andreas Möller, Matthias Kranz, Robert Huitl, Stefan Diewald, and Luis Roalter. 2012. A mobile indoor navigation system interface adapted to vision-based localization. In Proceedings of the 11th international conference on mobile and ubiquitous multimedia. ACM, 4. Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Claudio Pinhanez. 2001. The everywhere displays projector: A device to create ubiquitous graphical interfaces. In Ubicomp 2001: Ubiquitous Computing. Springer, 315--331. Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. Jürgen Scheible, Arnd Engeln, Michael Burmester, Gottfried Zimmermann, Tobias Keber, Uwe Schulz, Sabine Palm, Markus Funk, and Uwe Schaumann. 2016. SMARTKITCHEN Media Enhanced Cooking Environment. In Proceedings of the 6th International Conference on the Internet of Things. ACM, 169--170. Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. Arthur Tang, Charles Owen, Frank Biocca, and Weimin Mou. 2003. Comparative effectiveness of augmented reality in object assembly. In Proceedings of the SIGCHI conference on Human factors in computing systems. 73--80. Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. Wei Wang, Suparna De, Ralf Toenjes, Eike Reetz, and Klaus Moessner. 2012. A comprehensive ontology for knowledge representation in the internet of things. In Trust, Security and Privacy in Computing and Communications (TrustCom), 2012 IEEE 11th International Conference on. IEEE, 1793--1798. Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. Mark Weiser. 1999. The computer for the 21st century. Mobile Computing and Communications Review 3, 3 (1999), 3--11. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Combining semantics and augmented reality to support the human mind

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in
    • Published in

      cover image ACM Conferences
      UbiComp '17: Proceedings of the 2017 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2017 ACM International Symposium on Wearable Computers
      September 2017
      1089 pages
      ISBN:9781450351904
      DOI:10.1145/3123024

      Copyright © 2017 Owner/Author

      Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 11 September 2017

      Check for updates

      Qualifiers

      • extended-abstract

      Acceptance Rates

      Overall Acceptance Rate764of2,912submissions,26%

      Upcoming Conference

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader