Maximilian Speicher
Brian D. Hall
ABSTRACT
What is Mixed Reality (MR)? To revisit this question given the many recent developments, we conducted interviews with ten AR/VR experts from academia and industry, as well as a literature survey of 68 papers. We find that, while there are prominent examples, there is no universally agreed on, one-size-fits-all definition of MR. Rather, we identified six partially competing notions from the literature and experts' responses. We then started to isolate the different aspects of reality relevant for MR experiences, going beyond the primarily visual notions and extending to audio, motion, haptics, taste, and smell. We distill our findings into a conceptual framework with seven dimensions to characterize MR applications in terms of the number of environments, number of users, level of immersion, level of virtuality, degree of interaction, input, and output. Our goal with this paper is to support classification and discussion of MR applications' design and provide a better means to researchers to contextualize their work within the increasingly fragmented MR landscape.
Supplemental Material
- M. Al-Kalbani, I. Williams, and M. Frutos-Pascual. 2016. Analysis of Medium Wrap Freehand Virtual Object Grasping in Exocentric Mixed Reality. In 2016 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). 84--93.Google Scholar
- Sasha Barab and Kurt Squire. 2004. Design-based research: Putting a stake in the ground. The journal of the learning sciences 13, 1 (2004), 1--14.Google Scholar
- E. Barba and R. Z. Marroquin. 2017. A Primer on Spatial Scale and Its Application to Mixed Reality. In 2017 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). 100--110.Google Scholar
- Steve Benford, Andy Crabtree, Martin Flintham, Adam Drozd, Rob Anastasi, Mark Paxton, Nick Tandavanitj, Matt Adams, and Ju RowFarr. 2006. Can You See Me Now? ACM Trans. Comput.-Hum. Interact. 13, 1 (March 2006), 100--133. Google ScholarDigital Library
- Steve Benford and Gabriella Giannachi. 2011. Performing Mixed Reality. The MIT Press. Google ScholarDigital Library
- Steve Benford, Chris Greenhalgh, Gail Reynard, Chris Brown, and Boriana Koleva. 1998. Understanding and Constructing Shared Spaces with Mixed-reality Boundaries. ACM Trans. Comput.-Hum. Interact. 5, 3 (Sept. 1998), 185--223. Google ScholarDigital Library
- Mark Billinghurst. 2017. What is Mixed Reality? https://medium.com/@marknb00/what-is-mixed-reality-60e5cc284330.Google Scholar
- Mark Billinghurst, Adrian Clark, and Gun Lee. 2015. A Survey of Augmented Reality. Foundations and Trends® in Human--Computer Interaction 8, 2--3 (2015), 73--272. Google ScholarCross Ref
- Mark Billinghurst and Hirokazu Kato. 1999. Collaborative mixed reality. In Proceedings of the First International Symposium on Mixed Reality. 261--284.Google ScholarCross Ref
- Elizabeth M. Bonsignore, Derek L. Hansen, Zachary O. Toups, Lennart E. Nacke, Anastasia Salter, and Wayne Lutters. 2012. Mixed Reality Games. In Proceedings of the ACM 2012 Conference on Computer Supported Cooperative Work Companion (CSCW '12). ACM, New York, NY, USA, 7--8. Google ScholarDigital Library
- Brandon Bray and Matt Zeller. 2018. What is mixed reality? https://docs.microsoft.com/en-us/windows/mixed-reality/mixed-reality.Google Scholar
- J. P. Cater. 1994. Smell/taste: odors in reality. In Proceedings of IEEE International Conference on Systems, Man and Cybernetics, Vol. 2.Google ScholarCross Ref
- Anil Çamc?, Kristine Lee, Cody J. Roberts, and Angus G. Forbes. 2017. INVISO: A Cross-platform User Interface for Creating Virtual Sonic Environments. In Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology (UIST '17). ACM, New York, NY, USA, 507--518. Google ScholarDigital Library
- J. C. P. Chan, H. Leung, J. K. T. Tang, and T. Komura. 2011. A Virtual Reality Dance Training System Using Motion Capture Technology. IEEE Transactions on Learning Technologies 4, 2 (April 2011), 187--195. Google ScholarDigital Library
- L. Chen, T. W. Day, W. Tang, and N. W. John. 2017. Recent Developments and Future Challenges in Medical Mixed Reality. In 2017 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). 123--135.Google Scholar
- A. Dey, M. Billinghurst, R. W. Lindeman, and J. E. Swan II. 2017. A Systematic Review of Usability Studies in Augmented Reality between 2005 and 2014. In 2016 IEEE International Symposium on Mixed and Augmented Reality (ISMAR-Adjunct)(ISMARW), Vol. 00. 49--50.Google Scholar
- Alan Dix, Adrian Friday, Boriana Koleva, Tom Rodden, Henk Muller, Cliff Randell, and Anthony Steed. 2005. Multiple spaces. In Spaces, Spatiality and Technology. Springer, 151--172.Google Scholar
- Daniel Dobler, Michael Haller, and Philipp Stampfl. 2002. ASR: Augmented Sound Reality. In ACM SIGGRAPH 2002 Conference Abstracts and Applications (SIGGRAPH '02). ACM, New York, NY, USA, 148--148. Google ScholarDigital Library
- Clarence A Ellis, Simon J Gibbs, and Gail Rein. 1991. Groupware: some issues and experiences. Commun. ACM 34, 1 (1991), 39--58. Google ScholarDigital Library
- Steven K. Feiner. 2002. Augmented Reality: a New Way of Seeing. Scientific American 286, 4 (2002), 48--55. http://www.jstor.org/stable/Google ScholarCross Ref
- Maribeth Gandy and Blair MacIntyre. 2014. Designer's Augmented Reality Toolkit, Ten Years Later: Implications for New Media Authoring Tools. In Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology (UIST '14). ACM, New York, NY, USA, 627--636. Google ScholarDigital Library
- Çalar Genç, Shoaib Soomro, Yalçn Duyan, Selim Ölçer, Fuat Balc, Hakan Ürey, and Oguzhan Özcan. 2016. Head Mounted Projection Display & Visual Attention: Visual Attentional Processing of Head Referenced Static and Dynamic Displays While in Motion and Standing. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, New York, NY, USA, 1538--1547. Google ScholarDigital Library
- Perttu Hämäläinen, Joe Marshall, Raine Kajastila, Richard Byrne, and Florian "Floyd" Mueller. 2015. Utilizing Gravity in Movement-Based Games and Play. In Proceedings of the 2015 Annual Symposium on Computer-Human Interaction in Play (CHI PLAY '15). ACM, New York, NY, USA, 67--77. Google ScholarDigital Library
- Vinzenz Hediger and Alexandra Schneider. 2005. The Deferral of Smell: Cinema, Modernity and the Reconfiguration of the Olfactory Experience. In I cinque sensi del cinema/The Five Senses of Cinema, eds. Alice Autelitano, Veronica Innocenti, Valentina Re (Udine: Forum, 2005). 243--252.Google Scholar
- Otmar Hilliges, David Kim, Shahram Izadi, Malte Weiss, and Andrew Wilson. 2012. HoloDesk: Direct 3D Interactions with a Situated Seethrough Display. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '12). ACM, New York, NY, USA, 2421--2430. Google ScholarDigital Library
- G. Hough, I. Williams, and C. Athwal. 2014. Measurements of live actor motion in mixed reality interaction. In 2014 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). 99--104.Google Scholar
- Intel. 2018. Demystifying the Virtual Reality Landscape. https://www.intel.com/content/www/us/en/tech-tips-and-tricks/ virtual-reality-vs-augmented-reality.html.Google Scholar
- Hajime Kajita, Naoya Koizumi, and Takeshi Naemura. 2016. SkyAnchor: Optical Design for Anchoring Mid-air Images Onto Physical Objects. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology (UIST '16). ACM, New York, NY, USA, 415--423. Google ScholarDigital Library
- M. Kersten-Oertel, P. Jannin, and D. L. Collins. 2012. DVV: A Taxonomy for Mixed Reality Visualization in Image Guided Surgery. IEEE Transactions on Visualization and Computer Graphics 18, 2 (Feb 2012), 332--352. Google ScholarDigital Library
- Boriana Koleva, Steve Benford, and Chris Greenhalgh. 1999. The Properties of Mixed Reality Boundaries. Springer Netherlands, Dordrecht, 119--137.Google Scholar
- Martijn J.L. Kors, Gabriele Ferri, Erik D. van der Spek, Cas Ketel, and Ben A.M. Schouten. 2016. A Breathtaking Journey. On the Design of an Empathy-Arousing Mixed-Reality Game. In Proceedings of the 2016 Annual Symposium on Computer-Human Interaction in Play (CHI PLAY '16). ACM, New York, NY, USA, 91--104. Google ScholarDigital Library
- A. Lassagne, A. Kemeny, J. Posselt, and F. Merienne. 2018. Performance Evaluation of Passive Haptic Feedback for Tactile HMI Design in CAVEs. IEEE Transactions on Haptics 11, 1 (Jan 2018), 119--127.Google ScholarCross Ref
- C. Lee, G. A. Rincon, G. Meyer, T. Höllerer, and D. A. Bowman. 2013. The Effects of Visual Realism on Search Tasks in Mixed Reality Simulation. IEEE Transactions on Visualization and Computer Graphics 19, 4 (April 2013), 547--556. Google ScholarDigital Library
- @LenaRogl. 2017. Was die Hololens macht ist übrigens weder #AR noch #VR, sondern #MixedReality :) {By the way, what HoloLens does is neither #AR nor #VR, but #MixedReality :)}. Tweet. Retrieved May 28, 2018 from https://twitter.com/LenaRogl/status/869851941966290945.Google Scholar
- David Lindlbauer and Andy D. Wilson. 2018. Remixed Reality: Manipulating Space and Time in Augmented Reality. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, New York, NY, USA, Article 129, 13 pages. Google ScholarDigital Library
- Pedro Lopes, Sijing You, Alexandra Ion, and Patrick Baudisch. 2018. Adding Force Feedback to Mixed Reality Experiences and Games Using Electrical Muscle Stimulation. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, New York, NY, USA, Article 446, 13 pages. Google ScholarDigital Library
- Laura Lotti. 2013. Through the Augmenting-Glass: The Rhetorics of Augmented Reality Between Code and Interface. Itineration: CrossDisciplinary Studies in Rhetoric, Media, and Culture (March 2013).Google Scholar
- Blair MacIntyre, Maribeth Gandy, Steven Dow, and Jay David Bolter. 2004. DART: A Toolkit for Rapid Design Exploration of Augmented Reality Experiences. In Proceedings of the 17th Annual ACM Symposium on User Interface Software and Technology (UIST '04). ACM, New York, NY, USA, 197--206. Google ScholarDigital Library
- Laura Malinverni, Julian Maya, Marie-Monique Schaper, and Narcis Pares. 2017. The World-as-Support: Embodied Exploration, Understanding and Meaning-Making of the Augmented World. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). ACM, New York, NY, USA, 5132--5144. Google ScholarDigital Library
- D. Mandl, K. M. Yi, P. Mohr, P. M. Roth, P. Fua, V. Lepetit, D. Schmalstieg, and D. Kalkofen. 2017. Learning Lightprobes for Mixed Reality Illumination. In 2017 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). 82--89.Google Scholar
- Mark McGill, Alexander Ng, and Stephen Brewster. 2017. I Am The Passenger: How Visual Motion Cues Can Influence Sickness For In-Car VR. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). ACM, New York, NY, USA, 5655--5668. Google ScholarDigital Library
- David McGookin, Koray Tahirolu, Tuomas Vaittinen, Mikko Kytö, Beatrice Monastero, and Juan Carlos Vasquez. 2017. Exploring Seasonality in Mobile Cultural Heritage. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). ACM, New York, NY, USA, 6101--6105. Google ScholarDigital Library
- Paul Milgram and Herman Colquhoun Jr. 1999. A Taxonomy of Real and Virtual World Display Integration.Google Scholar
- Paul Milgram and Fumio Kishino. 1994. A taxonomy of mixed reality visual displays. IEICE Trans. Information and Systems 77, 12 (1994), 1321--1329.Google Scholar
- Paul Milgram, Haruo Takemura, Akira Utsumi, and Fumio Kishino. 1995. Augmented reality: A class of displays on the reality-virtuality continuum. In Telemanipulator and telepresence technologies, Vol. 2351. 282--293.Google Scholar
- Takashi Miyaki and Jun Rekimoto. 2016. LiDARMAN: Reprogramming Reality with Egocentric Laser Depth Scanning. In ACM SIGGRAPH 2016 Emerging Technologies (SIGGRAPH '16). ACM, New York, NY, USA, Article 15, 2 pages. Google ScholarDigital Library
- Thomas B. Moeslund and Erik Granum. 2001. A Survey of Computer Vision-Based Human Motion Capture. Computer Vision and Image Understanding 81, 3 (2001), 231 -- 268. Google ScholarDigital Library
- C. Morales, T. Oishi, and K. Ikeuchi. 2014. {Poster} Turbidity-based aerial perspective rendering for mixed reality. In 2014 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). 283--284.Google Scholar
- Jens Müller, Roman Rädle, and Harald Reiterer. 2016. Virtual Objects As Spatial Cues in Collaborative Mixed Reality Environments: How They Shape Communication Behavior and User Task Load. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, New York, NY, USA, 1245--1249. Google ScholarDigital Library
- Jens Müller, Roman Rädle, and Harald Reiterer. 2017. Remote Collaboration With Mixed Reality Displays: How Shared Virtual Landmarks Facilitate Spatial Referencing. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). ACM, New York, NY, USA, 6481--6486. Google ScholarDigital Library
- Elizabeth D. Mynatt, Maribeth Back, Roy Want, and Ron Frederick. 1997. Audio Aura: Light-weight Audio Augmented Reality. In Proceedings of the 10th Annual ACM Symposium on User Interface Software and Technology (UIST '97). ACM, New York, NY, USA, 211--212. Google ScholarDigital Library
- Arinobu Niijima and Takefumi Ogawa. 2016. Study on Control Method of Virtual Food Texture by Electrical Muscle Stimulation. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology (UIST '16 Adjunct). ACM, New York, NY, USA, 199--200. Google ScholarDigital Library
- M. Ohta, S. Nagano, H. Niwa, and K. Yamashita. 2015. {POSTER} MixedReality Store on the Other Side of a Tablet. In 2015 IEEE International Symposium on Mixed and Augmented Reality. 192--193. Google ScholarDigital Library
- Leif Oppermann, Clemens Putschli, Constantin Brosda, Oleksandr Lobunets, and Fabien Prioville. 2015. The Smartphone Project: An Augmented Dance Performance. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15). ACM, New York, NY, USA, 2569--2572. Google ScholarDigital Library
- Sergio Orts-Escolano, Christoph Rhemann, Sean Fanello, Wayne Chang, Adarsh Kowdle, Yury Degtyarev, David Kim, Philip L. Davidson, Sameh Khamis, Mingsong Dou, Vladimir Tankovich, Charles Loop, Qin Cai, Philip A. Chou, Sarah Mennicken, Julien Valentin, Vivek Pradeep, Shenlong Wang, Sing Bing Kang, Pushmeet Kohli, Yuliya Lutchyn, Cem Keskin, and Shahram Izadi. 2016. Holoportation: Virtual 3D Teleportation in Real-time. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology (UIST '16). ACM, New York, NY, USA, 741--754. Google ScholarDigital Library
- Clément Pillias, Raphaël Robert-Bouchard, and Guillaume Levieux. 2014. Designing Tangible Video Games: Lessons Learned from the Sifteo Cubes. In Proceedings of the 32nd Annual ACM Conference on Human Factors in Computing Systems (CHI '14). ACM, New York, NY, USA, 3163--3166. Google ScholarDigital Library
- Thammathip Piumsomboon, Arindam Day, Barrett Ens, Youngho Lee, Gun Lee, and Mark Billinghurst. 2017. Exploring Enhancements for Remote Mixed Reality Collaboration. In SIGGRAPH Asia 2017 Mobile Graphics & Interactive Applications (SA '17). ACM, New York, NY, USA, Article 16, 5 pages. Google ScholarDigital Library
- Thammathip Piumsomboon, Gun A. Lee, Jonathon D. Hart, Barrett Ens, Robert W. Lindeman, Bruce H. Thomas, and Mark Billinghurst. 2018. Mini-Me: An Adaptive Avatar for Mixed Reality Remote Collaboration. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, New York, NY, USA, Article 46, 13 pages. Google ScholarDigital Library
- Belma Ramic-Brkic and Alan Chalmers. 2010. Virtual Smell: Authentic Smell Diffusion in Virtual Environments. In Proceedings of the 7th International Conference on Computer Graphics, Virtual Reality, Visualisation and Interaction in Africa (AFRIGRAPH '10). ACM, New York, NY, USA, 45--52. Google ScholarDigital Library
- Nimesha Ranasinghe and Ellen Yi-Luen Do. 2016. Virtual Sweet: Simulating Sweet Sensation Using Thermal Stimulation on the Tip of the Tongue. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology (UIST '16 Adjunct). ACM, New York, NY, USA, 127--128. Google ScholarDigital Library
- Stuart Reeves, Christian Greiffenhagen, Martin Flintham, Steve Benford, Matt Adams, Ju Row Farr, and Nicholas Tandavantij. 2015. I'D Hide You: Performing Live Broadcasting in Public. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15). ACM, New York, NY, USA, 2573--2582. Google ScholarDigital Library
- H. Regenbrecht, K. Meng, A. Reepen, S. Beck, and T. Langlotz. 2017. Mixed Voxel Reality: Presence and Embodiment in Low Fidelity, Visually Coherent, Mixed Reality Environments. In 2017 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). 90--99.Google Scholar
- Derek Reilly, Andy Echenique, Andy Wu, Anthony Tang, and W. Keith Edwards. 2015. Mapping out Work in a Mixed Reality Project Room. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15). ACM, New York, NY, USA, 887--896. Google ScholarDigital Library
- T. Richter-Trummer, D. Kalkofen, J. Park, and D. Schmalstieg. 2016. Instant Mixed Reality Lighting from Casual Scanning. In 2016 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). 27--36.Google Scholar
- Yvonne Rogers, Mike Scaife, Silvia Gabrielli, Hilary Smith, and Eric Harris. 2002. A Conceptual Framework for Mixed Reality Environments: Designing Novel Learning Activities for Young Children. Presence: Teleoperators and Virtual Environments 11, 6 (2002), 677--686. Google ScholarDigital Library
- K. Rohmer, W. Büschel, R. Dachselt, and T. Grosch. 2014. Interactive near-field illumination for photorealistic augmented reality on mobile devices. In 2014 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). 29--38.Google Scholar
- C. Rolim, D. Schmalstieg, D. Kalkofen, and V. Teichrieb. 2015. {POSTER} Design Guidelines for Generating Augmented Reality Instructions. In 2015 IEEE International Symposium on Mixed and Augmented Reality. 120--123. Google ScholarDigital Library
- Joan Sol Roo, Jean Basset, Pierre-Antoine Cinquin, and Martin Hachet. 2018. Understanding Users' Capability to Transfer Information Between Mixed and Virtual Reality: Position Estimation Across Modalities and Perspectives. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, New York, NY, USA, Article 363, 12 pages. Google ScholarDigital Library
- Joan Sol Roo, Renaud Gervais, Jeremy Frey, and Martin Hachet. 2017. Inner Garden: Connecting Inner States to a Mixed Reality Sandbox for Mindfulness. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). ACM, New York, NY, USA, 1459--1470. Google ScholarDigital Library
- Joan Sol Roo and Martin Hachet. 2017. One Reality: Augmenting How the Physical World is Experienced by Combining Multiple Mixed Reality Modalities. In Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology (UIST '17). ACM, New York, NY, USA, 787--795. Google ScholarDigital Library
- J. K. Salisbury and M. A. Srinivasan. 1997. Phantom-based haptic interaction with virtual objects. IEEE Computer Graphics and Applications 17, 5 (Sept 1997), 6--10. Google ScholarDigital Library
- T. Schwandt and W. Broll. 2016. A Single Camera Image Based Approach for Glossy Reflections in Mixed Reality Applications. In 2016 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). 37--43.Google Scholar
- Hitesh Nidhi Sharma, Sultan A. Alharthi, Igor Dolgov, and Zachary O. Toups. 2017. A Framework Supporting Selecting Space to Make Place in Spatial Mixed Reality Play. In Proceedings of the Annual Symposium on Computer-Human Interaction in Play (CHI PLAY '17). ACM, New York, NY, USA, 83--100. Google ScholarDigital Library
- Hitesh Nidhi Sharma, Zachary O. Toups, Igor Dolgov, Andruid Kerne, and Ajit Jain. 2016. Evaluating Display Modalities Using a Mixed Reality Game. In Proceedings of the 2016 Annual Symposium on ComputerHuman Interaction in Play (CHI PLAY '16). ACM, New York, NY, USA, 65--77. Google ScholarDigital Library
- Hitesh Nidhi Sharma, Zachary O. Toups, Ajit Jain, and Andruid Kerne. 2015. Designing to Split Attention in a Mixed Reality Game. In Proceedings of the 2015 Annual Symposium on Computer-Human Interaction in Play (CHI PLAY '15). ACM, New York, NY, USA, 691--696. Google ScholarDigital Library
- Maximilian Speicher, Brian D. Hall, Ao Yu, Bowen Zhang, Haihua Zhang, Janet Nebeling, and Michael Nebeling. 2018. XD-AR: Challenges and Opportunities in Cross-Device Augmented Reality Application Development. Proc. ACM Hum.-Comput. Interact. 2, EICS, Article 7 (June 2018), 24 pages. Google ScholarDigital Library
- D. Stanton, C. O'Malley, K. Huing, M. Fraser, and S. Benford. 2003. Situating Historical Events Through Mixed Reality. Springer Netherlands, Dordrecht, 293--302.Google Scholar
- Ivan E. Sutherland. 1965. The Ultimate Display. In Proceedings of the IFIP Congress. 506--508.Google Scholar
- F. Tecchia, G. Avveduto, M. Carrozzino, R. Brondi, M. Bergamasco, and L. Alem. 2014. {Poster} Interacting with your own hands in a fully immersive MR system. In 2014 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). 313--314.Google Scholar
- P. Tiefenbacher, A. Pflaum, and G. Rigoll. 2014. {Poster} Touch gestures for improved 3D object manipulation in mobile augmented reality. In 2014 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). 315--316.Google Scholar
- Brygg Ullmer and Hiroshi Ishii. 2000. Emerging frameworks for tangible user interfaces. IBM Systems Journal 39, 3.4 (2000), 915--931. Google ScholarDigital Library
- D. R. Walton, D. Thomas, A. Steed, and A. Sugimoto. 2017. Synthesis of Environment Maps for Mixed Reality. In 2017 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). 72--81.Google Scholar
- X. Wang, S. Habert, M. Ma, C. H. Huang, P. Fallavollita, and N. Navab. 2015. {POSTER} RGB-D/C-arm Calibration and Application in Medical Augmented Reality. In 2015 IEEE International Symposium on Mixed and Augmented Reality. 100--103. Google ScholarDigital Library
- Christian Weichel, Manfred Lau, David Kim, Nicolas Villar, and Hans W. Gellersen. 2014. MixFab: A Mixed-reality Environment for Personal Fabrication. In Proceedings of the 32nd Annual ACM Conference on Human Factors in Computing Systems (CHI '14). ACM, New York, NY, USA, 3855--3864. Google ScholarDigital Library
- Po-Chen Wu, Robert Wang, Kenrick Kin, Christopher Twigg, Shangchen Han, Ming-Hsuan Yang, and Shao-Yi Chien. 2017. DodecaPen: Accurate 6DoF Tracking of a Passive Stylus. In Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology (UIST '17). ACM, New York, NY, USA, 365--374. Google ScholarDigital Library
- P. Yang, I. Kitahara, and Y. Ohta. 2015. {POSTER} Remote Mixed Reality System Supporting Interactions with Virtualized Objects. In 2015 IEEE International Symposium on Mixed and Augmented Reality. 64--67. Google ScholarDigital Library
- Nesra Yannier, Kenneth R. Koedinger, and Scott E. Hudson. 2015. Learning from Mixed-Reality Games: Is Shaking a Tablet As Effective As Physical Observation?. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15). ACM, New York, NY, USA, 1045--1054. Google ScholarDigital Library
- Ya-Ting Yue, Yong-Liang Yang, Gang Ren, and Wenping Wang. 2017. SceneCtrl: Mixed Reality Enhancement via Efficient Scene Editing. In Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology (UIST '17). ACM, New York, NY, USA, 427--436. Google ScholarDigital Library
- Ya-Ting Yue, Xiaolong Zhang, Yongliang Yang, Gang Ren, Yi-King Choi, and Wenping Wang. 2017. WireDraw: 3D Wire Sculpturing Guided with Mixed Reality. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). ACM, New York, NY, USA, 3693--3704. Google ScholarDigital Library
- Daniel Yule, Bonnie MacKay, and Derek Reilly. 2015. Operation Citadel: Exploring the Role of Docents in Mixed Reality. In Proceedings of the 2015 Annual Symposium on Computer-Human Interaction in Play (CHI PLAY '15). ACM, New York, NY, USA, 285--294. Google ScholarDigital Library
- Feng Zhou, Henry Been-Lirn Duh, and Mark Billinghurst. 2008. Trends in Augmented Reality Tracking, Interaction and Display: A Review of Ten Years of ISMAR. In Proceedings of the 7th IEEE/ACM International Symposium on Mixed and Augmented Reality (ISMAR '08). IEEE Computer Society, Washington, DC, USA, 193--202. Google ScholarDigital Library
Index Terms
- What is Mixed Reality?
Recommendations
Merging environments for shared spaces in mixed reality
VRST '18: Proceedings of the 24th ACM Symposium on Virtual Reality Software and TechnologyIn virtual reality a real walking interface limits the extent of a virtual environment to our local walkable space. As local spaces are specific to each user, sharing a virtual environment with others for collaborative work or games becomes complicated. ...
Mixed Reality MIDI Keyboard Demonstration
AM '17: Proceedings of the 12th International Audio Mostly Conference on Augmented and Participatory Sound and Music ExperiencesThe Mixed Reality MIDI Keyboard is a prototype designed to augment virtual reality experiences through the inclusion of a physical interface which aligns the user's senses with the virtual environment. It also serves as a platform on which the uses of ...
Exploring User Behaviour in Asymmetric Collaborative Mixed Reality
VRST '22: Proceedings of the 28th ACM Symposium on Virtual Reality Software and TechnologyA common issue for collaborative mixed reality is the asymmetry of interaction with the shared virtual environment. For example, an augmented reality (AR) user might use one type of head-mounted display (HMD) in a physical environment, while a virtual ...
Comments