Radu-Daniel Vatavu
ABSTRACT
Our physical environments integrate more and more sensing, processing, and communications technology toward the realization of the vision of Ambient Intelligence (AmI). At the same time, virtual worlds are increasingly more linked to physical spaces by means of applications delivering the vision of Augmented and Mixed Reality (AR/MR). In this context, several opportunities emerge at the intersection of these two visions of computing. The goal of this course is to achieve the realization that AmI and MR are two sides of the same coin in order to deliver a fresh perspective to HCI researchers and practitioners interested in designing interactive experiences beyond the desktop and mobile computing paradigms by employing the concepts, principles, and methods of AmI and MR.
- Emile H.L. Aarts and Frits Grotenhuis. 2011. Ambient Intelligence 2.0: Towards Synergetic Prosperity. Journal of Ambient Intelligence and Smart Environments 3, 1(2011), 3–11. http://dx.doi.org/10.3233/AIS-2011-0090Google Scholar
Digital Library
- Ronald T. Azuma. 1997. A Survey of Augmented Reality. Presence: Teleoper. Virtual Environ. 6, 4 (1997), 355–385. https://doi.org/10.1162/pres.1997.6.4.355Google ScholarDigital Library
- Ronald T. Azuma. 2016. The Most Important Challenge Facing Augmented Reality. Presence: Teleoper. Virtual Environ. 25, 3 (Dec. 2016), 234–238. https://doi.org/10.1162/PRES_a_00264Google ScholarDigital Library
- Ronald T. Azuma. 2019. The Road to Ubiquitous Consumer Augmented Reality Systems. Human Behavior and Emerging Technologies 1, 1 (2019), 26–32. https://doi.org/10.1002/hbe2.113Google ScholarCross Ref
- Mark Billinghurst, Adrian Clark, and Gun Lee. 2015. A Survey of Augmented Reality. Found. Trends Hum.-Comput. Interact. 8, 2–3 (March 2015), 73–272. https://doi.org/10.1561/1100000049Google ScholarDigital Library
- Diane J. Cook, Juan C. Augusto, and Vikramaditya R. Jakkula. 2009. Ambient intelligence: Technologies, Applications, and Opportunities. Pervasive and Mobile Computing 5, 4 (2009), 277–298. https://doi.org/10.1016/j.pmcj.2009.04.001Google ScholarDigital Library
- Rob Dunne, Tim Morris, and Simon Harper. 2021. A Survey of Ambient Intelligence. ACM Comput. Surv. 54, 4, Article 73 (May 2021), 27 pages. https://doi.org/10.1145/3447242Google Scholar
- Bogdan-Florin Gheran, Jean Vanderdonckt, and Radu-Daniel Vatavu. 2018. Gestures for Smart Rings: Empirical Results, Insights, and Design Implications. In Proceedings of the 2018 Designing Interactive Systems Conference(DIS ’18). ACM, New York, NY, USA, 623–635. https://doi.org/10.1145/3196709.3196741Google ScholarDigital Library
- Vermeulen J., Slenders J., Luyten K., and Coninx K.2009. I Bet You Look Good on the Wall: Making the Invisible Computer Visible. In Proceedings of AmI 2009. Lecture Notes in Computer Science, vol. 5859. Springer, Berlin, Heidelberg, 196–205. https://doi.org/10.1007/978-3-642-05408-2_24Google Scholar
- Brett R. Jones, Hrvoje Benko, Eyal Ofek, and Andrew D. Wilson. 2013. IllumiRoom: Peripheral Projected Illusions for Interactive Experiences. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems(CHI ’13). ACM, New York, NY, USA, 869–878. https://doi.org/10.1145/2470654.2466112Google ScholarDigital Library
- Mike Kuniavsky. 2010. Smart Things: Ubiquitous Computing User Experience Design. Morgan Kaufmann, Burlington, MA, USA. https://doi.org/10.1016/C2009-0-20057-2Google ScholarDigital Library
- Jean-Yves Lionel Lawson, Jean Vanderdonckt, and Radu-Daniel Vatavu. 2018. Mass-Computer Interaction for Thousands of Users and Beyond. In Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems(CHI EA ’18). ACM, New York, NY, USA, 1–6. https://doi.org/10.1145/3170427.3188465Google ScholarDigital Library
- Steve Mann, Tom Furness, Yu Yuan, Jay Iorio, and Zixin Wang. 2018. All Reality: Virtual, Augmented, Mixed (X), Mediated (X,Y), and Multimediated Reality. arxiv:1804.08386 [cs.HC] https://arxiv.org/abs/1804.08386Google Scholar
- Paul Milgram and Fumio Kishino. 1994. A Taxonomy of Mixed Reality Visual Displays. IEICE Transactions on Information and Systems E77-D, 12 (December 1994), 1321–1329. https://search.ieice.org/bin/summary.php?id=e77-d_12_1321Google Scholar
- Cristian Pamparau and Radu-Daniel Vatavu. 2021. FlexiSee: Flexible Configuration, Customization, and Control of Mediated and Augmented Vision for Users of Smart Eyewear Devices. Multimedia Tools and Applications 80 (2021), 30943–30968. https://doi.org/10.1007/s11042-020-10164-5Google ScholarDigital Library
- Bogdan Pogorelc, Artur Lugmayr, Bjorn Stockleben, Radu-Daniel Vatavu, Nina Tahmasebi, Estefania Serral, Emilija Stojmenova, Bojan Imperl, Thomas Risse, Gideon Zenz, and Matjaz Gams. 2013. Ambient Bloom: New Business, Content, Design and Models to Increase the Semantic Ambient Media Experience. Multimedia Tools and Applications 66, 1 (2013), 7–32. http://dx.doi.org/10.1007/s11042-012-1228-4Google ScholarDigital Library
- Irina Popovici, Ovidiu-Andrei Schipor, and Radu-Daniel Vatavu. 2019. Hover: Exploring cognitive maps and mid-air pointing for television control. International Journal of Human-Computer Studies 129 (2019), 95–107. https://doi.org/10.1016/j.ijhcs.2019.03.012Google ScholarDigital Library
- Irina Popovici and Radu-Daniel Vatavu. 2019. Understanding Users’ Preferences for Augmented Reality Television. In Proceedings of the 18th IEEE International Symposium on Mixed and Augmented Reality(ISMAR ’19). IEEE, Washington, DC, USA, 269–278. https://doi.org/10.1109/ISMAR.2019.00024Google ScholarCross Ref
- Irina Popovici, Radu-Daniel Vatavu, Pu Feng, and Wenjun Wu. 2021. AR-TV and AR-Diànshì: Cultural Differences in Users’ Preferences for Augmented Reality Television. In ACM International Conference on Interactive Media Experiences(IMX ’21). ACM, New York, NY, USA, 50–60. https://doi.org/10.1145/3452918.3458801Google Scholar
- Ovidiu-Andrei Schipor and Radu-Daniel Vatavu. 2018. Invisible, Inaudible, and Impalpable: Users’ Preferences and Memory Performance for Digital Content in Thin Air. IEEE Pervasive Computing 17, 4 (2018), 76–85. https://doi.org/10.1109/MPRV.2018.2873856Google ScholarCross Ref
- Ovidiu-Andrei Schipor and Radu-Daniel Vatavu. 2021. Empirical Results for High-definition Video and Augmented Reality Content Delivery in Hyper-connected Cars. Interacting with Computers 33, 1 (2021), 3–16. https://doi.org/10.1093/iwcomp/iwaa025Google ScholarCross Ref
- Ovidiu-Andrei Schipor, Radu-Daniel Vatavu, and Jean Vanderdonckt. 2019. Euphoria: A Scalable, Event-Driven Architecture for Designing Interactions Across Heterogeneous Devices in Smart Environments. Information and Software Technology 109 (2019), 43–59. https://doi.org/10.1016/j.infsof.2019.01.006Google ScholarDigital Library
- Ovidiu-Andrei Schipor, Radu-Daniel Vatavu, and Wenjun Wu. 2019. SAPIENS: Towards Software Architecture to Support Peripheral Interaction in Smart Environments. Proc. ACM Hum.-Comput. Interact. 3, EICS, Article 11 (June 2019), 24 pages. https://doi.org/10.1145/3331153Google ScholarDigital Library
- Richard Skarbez, Missie Smith, and Mary C. Whitton. 2021. Revisiting Milgram and Kishino’s Reality-Virtuality Continuum. Frontiers in Virtual Reality 2 (2021), 27. https://doi.org/10.3389/frvir.2021.647997Google ScholarCross Ref
- Maximilian Speicher, Brian D. Hall, and Michael Nebeling. 2019. What is Mixed Reality?. In Proceedings of the CHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 1–15. https://doi.org/10.1145/3290605.3300767Google ScholarDigital Library
- Norbert Streitz, Dimitris Charitos, Maurits Kaptein, and Marc Böhlen. 2019. Grand challenges for ambient intelligence and implications for design contexts and smart societies. Journal of Ambient Intelligence and Smart Environments 11 (2019), 87–107. http://dx.doi.org/10.3233/AIS-180507Google ScholarDigital Library
- Jean Vanderdonckt and Radu-Daniel Vatavu. 2018. Designing, Engineering, and Evaluating Gesture User Interfaces. In Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems(CHI EA ’18). ACM, New York, NY, USA, 1–4. https://doi.org/10.1145/3170427.3170648Google ScholarDigital Library
- Radu-Daniel Vatavu. 2013. On Designing Interactivity Awareness for Ambient Displays. Multimedia Tools and Applications 66, 1 (2013), 59–80. http://dx.doi.org/10.1007/s11042-012-1140-yGoogle ScholarDigital Library
- Radu-Daniel Vatavu. 2013. There’s a World Outside Your TV: Exploring Interactions beyond the Physical TV Screen. In Proceedings of the 11th European Conference on Interactive TV and Video(EuroITV ’13). ACM, New York, NY, USA, 143–152. https://doi.org/10.1145/2465958.2465972Google ScholarDigital Library
- Radu-Daniel Vatavu. 2015. Gesture Interfaces, Ambient Intelligence, and Augmented Reality for the Interactive TV. In Proceedings of the ACM International Conference on Interactive Experiences for TV and Online Video(TVX ’15). ACM, New York, NY, USA, 197–198. https://doi.org/10.1145/2745197.2745698Google ScholarDigital Library
- Radu-Daniel Vatavu. 2016. Tools for Designing for Home Entertainment: Gesture Interfaces, Augmented Reality, and Smart Spaces. In Proceedings of the CHI Conference Extended Abstracts on Human Factors in Computing Systems(CHI EA ’16). ACM, New York, NY, USA, 1003–1006. https://doi.org/10.1145/2851581.2856676Google ScholarDigital Library
- Radu-Daniel Vatavu. 2017. Fundamentals of Gesture Production, Recognition, and Analysis. In Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems(CHI EA ’17). ACM, New York, NY, USA, 1174–1177. https://doi.org/10.1145/3027063.3027106Google ScholarDigital Library
- Radu-Daniel Vatavu. 2017. Smart-Pockets: Body-Deictic Gestures for Fast Access to Personal Data during Ambient Interactions. International Journal of Human-Computer Studies 103 (2017), 1–21. https://doi.org/10.1016/j.ijhcs.2017.01.005Google ScholarDigital Library
- Radu-Daniel Vatavu, Lisa Anthony, and Jacob O. Wobbrock. 2012. Gestures as Point Clouds: A $P Recognizer for User Interface Prototypes. In Proceedings of the 14th ACM International Conference on Multimodal Interaction(ICMI ’12). ACM, New York, NY, USA, 273–280. https://doi.org/10.1145/2388676.2388732Google ScholarDigital Library
- Radu-Daniel Vatavu, Lisa Anthony, and Jacob O. Wobbrock. 2014. Gesture Heatmaps: Understanding Gesture Performance with Colorful Visualizations. In Proceedings of the 16th International Conference on Multimodal Interaction(ICMI ’14). ACM, New York, NY, USA, 172–179. https://doi.org/10.1145/2663204.2663256Google ScholarDigital Library
- Radu-Daniel Vatavu, Lisa Anthony, and Jacob O. Wobbrock. 2018. $Q: A Super-Quick, Articulation-Invariant Stroke-Gesture Recognizer for Low-Resource Devices. In Proceedings of the 20th International Conference on Human-Computer Interaction with Mobile Devices and Services(MobileHCI ’18). ACM, New York, NY, USA, Article 23, 12 pages. https://doi.org/10.1145/3229434.3229465Google ScholarDigital Library
- Radu-Daniel Vatavu and Laura-Bianca Bilius. 2021. GestuRING: A Web-Based Tool for Designing Gesture Input with Rings, Ring-Like, and Ring-Ready Devices. In Proceedings of the 34th Annual ACM Symposium on User Interface Software and Technology(UIST ’21). ACM, New York, NY, USA, 710–723. https://doi.org/10.1145/3472749.3474780Google ScholarDigital Library
- Radu-Daniel Vatavu, Catalin Marian Chera, and Wei-Tek Tsai. 2012. Gesture Profile for Web Services: An Event-driven Architecture to Support Gestural Interfaces for Smart Environments. In Proceedings of the International Joint Conference on Ambient Intelligence. Lecture Notes in Computer Science, vol. 7683(AmI’12), Paternò F., de Ruyter B., Markopoulos P., Santoro C., van Loenen E., and Luyten K. (Eds.). Springer, Berlin, Heidelberg, 161–176. http://dx.doi.org/10.1007/978-3-642-34898-3_11Google Scholar
- Radu-Daniel Vatavu, Pejman Saeghe, Teresa Chambel, Vinoba Vinayagamoorthy, and Marian F Ursu. 2020. Conceptualizing Augmented Reality Television for the Living Room. In Proceedings of the ACM International Conference on Interactive Media Experiences(IMX ’20). ACM, New York, NY, USA, 1–12. https://doi.org/10.1145/3391614.3393660Google ScholarDigital Library
- Radu-Daniel Vatavu and Jacob O. Wobbrock. 2016. Between-Subjects Elicitation Studies: Formalization and Tool Support. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems(CHI ’16). ACM, New York, NY, USA, 3390–3402. https://doi.org/10.1145/2858036.2858228Google ScholarDigital Library
Index Terms
- Designing Interactive Experiences in the Interplay between Ambient Intelligence and Mixed Reality
Index terms have been assigned to the content through auto-classification.
Recommendations
Are Ambient Intelligence and Augmented Reality Two Sides of the Same Coin? Implications for Human-Computer Interaction
CHI EA '22: Extended Abstracts of the 2022 CHI Conference on Human Factors in Computing SystemsWe revisit the foundational principles of Ambient Intelligence (AmI) and Augmented Reality (AR) environments to discuss the perspective that AmI and AR feature the same vision of computing, as intuited at their origins, despite their recent development ...
User Experience Guidelines for Designing HMD Extended Reality Applications
Human-Computer Interaction – INTERACT 2019AbstractWith the rise of Extended Reality (XR) technologies, such as head mounted displays (HMD) for Virtual Reality (VR), Mixed Reality (MR), and Augmented Reality (AR), designers are presented with many unique challenges and opportunities when creating ...
Designing and implementing interactive and realistic augmented reality experiences
In this paper, we propose an approach for supporting the design and implementation of interactive and realistic Augmented Reality (AR). Despite the advances in AR technology, most software applications still fail to support AR experiences where virtual ...
Comments