Abstract
The way we are experiencing and interacting with our everyday living environment define and anticipate our future behavior and actions. Today new digital technologies vastly diminish boundaries between virtual and physical world. Cross-reality design supported with recent mobile and context aware computing, gradually changed the concept of user interaction and moved it more toward usage of heterogeneous contexts, pervasive computing technologies, and multimodal spatial perception and transformed our living surroundings into smart environments, traditional living object into smart living objects. Ubiquitous computing vision implies more than ever to our lives. In order to make all these changes more human-centered in this paper we are investigated the cognitive and metaphorical aspects of future interface design strategies which could enhance user experience and ideas acceptance, communicated through multimodal interactions. In this paper we are presenting three tangible interfaces that we have developed for design and research purposes and results we collected during their public exposure. Hopefully, the results will give us sufficient insights for further investigations in the field of smart living environments and smart objects development. We believe that to fulfill these goals application and exploration of tangible interfaces frameworks and cognitive methods could be one of the crucial elements for the future research success.
Keywords
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Weiser, M., Brown, J.S.: The coming age of calm technology. In: Denning, P.J., Metcalfe, R.M. (eds.) Beyond Calculation: The Next Fifty Years of Computing. Copernicus, Göttingen (1998)
Muller, J., Alt, F., Michelis, D. (eds.): Pervasive Advertising, pp. 1–30. Springer, Berlin (2011)
Van Waart, P., Mulder, I., De Bont, C.: Meaningful advertising. In: Muller, J., Alt, F., Michelis, D. (eds.) Pervasive Advertising, pp. 57–79. Springer, Berlin (2011)
Coleman, B.: Using sensor inputs to affect virtual and real environments. IEEE Pervasive Comput. 8(3), 16–23 (2009)
Dindar, N., Balkesen, C., Kromwijk, K., Tatbul, N.: Event processing support for cross-reality environments. IEEE Pervasive Comput. Mag. 8(3), 34–41 (2009). Special Issue on Cross-Reality Environment
Fitzmaurice, G., Ishii, H., Buxton, W.: Bricks: laying the foundations for graspable user interfaces. In: Proceedings of the CHI 1995 Conference on Human Factors in Computing Systems, Denver, Colorado, pp. 442–449 (1995)
Ishii, H., Ullmer, B.: Tangible bits: towards seamless interfaces between people, bits, and atoms. In: Proceedings of the CHI 1997 Conference on Human Factors in Computing Systems, Atlanta, Georgia, pp. 234–241 (1997)
Feiner, S., MacIntyre, B., Hollerer, T.: A touring machine: prototyping 3D mobile augmented reality systems for exploring the urban environment. In: Proceedings of the 1st International Symposium Wearable Computers (ISWC 1997), pp. 74–81. IEEE, CS Press (1997)
Mark, G.: Extreme collaboration. Commun. ACM 45(6), 89–93 (2002)
Lifton, J., Laibowitz, M., Harry, D., Gong, N., Mittal, M., Paradiso, J.: Metaphor and manifestation: cross reality with ubiquitous sensor/actuator networks. IEEE Pervasive Comput. Mag. 8, 24–33 (2009)
Askay, S.: New visualization tools for environmental sensor networks: using Google earth as an interface to micro-climate and multimedia datasets. Master’s thesis, Department Environmental Sciences, University of California, Riverside (2006)
Reilly, D., Voida, S., McKeon, M., Le Dantec, C., Edwards, W.K., Mynatt, E., Mazalek, A.: Space matters: physical-digital and physical-virtual co-design, in the inspace project. IEEE Pervasive Comput. 9(3), 54–63 (2010)
Mistree, B.F.T., Paradiso, J.A.: ChainMail – a configurable multimodal lining to enable sensate surfaces and interactive objects. In: Proceedings of TEI 2010, pp. 65–72 (2010)
Reilly, D., Tang, A., Wu, A., Echenique, A., Massey, J., Mathiasen, N., Mazalek, A., Edwards, W.K.: Organic UIs and cross-reality spaces. In: 2nd International Workshop on Organic User Interfaces (OUI 2011), TEI 2011, Madeira, Portugal (2011)
Nardi, B. (ed.): Context and Consciousness: Activity Theory and Human-Computer Interaction. MIT Press, Cambridge (1996)
Leont’ev, A.N.: Activity, Consciousness, Personality. Prentice Hall, Englewood Cliffs (1978)
Engeström, Y.: Learning, Working and Imagining: Twelve Studies in Activity Theory. Orienta-Konsultit Oy, Helsinki (1990)
Hinckley, K., Pausch, R., Goble, J.C., Kassell, N.F.: Passive real-world interface props for neurosurgical visualization. In: Proceedings of the CHI 1994 Conference on Human Factors in Computing Systems, Boston, Massachusetts, pp. 452–458 (1994)
Harrison, B., Fishkin, K., Want, R., Gujar, A., Mochon, C.: Squeeze me, hold me, tilt me! An exploration of manipulative user interfaces. In: Proceedings of the CHI 1998 Conference on Human Factors in Computing Systems, Los Angeles, California, pp. 17–24 (1998)
Fishkin, K., Moran, T., Harrison, B.: Embodied user interfaces: towards invisible user interfaces. In: Chatty, S., Dewan, P. (eds.) Engineering for Human–Computer Interaction, pp. 1–18. Springer Science + Business Media, New York (1998)
Ullmer, B., Ishii, H.: Emerging frameworks for tangible user interfaces. In: Carroll, J.M. (ed.) Human–Computer Interaction in the New Millennium, pp. 579–601. Addison-Wesley, New York (2001)
Fishkin, K.P.: A taxonomy for and analysis of tangible interfaces. J. Pers. Ubiquit. Comput. 8(5), 347–358 (2004)
Mithen, S.: The Prehistory of the Mind. Thames and Hudson, London (1996)
Brown, T.: Making Truth: Metaphor in Science. University of Illinois Press, Champaign (2003)
Kuhn, T.S.: Metaphor in science. In: Ortony, A. (ed.) Metaphor and Thought, 2nd edn, pp. 1–539. Cambridge University Press, Cambridge (1993)
Goldin-Meadow, S.: Structure in a manual communication system developed without a conventional language model: language without a helping hand. In: Whitaker, H., Whitaker, H.A. (eds.) Studies in Neurolinguistics, vol. 4, pp. 125–209. Academic Press, New York (1979)
Goldin-Meadow, S.: The representation of semantic relations in a manual language created by deaf children of hearing parents: a language you can’t dismiss out of hand. Ph.D. thesis (1975)
Gorbet, M.: Beyond input devices: a new conceptual framework for the design of physical–digital objects. Masters thesis, MIT Media Laboratory, Cambridge, Massachusetts (1998)
Kuhn, D.: The Skills of Argument. Cambridge University Press, Cambridge (1991)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2016 ICST Institute for Computer Sciences, Social Informatics and Telecommunications Engineering
About this paper
Cite this paper
Nikolic, P.K. (2016). Multimodal Interactions: Embedding New Meanings to Known Forms and Objects. In: Mandler, B., et al. Internet of Things. IoT Infrastructures. IoT360 2015. Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering, vol 170. Springer, Cham. https://doi.org/10.1007/978-3-319-47075-7_13
Download citation
DOI: https://doi.org/10.1007/978-3-319-47075-7_13
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-47074-0
Online ISBN: 978-3-319-47075-7
eBook Packages: Computer ScienceComputer Science (R0)